<p>Harvard has a tiny permanent math faculty that is of extremely high quality. (The size probably accounts for the rankings.) MIT has a much larger faculty that is also very good. Each department certainly has its own "feel" and you should figure out what that is when you visit and whether it suits you.</p>
<p>Harvard's graduate school in math is certainly harder to get into than MIT's, for what it's worth.</p>