That said, I think it is objectively true that Rochester is a) larger b) a university rather than a college c) more socioeconomically diverse d) in a more urban setting. If either of those tip the balance for you, they are significant differences.
On socioeconomic diversity, this is a worthwhile read: https://www.nytimes.com/interactive/2017/01/18/upshot/some-colleges-have-more-students-from-the-top-1-percent-than-the-bottom-60.html?_r=0. For high concentrations of wealthy kids, Colgate is top 10, while Rochester is in the 150s. That alone would point ME towards Rochester, but you may feel differently.