One factor that I don’t think has been mentioned is Greek life/fraternities & sorrorities.
If you like it, Vandy’s for you. If you don’t, it’s not.
It’s not a small factor in campus culture, and its absence was one reason I chose Williams (over Dartmouth) back in the day.