At most not-small institutions you are not going to befriend the entire student body in any event.
At my school, for the most part, one found their own group of like-minded individuals to hang out with, and proceeded largely with them. A lot of that sorting took place as underclassmen in one’s places of residence .
I imagine even at the so-called “party schools” there are plenty of students who do not “party”, yet still hang out with friends and have a satisfactory social life.
At whatever school you go to there may be plenty of people who you do not like or you have nothing in common with. You don’t hang out with those people. You hang out with people you like. It’s the same in “real life”, after college.
At a very small school, the prevailing campus culture may be more influential and the like-minded individuals may be hard to find if you don’t fit.
But at a larger school, often each subgroup will be represented and sizable enough to form a sufficient network, once you find them.