It’s just limited, in general, to think of colleges as if they are extensions of your own high school, jocks in one corner, brainiacs in another.
Instead of “elite,” I might have said, “more academically competitive” or “more intensity in the major,” which opens up more than just the flat notion of prestige in some general ranking.
Top notch is more than that.