If you include Brandeis, I’m actually a bit surprised that it zoomed to the top of this list and has stayed there since 1970.
https://books.google.com/ngrams/graph?content=Oberlin+College%2CHaverford+College%2CDavidson+College%2CAmherst+College%2CWilliams+College%2CPomona+College%2CBowdoin+College%2CCarleton+College%2CBrandeis+University&year_start=1945&year_end=2008&corpus=0&smoothing=3&share=&direct_url=t1%3B%2COberlin%20College%3B%2Cc0%3B.t1%3B%2CHaverford%20College%3B%2Cc0%3B.t1%3B%2CDavidson%20College%3B%2Cc0%3B.t1%3B%2CAmherst%20College%3B%2Cc0%3B.t1%3B%2CWilliams%20College%3B%2Cc0%3B.t1%3B%2CPomona%20College%3B%2Cc0%3B.t1%3B%2CBowdoin%20College%3B%2Cc0%3B.t1%3B%2CCarleton%20College%3B%2Cc0%3B.t1%3B%2CBrandeis%20University%3B%2Cc0
You have to exclude Wesleyan from this list, because there is also “Ohio Wesleyan University”, “Texas Wesleyan University”, etc.