Lafayette College Party/Social Scene

I’m a hs senior and love Lafayette. From what I’ve read most parties are dominated by frats/sports. If not involved with athletics or greek life is campus life boring or is there still plenty of activities to do/parties to attend?