I wouldn’t worry about looking insane. This is your chance to get an education.
But make sure you aren’t jumping just because you’ve had trouble finding your “people”. That takes time, no matter where you go, and no matter how small the student body. Wherever you go- there you are, as the saying goes. Which means you need to make sure you’ve really thrown yourself into exploring all the academic and intellectual resources, AND reaching out to all kinds of people and groups and activities before concluding that it’s not there. But might be somewhere else.
What do your parents say?