^^sure, Swat is excellent for pre-PhD, but I have the same problem there - its a personal thing. Enrolling in a LAC to take classes at a R1 kinda defeats the purpose of a LAC, IMO, particularly when the Recs that are needed will mostly come from the Penn profs (who will be teaching the upper division neuro courses. Just go to Penn in the first place.
The other possible downside with Swat is for premed. Rumor has it that Swat is not exactly generous with A’s. But that just could be rumor and not fact.
(To maximize GPA, Amherst would be my first choice.)
Decisions, decisions. Good luck OP, there is no wrong answer here.