Being from NJ, I know a lot of people that go to Rutgers. That’s probably the main reason why the stigma is there about NOT wanting to go from there as a NJ resident. But hey I’ve always liked it. 
Distance is a personal preference just like Greek life and campus size. Also, due to finances and family, jetsetting off to California may not always be the most feasible option. Travelling on holidays, emergency travels to and/or fro (can’t really anticipate those), parent/family visits etc. are all factors that have to be considered when going farther than a ~10 hour drive. Everyone is different and not all kids (or parents) are comfortable being so far away from home.