Many such students do not merely think their quality of life will not be as good as it should be; they know this from firsthand experience.
I’ll add that this is the case not only for prospective undergrads but also to some extent for grad students and faculty as well. My boyfriend and I did not entirely rule out applying for jobs in the South when we were on the academic job market, but neither of us was keen on taking a job at a southern college.