Have you ever gone to a job interview and thought, “wow, I cannot imagine myself here!” even though the job sounded perfect on paper?
Visiting schools is similar. I recall a friend (back in the 70s - some people visited even back then!) feeling so uncomfortable at one school that had recently started admitting women that she decided not to apply even though it was #1 on paper. Often, the social vibe will be apparent to kids in a way that it’s not to their parents.
Most schools offer an excellent education. The residential environment is often was differs most.