Its very important to visit colleges - especially with a stubborn kid that has no idea what a college campus is really like. (probably all our kids). My kid ruled out 3 colleges by visiting - but better than that, he realized he did NOT want a LAC and did want a larger university. That is the benefit of the college visits.
Go look at the school calendar and you will see many opportunities to visit colleges without missing a single day of school. There are in-service days, holidays (where colleges are in session - like Columbus, Veterans, MLK, etc…), school vacation week (spring break varies by college - its 1 week in March - you will find many colleges where their spring break is not the same as your kids). Also MANY colleges do special weekend events in the fall and spring. For example, Fordham has one this weekend - “Fall Preview” on Saturday or Sunday. They have a spring preview too.
https://www.fordham.edu/info/24378/visit_days_and_open_houses
There are at least a dozen colleges and universities within 20 miles of Berklee in Boston (Boston Conservatory). Not sure if that conservatory is elite enough for your S.
Its going to be hard for your son to figure out what he wants to do if he spends all his time doing what he doesn’t want to do.
Also, I call BS on all the homework. Your son has 2 frees and spends 6 hours on the weekend doing homework? Maybe he’s secretly playing video games ( 
- you wish)