You should check out Rice. They have a Master’s and Doctoral program in Human-Computer Interaction and Human Factors. Obviously you are not looking at grad schools, but they have undergrad classes on the topic taught by the faculty of that department and you would be able to get involved in research in the area. The head of the department got his undergrad in Psych and Engineering from Michigan and then a Masters in CS and PhD in Psych. Sounds like his path is similar to what you’re looking for.
https://psychology.rice.edu/human-factors-human-computer-interaction
Rice had a collaborative environment and MANY students double major. They have distribution requirements so that students take classes outside their field, which allows you to examine other interests.