You’re going to change your mind again. That’s why choosing a college based on a major is risky, unless you’re absolutely sure.
However, many LACs have fine Physics departments for kids who are taking AP Physics 1/2 in high school. If need be, go study abroad at a university that offers lots of physics classes (in the UK, Australia… unless you’re bilingual) to complete your courses, but you should be okay since you’ll be starting with the first course in the first year sequence.
Your first year you’ll have general physics, and then you’ll reconsider whether you want to go on or not. Perhaps you’ll find economics equally exciting, or will find yet another subject you love.