Pretty much all besides Brown will have at least some general education or core curriculum requirements. Of course, a math or physics major will have to take substantial liberal arts courses even at Brown, since math and physics are liberal arts.
Some of the schools with the heaviest general education or core curriulum requirements besides Chicago and Columbia are MIT and Harvey Mudd. If you really want to know, you can go to each school’s web site and look up its degree requirements.