Williams’ math department is widely acknowledged as among the very best and has the awards to show for it.
And of course there’s Harvey Mudd…
In general, though, there are pros and cons. The cons? Fewer course offerings. The pros? No TA-led class sessions, close interaction with brilliant and accomplished professors, and, perhaps the best, all research opportunities are available to undergrads.