Actually, while the physics major core is rather standard, some smaller departments may offer some of the courses very infrequently, like once every two years or less often. This can be disadvantageous.
For small schools for geology, consider those with “mines” or “mining” in their names.