Several hundred (thousand?) schools “believe” differently. And since they hold the keys to the front door, you have to play by their rules.
OTOH, if you feel so strongly, don’t apply to such colleges. There are plenty that “believe” as you do.
I put believe in quotes bcos your belief is meaningless when colleges have tons of research data to indicate that test scores help them craft a ‘better’ class (however they define it). If it didn’t benefit the colleges, they would not use the scores.
Incidentally, what about the 3.3 student who struggled for a year or two, but then got into a groove with some A’s. A strong test score in such a case gives the college a comfort level that the kid could do the work.