It is a zero sum game - there are only so many spots. If the goal is to increase representation of some underserved groups, it will come at the cost of decreasing representation of others.
The elephant in the room question, imo, is whether that is ok. Is it de facto racist to do away with a criterion that disproportionately impacts one group? Or is it de facto racist to keep it? Which is worse?