I’d respond, “I don’t see color but apparently you do.”
If things continue to get worse, meet with the teacher & principal and follow everything up with an email to the teacher & principal detailing the conversation and thanking them for addressing the situation in advance.
You need to get it on record that the teacher & principal are very well aware of this situation. Ultimately, this holds the school accountable for future actions.