You may want to get a second opinion from a different advisor.
I find it hard to believe that you wouldn’t be able to complete a major in psych, a few semesters each of sign language and a foreign language (which I imagine would contribute to your core requirements) and the interdisciplinary honors courses in four years.
I don’t think there’s a lot of formal value added in completing a “social justice” minor. You can take courses in that concentration without having to complete the minor. Maybe that will provide the wiggle room that you need.
Is part of your buyer’s remorse also based on affordability/loans?
Is there a plan B? Would you take a gap year or try to get into a college for the fall where there is still space?