Can I not take math in my junior year to replace it with another class?

I know the question seems a bit weird.

I am taking AP Calculus AB this year (10th Grade) and I’m doing pretty good. I took Pre-Calc in 9th Grade because I was put in the Accelerated Program back in 6th grade and took Algebra 1 in 6th grade.

Since I have no intent in majoring in any STEM field of study, I want to take a humanities class instead of math if I can. I want to take AP Euro History instead of more Calculus so that I can take all the history AP classes and get a perfect humanities endorsement.

My schedule in 11th grade is supposed to be:
AP English 3
AP Calculus BC
Physics
AP US History
AP French Language and Culture
Band
AP Art History

But I want to change it to:
AP English 3
AP European History
Physics
AP US History
AP French Language and Culture
Band
AP Art History

Am I allowed to do this without being penalized?

Depends on your target colleges.

If you are targeting a college like MIT or Caltech, where humanities majors are expected to be highly comfortable with math anyway, it can matter. It can also matter if you are targeting colleges that want to see math or math-heavy courses senior year, like Washington publics. At some super-competitive admissions colleges, going above and beyond in math may help set you apart in a good way from other prospective humanities major applicants (some of whom may be mathphobic and stop math after algebra 2).

However, most colleges do not expect a prospective humanities major to go beyond calculus. But you may find it generally useful to take AP statistics and AP CS principles (both of which are generally considered to be not very hard) some time during high school, although if you do not, you can take similar courses in college.