Do colleges frown upon dropping an honors class?

I’m currently a junior in highschool, so far my grades have been all A’s until this year. I am struggling in Honors PreCalculus- in fact, I wanted to drop the class earlier in the semester but my counselor recommended that I stayed in the class. For the first 6 weeks, I got a 66, second 6 weeks I got a 71 and now I am sitting at a 75. I am at risk of failing the semester and I just don’t know how to handle this. I am devastated. In all of my other classes, which are AP, I have an A average (in Honors Physics I have a low/mid B average). My GPA is above 3.85.
I have already made up my mind to drop to regular PreCalc- I just wonder how much this will damage me. I’m preparing to fail this semester but I really, really would like to pass the class with even a low C (but I would have to get a remarkably high grade on my final, so I’m already preparing for the worst). I am at my breaking point.