I think I want to drop to a lower math?

You should have been going to professor office hours, forming a study group, looking at Khan Academy videos, talking to the TA, getting a tutor or going to the math center if your college has one.