Well since you said you’re not focused on math as a career choice at the moment, that cuts out pre-med, pre-pharm etc. Even though you probably will not be classified as the most rigorous in your GC’s rating of you, I don’t think it will prevent you from being considered. Sure, there will be other kids with competitive stats but there’s only so much you can do through the school.
Is it possible for you to take Calc at a CC or online? If so, you should definitely pursue that route. You have four years to go through high school and gain a possibly stronger footing in math.