Would Remedial Math Look Bad on my Transcript?

I attended Amherst to please a family member and ended up being miserable there. I was never able to find my niche socially nor academically in that small, tight-knit community. I’m very interested in transferring to a larger school of equal caliber if possible. I would need to take the SAT in order to achieve that but as I said, my math is a considerable weakness.