Advice from people who have taken summer courses?

I had a rough 18 course fall semester, and I was hoping to still squeeze in some me time.
I’m taking 6 credits this summer but one of them is intermediate algebra. Unfortunately math and I have never gotten along, I also have a part time job (that’s essentially full time since we’re short staffed).
As someone whose taken summer courses:
Should I give up on having fun this summer now or hold onto to that hope?
How did you manage enjoying the sun and classes?
(Side note: I know this is extremely trivial but after the hellish semester I had I’m desperate for any form of relaxation.)