Let me give you the perspective of a physics professor. It is good that you got a B in your Calculus 2 class but you should consider the possibility of taking both Calculus 1 and 2 again at UCSB. They are foundational courses for physics and having a strong base will help you in your later classes. You have taken them twice already and maybe you won’t want to give them a third go-round but at least consider it and discuss it with your academic advisor.
What I actually plan on doing was spending this summer hammering my math, starting with precalc. I plan to review and do practice problems up to calc 2. If I do that, should I still retake it? UCSB said I will get the credit for those classes but the GPA won’t transfer, so I wanted to take those credits and jump ahead. I’m fully aware the immense importance math has for physics.