I agree that your intended major is very physics heavy. I would encourage you to look at the four year plans of study at the schools you are considering to be sure the courses appeal to you.
I also agree that you don’t need to retake a B grade but you should consider AP physics next year if this is the major you want to pursue.