Second Quarter grades slipping

I have 2 C’s (AP Calc and AP Psych), 2 B’s (AP Comp Sci and Honors English), an unrecieved grade that is likely a B (AP Physics), while my other 2 Non-AP classes are A’s. This is making me freak out because I actually recieved great grades on my first quarter (All A’s, one B). I’ve applied to multiple Non-Ivy League (but still competitive) schools, and most are asking for Midyear grades. I believe my downfall was the fact that I was hired at the end of my first quarter, and had some trouble getting used to my new schedule quickly enough. I’m not sure if this sudden dip will cause colleges to reject me, despite the improvement I’ve had since freshmen year, and any likely advances I’ll be taking during my second semester. Will colleges care about this? What should I do?