AP Scores

I just got my AP scores back and I am a little worried. Last year (sophomore) I took AP European History and got a 4. This year I took AP American History and got a 4 and AP Physics and got a 2!! I plan on applying to an Ivy early decision and have a 3.9 GPA. I have a long list of extracurriculars and I may be recruited for swimming. Are these scores bad? What should I submit? Is it bad I have no 4s?