International student 5 years of English

I came here from Japan around 5 years ago and because of that in freshman year and sophomore year I had many Bs
(I take all AP/honor classes) Im a junior right now and have only one B (again, AP english III)
If I screwed up in Freshman/Sophomore year (because of the disadvantages) and have lower GPA, does this mean I can not get into top colleges or will they understand why I had Bs in freshman/ sophomore years and look at how much I have improved?
I am really disappointed in myself when looking at those Bs I made especially in freshman year because I couldn’t understand English but was forced to take Pre AP English Pre AP Bio etc
I do orchestra, golf and am the leader of 4 clubs also was awarded for the volunteering hours
Will those extracurriculars make up for my “bad” grades
Because if i was a native english speaker I could have had all As or few Bs
but i feel like the colleges only look at overall GPA and will disregard why I got those bad grades in Freshman year
I want to now what my chances of getting into top colleges
In my opinion because of my low GPA and those Bs I made in freshman year I will not get into any top colleges even though the reason behind it was due to the lack of English knowledge
If anyone can help me with my situation please let me know

know* not now (typo sorry)

Explain your situation in your essay; your language skills will be taken into consideration by the admissions committees. Plenty of students with a few Bs on their record get into top schools, even Ivies, if they have outstanding ECs, a great essay and/or very high SATs.

When were you exited from ESOL? Before 9th grade, or after 9th grade? If you were still in ESOL classes in high school, that will show on your transcript. Your guidance counselor and teachers who write letters of recommendation can also mention this in their letters.

in 9th grade that was my first time taking actual English Pre Ap course before that I was taking ESL