Will my Freshmen year hurt my transcript?

In my Freshmen year, I didn’t really do that well in terms of grades. I had an unweighted GPA of 3.5, and a weighted of a 3.66. (2 B’s in Honors English, rest from other classes)

For my current year schedule (Sophomore), I have AP World + Honors English, which is 2/3 the AP/Honors, only missing out of Honors Precal.

In Junior year, I’ll probably take 3 AP and 1 honors. (undecided which classes specifically)

Assuming I get straight A’s, I’ll have around an unweighted GPA of around a 3.8, and a weighted GPA around a 4.1

Would these stats be bad GPA wise if I was aiming towards a prestigious school?

You are where you are. All you can do is do better in harder classes. That will show that you can do college work.