How much do freshman and sophomore year matter?

I’m currently a junior and and doing pretty well in school (3.8 GPA and involved in a wide range of extra curriculars) however, my performance this year is the complete oppposite of previous years. Freshman and sophomore year I did awful and had an average of a 2.9-3.0 GPA and was only involved in one or two activities. How much will my poor performance in my first two years effect my chances of getting into schools?

A list of schools I’m interested in:
Penn state
Syracuse
University of Michigan
University at Buffalo
SUNY Fredonia
Boston University

Since there is an upward trend in grades, I wouldn’t worry about it.