@KingJohnRocks
In a word, yes, you are way over-reacting. The “Ivies” are a sports league. That’s it. Unless something about D1 athletics without scholarships is important to you, put the “Ivies” out of your head.
Please, please, please do this. Do intelligent, thoughtful research and reflection on what kind of college experience you want (“Ivies” range from “nearly-a-rural-LAC Dartmouth” to “to nearly a top-tier mid-state State U Cornell” to "another very good, competitive urban U Penn, Columbia or Harvard.)
1st thing to do is spend some time thinking about what KIND of educational experience you want:
What part of the US, what kind of environment, size, “vibe?” Religious? Are research opportunities important? Study abroad? Social life?
Big, bustling U with tons of opportunities at the school and in the community for culturual activies? (So maybe a big, big city research U like NYU, Columbia, Penn, Drexel, GW, Harvard, Northeastern, USC, Emory, UChicago)
or maybe a Smaller big-city school where you get the urban environment but a bit more intimate feel? (USF, LMU, USD, Occidental, etc. etc. etc.)
or maybe a bigger rural/small town school - (Cornell, GSU, Elon, James Madison, etc. etc. etc.)
or one of the many excellent small rural/small town/suburban LACs or small research (from Bates to Pomona, Reed to Berea etc.)
Once you narrow to some schools speak with whoever will be helping you pay for college. Run some net price calculators with them. Add in a few thousand in “extras” you don’t even know you need. Then talk about a) Can you afford some of the schools you looked at. b) Are they worth it?
If you are planning/hoping to go to law school or other post-grad you may need a lot more money for education down the line as well. In most cases a reasonably prices state school will be your best undergraduate option, unless you get a lot of merit aid, have a lot of resources, or get a lot of fin aid.
Once you have a list of what kind of school you want and what you can afford, make your list to apply to. Sure, include an Ivy if it fits your criteria, but if not going to an Ivy were some sort of hinderance to success, all but about 1% of the students graduating any give year would be SOL.
I’ll end with a stock story about a friend’s kid. They were a very good student, ambitious, hardworking, good grades, 80+ standardized test. They applied a few years ago, when the application environment was as hard as it had been, and did not get into the “elite” schools they had hoped to be able to say they got into (because, honestly, for a 17 year old who has never even been to college, you are really applying to a sweat shirt.) The ended up attending GWU with really good merit aid. Their first day at GW I wrote to see how it had been going (since I had encouraged them to take the $$ as the student wanted to be a lawyer with interest in politics it was a great fit.) The email I got back described their first day on campus, where the guest speaker in the intro Pol Sci course was SOTUS Justice O’Connor and their art history course took a tour of the national mall… They have since graduated happily and relatively debt free and are off to law school.
Good luck. You’ll find a great school if you do the search for YOU not for the sweat shirt.