I would not worry about aspects you cannot control.
According to Naviance:
My son is the first person from his high school ever to go to Williams.
No one from his high school had ever been accepted to Yale until last year, when someone was.
There are other similar anecdotes from his school.
You can’t control what a college thinks of your high school, but you can control your own application. Write a good application and hope for the best, while applying to matches and safeties in case the reaches do not work out.
The only way to be sure you will not be admitted to a college is not to apply to it!