Letter of Recommendation Mentions Specific College but Sent to Other Colleges

When I was asking teachers to write letters of recommendation for my common application, I asked a teacher who graduated from one of the schools I was applying to. Through the conversation, he misinterpreted me, and ended up writing a letter for the specific college. Not knowing this, I chose to have his letter submitted to every college I applied to (through my guidance counselor and Naviance). Although I have not seen the letter, I was told it mentions the college specifically by name and how he thinks I would be a good fit for it.

Am I screwed over for every college I applied to except the one the recommendation letter was written for? How do I fix this, especially now that the applications were submitted over a week ago?

Please help.