Have you talked to CAL? Is it possible you could still attend this year? I really have no idea. You don’t explain the “crazy circumstances” for withdrawal and for privacy it is understandable. If CalPolySLO is now the only school you can go to, it is a really really excellent choice and I would go ahead, work hard, and if you are unhappy and still want CAL, apply after your first year.
There is a chance you will look back at what you now view as a mistake, as putting you on a good path. If not, nothing is written in stone. By all means, to set your mind at ease, call CAL just to make sure you cannot attend, then move on.