Regret my major choice and my school doesn't allow me to change my major. Transfer out?

I’m currently a second year undergraduate neuroscience major in a UC school. After a bit over a year in school I finally realized that, 1)I’m not interested in life science, and 2) my strength and passion are in physics and math.

I have been talking to advisors from all the colleges at my school about changing my major and so far the only response is “You cannot do a change of major out of your current college as a second year” although I meet all the change of major requirements.(I am part of the social science college, I talked to college of natural science and college of engineering, same responses.)

I am on track with math and science classes(3.97GPA), and if I do take advantage of this summer, I will be able to finish the lower division physics classes.

I am still trying to work something out with my school about change of major, however, just in case that things turn to the worst(most likely), I am wondering what are some other options for me that will allow me to pursue a degree in what I am truly passionate about?(Physics or mechanical engineering.) Maybe transferring out of my current school to a CC?

Thanks for your responses.

I’m confused about the answer you are getting, since you said you meet the requirements. Are they saying you could do it later? Or that you should have done it earlier?

Assuming UCR, do you qualify according to the policies listed here:

For engineering majors:
https://student.engr.ucr.edu/policies/requirements/majorchange.html
https://student.engr.ucr.edu/policies/requirements/majorchange/cs.html

For math or physics:
https://cnasstudent.ucr.edu/majors/MajorSelection.html
https://cnasstudent.ucr.edu/files/MATH%20COM%20Criteria%208.21.15.pdf
https://cnasstudent.ucr.edu/files/PHYS%20COM%20Criteria%20Effective%2012U%20Revised.pdf

It looks like the humanities and social studies division does not want students to switch out after the first year, a highly unusual policy (usually, the limitations are on switching in to prevent majors from being overenrolled):
https://chassstudentaffairs.ucr.edu/transition_advising/index.html

Your option otherwise would be to apply to transfer to a different school, whether or not you need to complete additional prerequisites at a community college in-between. If you want to transfer to a different UC, be careful of the transfer credit limitations, and note that credit from UCs is not capped to prevent you from going over the transfer credit limitations:
http://admission.universityofcalifornia.edu/counselors/transfer/advising/transferring-credits/index.html
http://www.sdmesa.edu/student-services/transfer-center/documents/uc-transfer-maximum-limitation-policy-chart.pdf

https://www.universityofcalifornia.edu/infocenter/transfers-major can give you an idea of how selective other UCs are for transfer admission.