Does Cal Poly have a sign language interpreting major?
http://admissions.calpoly.edu/prospective/majors.html
Does not look like that major or minor is available. Most ASL programs are found at the community college level.
You might want to look at schools that offer Speech Pathology as a major.