What it comes down to for me is whether or not you can afford other good college options without TE. If a TE college is by far the best for your family financially, it sounds like the best option is staying with your job and letting your son know at the appropriate time (maybe end of sophomore year) that he needs to attend a TE college unless he is able to get an equivalent financial package at another college.
If you consider the TE option a financial bonus rather than a necessity, switching jobs seems like a reasonable option. Your well being is a very important consideration which should not be disregarded.