Why would you be too far behind, especially if you did the minor? The minor is seven courses: http://www.eecs.berkeley.edu/csugrad/minor.shtml
https://career.berkeley.edu/Major/AppMath.stm indicates that many applied math graduates go into finance, although taking CS 61A and 61B may be helpful in that context.