The only neuroscience graduate that I know took both calculus and statistics as a university student. They did very well in both classes. I think that they might have had calc AB as a high school student, and continued from there in university.
The minimum math that I think that you need is to complete all of the prerequisites that are needed prior to calculus. You should at least be ready to show up as a freshman at university ready to do very well in calculus. While your post does not say what you have already taken, it sounds like you have probably already done this.
I would take some math senior year because you do not want to get “rusty”. Either calculus or statistics seems like a good choice.
I will admit that I am not quite sure what college algebra is. I just googled it and found “… basic algebraic operations; linear and quadratic equations, inequalities, and graphs; algebraic, exponential, and logarithmic functions; and miscellaneous other topics”. This is stuff that you do want to know very well and would probably also be a good choice.