Withdrawing from a difficult course?

I am a junior double majoring in math and philosophy, and I plan to go to grad school in either statistics or quantitative psychology. I have been contemplating switching my second major from philosophy to psychology, but I was not able to make the decision until now.
I signed up for a senior seminar course in philosophy this semester and I am miserable in it. I got a C on the first paper which I worked quite hard on, and it might be very hard for me to bring the grade up to a satisfactory grade at the end (at best, I think that I could end up with a B). And this course is also draining my time to study for my math classes which are more important to me considering my future plans. It seems to me that it is best to withdraw at this point.

Should I withdraw from a senior seminar in philosophy? Given that I had withdrawn from an economics course in freshmen year, this would be my second withdraw in my college career. Therefore, I hesitate to do so. If I withdraw, will these 2 withdraws really hurt me when I apply to grad schools in stat and psych? 2 Ws on my transcript or a lower GPA (after this seminar I am likely to drop to 3.5)?

Talk to a math professor about this…ask them what they would suggest if you were going to grad school.
Also talk to your adviser…it may be that you were not ready for a senior seminar as a junior.
I am not sure if two Ws over your whole college career would affect you…I would just be ready to explain why you W’d (that you signed up for a senior course as a junior and have realized you are not ready for it.)
So if you want to still double major (although you can also talk to people if that is necessary or would juse classwork be okay)…do you still have to take that seminar?

Also make sure that 1) You would still be full time (12 credits) 2) Still can graduate on time