Computer Science club hurting my chances at philosophy and English double major?

I agree with @momofsenior1. Participate in the ECs that you want to participate in. I think that participating in the computer science club is a great activity regardless of your potential major.

A few people have expressed surprise that I got into a highly ranked university as a math major when most of my ECs (sailing, skiing) had nothing at all to do with math, or even academics. What I think helped was that I did what I wanted to do. This meant that I did it well.

Philosophy is a somewhat logical exercise. Computer science is also a logical exercise. To me they fit a lot better than you might be thinking.

Of course there is also the issue that you are young, and you might change your mind wrt potential majors.