Computer Science club hurting my chances at philosophy and English double major?

It’s fine. What’s risky is that you’re making a late decision based on something you think you heard somewhere. You will need to learn more about what does matter to your eventual targets- what they say, not random comments from who knows where.

There’s a ton of difference between diverse ECs, which top colleges like, vs cramming your schedule with any old time commitments.

But right now, you’ve only mentioned one club. Hope you’ll have more well-considered activities, some that cover your interests, some that contribute in meaningful ways, and the right comm service.