I was just accepted ED2, but have received an EA offer already. I know that I have to withdraw all my applications, just wondering if this means I have to decline my offer as well, thanks 
Yes. You need to withdraw your applications and decline your offers as well.
Read the ED agreement you have signed. If the ED school is financially feasible, you need to honor the agreement.
Make sure the financial package works for your family before withdrawing apps.