Is it selfish to not let others copy off my work that I worked so hard on?

Yeah, no. Answer in a way that puts the guilt back on them where it belongs. You have no reason to feel guilty whatsoever.

“Yeah, no, man, that’s against the honor code and I could get expelled, Why would you even ask me that?”