Will I be at a disadvantage? (very few extracurriculars due to circumstances)

I could never be an adcom because I am too much of a softie – but you sound like the kind of person all those schools would benefit from admitting.

I wouldn’t be ashamed of your path, I would brag about it!