In the extreme case of child neglect, lack of nutrition would be the dominant factor in height. It’s unfortunate too many of those cases don’t get reported to child protective services. That seems to be looking at the most extreme end of the spectrum. A lot of NBA greats were raised in low income urban areas. Then, there are eating disorders which lead to malnourishment, but cut across the full income spectrum.