Do we consider our 23 yr old son a family member on FAFSA if we don't claim as exemption on return?

If you could claim your dependent child, but choose not to; your dependent child can not claim his exemption, it is lost. See http://www.irs.gov/publications/p501/ar02.html#en_US_2014_publink1000220858