Note that Duke has an on-campus living requirement for the first three years:
https://studentaffairs.duke.edu/hdrl/apply-housing/campus-housing-requirement
Pomona may also have an on-campus living requirement for the first year (ask them to find out). If the college you choose has such a requirement, you may have to apply to get that requirement waived.