Whitman is possibly more outdoorsy than Wesleyan, but @Bill_Marsh gives an in-depth list of the opportunities in and around Middletown in this thread: