If general education requirements are a criterion, look up each school specifically. Do not assume that LACs versus non-LACs follow any pattern as to the type and volume of such. For example Brown (non-LAC) and Amherst (LAC) have minimal or no general education requirements, while MIT (non-LAC) and Harvey Mudd (LAC) have extensive general education requirements.
With respect to Williams, it has a large listing of advanced math courses for a LAC, but perhaps not as large as at a large math department in a large university, and they are not all offered every year: https://math.williams.edu/courses/ . Because you are advanced enough to likely want to take graduate level math courses as an undergraduate, you may want to compare catalog descriptions and/or ask the department directly whether any of the courses offered would be equivalent to graduate level courses elsewhere.
PhD programs in math often have a requirement of having a reading knowledge of French, German, or Russian. This may not necessarily require general fluency, but it means at least being able to read math articles and papers published in those languages and correctly understand the math being written about.