It matters, to an extent. The difference between like a 31 and a 34 is probably much more prominent and important than 33 and 36 because the general consensus is that 33 is the magic number that you can pass wherein your scores will generally not hold you back at any college in the U.S.