Depends on what you want. Too old to get the Field's medal? probably. Too old to study mathematics or have an academic career in mathematics? definitely not! I knew a few people who did their master's in math in their late 30's and went on to teach college math.