My experience is the older I get the quicker I am at learning new things, in mathematics or anything else. Maturity goes a long way at quieting the mind and a quit mind is much quicker at learning new things than the buzzing mind of the 18 year old that is still trying to figure out what is relevant and what is not. If anything your age is an asset so you should definitely go for it.