As a native Chinese speaker I would suggest the author at least try to make friends with Chinese math students who can check if his understanding of the paper he interested is accurate - is Lemma A really about Statement B is not true?, etc. Chinese is a very flexible language and sometimes the meaning has to be discerned from the proper context. So to have a dictionary and google translate probably is not enough, and since ordinary Chinese people do not know mathematical terminology that well, you should consult professionals. Alternatively, many papers have author's email, so I guess if you drop him or her an email the author will be happy to provide a brief note on the contents of the paper.
I had not read Chinese math papers for a while since I graduated from high school, so I expect someone who did his undergraduate math studies in China might be more helpful. My impression is the math papers I used to read were either too difficult to understand or written in such a way impossible to understand clearly what the author is really talking about. My Chinese classmates told me they often encounter similar difficulities. So presumably for a non-native speaker he or she will find the situation even more difficult, since sometimes the proof style, tex format, definitions, etc are all different. For example, sometimes Chinese people invent a name for foreign mathematicans using characters with a similar pronounciation. For not so well-known young mathematicans there is no orthodox translation, so you might be puzzled to look up who 西尔弗曼(Joe Silverman) is.
It is not impossible to train yourself to speak/read Chinese like a native speaker in a few years, and there are remarkable math work done in Chinese still yet to be translated. But this cost of energy and time seems neither what you wanted nor practical in real life.
