Yes. Don't be shy because you think you are asking him to write you a better letter, because in fact you are asking him whether he feels he is capable of writing you a good letter. The contrary could mean not that he doesn't like you, but that he doesn't have enough of an opinion to write a letter that would not be damning with faint praise, and if he declines and is a tactful person he would give that as his reason no matter what.

I have both personal and anecdotal experience with this situation. Once, I asked Barry Mazur for a letter when applying for an NSF graduate fellowship, and we did talk, but our contact had been pretty minimal at that time (it still is, really) and he said exactly what I wrote above: that he could write a letter but it wouldn't say much specific, so if I had someone who knew me better then I would be better served to ask them.

As for the anecdote, I will just use (possibly incorrect) pronouns as identifiers. At a "seminar" for applying for jobs, this person described how he once agreed to write a letter for a student who was highly regarded by others, and only later realized that he couldn't actually recommend her well. Having agreed to write the letter he produced one which was adequate but no more, and the student didn't get as good a job as it was generally felt she deserved. The writer described his guilt at doing this, because it was not his obligation to agree to write a letter for someone he couldn't give the best recommendation they could get.