David Williams has a book called Probability with Martingales which includes some excellent puzzles as exercises. These are often easy to state but require real trickery to prove.

In the spirit of doetoe's answer, I also recommend the Putnam. They don't have a ton of probability based puzzles but they do have some. That website also has old AIME problems and solutions. In both cases the problems are tricky and fun.