You can try SciRate ([http://scirate.com/][1]), a site that allows you to rate and comment papers from Arxiv (it updates the list of papers automatically). It doesn't seem to be very popular, though (lack of critical mass?).


  [1]: http://scirate.com/