(This should be put in the thread right below the original question as it does not provide any answer, but I can't leave comments). Yan LeCun wrote down some ideas for a new publishing model/system for Computer Science, also talking about discussing/commenting papers. Reading the comments to this question, his suggestions seem quite relevant.