30
$\begingroup$

I've put a paper on arxiv one year ago and I've submitted the version 6 to a journal seven months ago.

During these last seven months, I've given several talks about this work, which led me to update again the paper on arxiv, to fix some typos, polish, add clarification, add a few new applications and questions... nothing very serious, but the last arxiv version (of 51 pages) is surely better than the submitted one (of 47 pages).

Out of respect for the work of the referee and to not delay the report, I believe (perhaps wrongly) that it is better to not update the submission before the first report; but I was wondering:

Question: Is it usual for a referee to heed updated versions on arxiv?

$\endgroup$
  • 7
    $\begingroup$ well, I certainly heed [=pay attention to] arXiv, and I would be annoyed if the manuscript I am asked to review is of poorer quality than the one on arXiv. $\endgroup$ – Carlo Beenakker May 15 '16 at 10:21
  • $\begingroup$ @CarloBeenakker: The verb "heed" admits two (slightly different) meaning: "pay attention to" and "take into account", both are relevant for the question. $\endgroup$ – Sebastien Palcoux May 15 '16 at 10:33
  • 18
    $\begingroup$ This seems like a question for Academia to me. $\endgroup$ – Danu May 15 '16 at 15:06
  • 8
    $\begingroup$ Generally, the referee only looks at what you sent to the journal. You can if you wish send a revised version to the journal, which may forward it to the referees; but unless there are major changes, don't do that. Just keep improving it, and finally when the paper is accepted, you can submit the improved version for publication. $\endgroup$ – Gerald Edgar May 15 '16 at 17:45
  • 7
    $\begingroup$ I disagree that this is a question for the academia stackexchange sure. The use of the arxiv is so discipline specific that it seems clear better answers are available here, and certainly the question is within the remit of MathOverflow. $\endgroup$ – Scott Morrison May 18 '16 at 6:37
34
$\begingroup$

I think Friedrich Knop's answer describes a beautiful ideal, but it is not very realistic. For example, the following have both happened to me personally:

  1. I posted a preliminary version of a paper to the arXiv; later, after completing the paper and improving the results, I submitted the completed paper to a journal without updating the arXiv version. When I received the referee report, it was clear that the referee downloaded the version from the arXiv rather than reading the submitted version (they complain about the presence of hypotheses that don't appear in the paper I submitted, and refer to propositions with the numbering from the arXiv version). Milder versions of this story have happened with other papers.

  2. For another paper, I posted to the arXiv and submitted to a journal at the same time. Many months went by without a referee report. At some point I updated the version on the arXiv to reflect some minor corrections. When I received the report, the referee points out that some of their suggestions for changes to the paper have already been implemented in the more-recent arXiv revision.

In light of the first story, whenever I submit a paper, I now always make a point to update the arXiv version to be at least as current as the submitted version. In theory, perhaps this should not be necessary; but referees are human, and like everyone they sometimes take shortcuts.

$\endgroup$
  • 15
    $\begingroup$ Another thing that can happen is that the referee has already read the arXiv version and given it some thought: in this case, when receiving a version intended for publication, they will definitely wish to know what differences, if any, exist between that version and the one on the arXiv. $\endgroup$ – Gro-Tsen May 15 '16 at 19:16
27
$\begingroup$

It is not only unusual, I would be surprised if that ever happens. A referee's task is to a evaluate a paper in the state it has been submitted. So he/she should not take into account any other versions found elsewhere even if that means that the paper is rejected for poor quality. For that reason it is expected to only submit papers which are considered to be finished. In the case a serious problem is found after submission (like a gap in a proof, not just bad exposition) then the proper procedure is to inform the editor and resubmit the paper with profuse apologies.

$\endgroup$
  • 4
    $\begingroup$ I'm perfectionist, and (in my opinion) a paper is always perfectible (isn't it?), so the notion of "finished paper" is not clear to me, and then, it's a pain for me to submit a paper. But I must force myself to submit it at one time, otherwise I will just never submit it. Now seven months is long enough to perfect it again and again. My submitted version is not poor, but the last arxiv version is (a little bit) better. So it should be (a little bit) easier for the referee to read the last arxiv verison, moreover, this could prevent him to suggest improvements that are already done. $\endgroup$ – Sebastien Palcoux May 15 '16 at 11:38
  • 17
    $\begingroup$ @Sebastian Palcoux: You should not expect the referee to read anything but the text you submitted to the journal. If the paper is accepted, you can replace it by a newer version, explaining the changes. The editor then decides whether to send it to the referee again or not. $\endgroup$ – Alexandre Eremenko May 15 '16 at 11:52
  • 18
    $\begingroup$ The editor expects a report on the submitted version. So the new version will be ignored at best, at worst you'll get an aggravated referee. Next time, keep your horses, prepare a new version while the paper is under review but don't make it public. Wait until the report is in, merge the remarks with the new version and then submit to the arXiv (and the editor, obviously). $\endgroup$ – Friedrich Knop May 15 '16 at 12:06
10
$\begingroup$

I am hesitant to try to add anything further to the solid answers here, but here it goes anyway.

In practice, here is what I do:

  1. Once I have a manuscript that I feel is publisher-ready, I send it out to experts that I feel might be interested. After a week or two I re-read, make updates, and incorporate any feedback I received.
  2. Then I post the manuscript on the arXiv. I again wait a few weeks to see if any feedback comes. After that period I make changes as appropriate and give it another read making edits as they arise.
  3. Then I submit to a journal.
  4. Generally speaking I do not update the arXiv between submission and a referee report. In that time I always find typos and minor edits. Sometimes new content wants in too. To address this I make said changes and keep a log, commented out in TeX, at the top of my file, itemizing all changes that I have made. After the referee report, I address the referee suggestions and if rejected update the arXiv and resubmit. If accepted, I use the log I created to walk the referee through the changes (to make his/her job easier), and then update the arXiv.

This process has worked for me so far. There have been an occasion or two where I have broke protocol (exceptions always arise), but this is my attempt at a "best practice" from the author's point of view.

As a referee, I only consider the submitted manuscript. If I were to receive an update in the middle, generally speaking, I would consider the "clock" reset and start over from scratch. That said, I will sometimes compare the arXiv version to the submitted version. But I evaluate exclusively on the submitted version.

$\endgroup$
  • 4
    $\begingroup$ P.S. Another reason to wait to update the arXiv until referee reports is that too many arXiv versions makes it appear that the manuscript might not be "fully cooked". I think it is better to update the arXiv as infrequently as possible, while keeping the manuscript up-to-date. $\endgroup$ – Sean Lawton May 16 '16 at 14:04
4
$\begingroup$

As a referee, I usually stick to the submitted version, which is what I am asked to evaluate.

Often, it happens to encounter an error, an imprecision, or an unclear passage. Sometimes, it is not immediately clear whether it is just a typo, or something the authors really did not consider. In these cases, I usually check for a more recent version on the arXiv, or on the author's webpage, to see whether that part has been somehow improved or corrected.

So, updating papers on the arXiv even after submission could be beneficial to both authors and referees, by saving some time.

Indeed the possibility to improve the manuscript after the submission is not an excuse to send out poorly revised manuscripts for evaluation.

To comment Friedrich Knop's answer, in my opinion it is a very good (but not widespread) practice to update the arXiv version to fix or improve parts of the manuscript - even after publication. Most of the times, however, the arXiv version is not even updated to reflect the (sometimes substantial) modifications suggested by the referees.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.