Looking at our operations, one of the observations is that the response rate from invited referees could be much better. Avoiding delays at this level is crucial at improving the overall timescales for editorial processing.
On the one hand, we don’t want to overburden anybody. On the other hand, things work much better if quick yes/no replies are given to refereeing invitations, and if referees who have accepted to deliver a report, do so within the agreed deadline.
Some things come to mind about how we can improve this:
should we add a one-click accept/decline button in the referee invitation email (no login required)?
should we offer the option, upon accepting a refereeing invitation, for the referee to self-determine a “promised by” date for report delivery (within acceptable bounds), and show these promised dates to authors?
if a referee does not respond to an invitation after a few days, is the right default to consider this referee to having refused the invitation, or to have implicitely accepted it?
how often should we send email reminders to referees?
Your opinions on the above, together with any further thoughts or ideas, are most welcome.
First, we should make sure that only worthy submissions reach the referees. It should be easy and relatively common for editors to desk reject submissions, in particular if they are not written clearly enough. This can come with an encouragement to resubmit later.
Then, for the referee’s workflow, there is no need to reinvent the wheel: JHEP has a rather efficient workflow that could be emulated. This includes a “promised by” date (with a bound of 30 days), with an automatic email reminder when that date approaches, and the possibility to extend the deadline if need be. I am not sure what they do when there is no reply to the invitation, but it seems dangerous to assume it has been accepted.
The one-click accept/decline button looks like a good idea, but raises the issue of choosing the promised date by default.
What are the frequencies of referee responses (yes/no/no response)? If no reaction is frequent, then it seems best to:
Count lack of response as declining the invitation.
Write in the invitation email something along the lines:
Please let us know as soon as possible if you are able to review the manuscript by following the accept link or decline link. We hope to hear from you within 5 days, after which we will consider you unable to provide a review (although if you reconsider, you you may contribute a report as long as review is open).
On a related note: where can one find the default email templates or provide feedback on those?
At face value the rates themselves don’t seem to be problematic, or am I wrong? Could it be that they are distributed very unevenly across different submissions and/or editors, and that is the actual problem?
46% of accepted invitations would be great but I guess this is only because the statistics also included multiple reports of the same referee due to resubmission.
The real rate for the first submission is probably closer to 25-30% (taking into account that for resubmissions the acceptance rate is close to 100%). This would imply that one has to ask 4-8 people to get two reports.
I have the feeling that many of our colleagues react as a matter of priniciple only after they receive a reminder on “anything”.
I would suggest (1) offer a simple way to decline without registration, (2) send maximaly two “reminder” emails for the initial invitation and only then count as “refused”
@jscaux this is an important question: in your check did you only consider first invitations or also repeated ones? (I do realize it’s been a while since your post.)