-
Notifications
You must be signed in to change notification settings - Fork 444
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Reduce confusion when authors are shown review round status #4092
Comments
This is a great example of a feature where it's tough to get the balance of information right for everyone. @stranack, I'm wondering whether you've heard of other user reports where we're giving too much or too little information to authors about submission progress -- we could either suggest supporting alterations with plugins (as @forgive38 has done), or offering something more built-in like a set of configuration options. I'm not sure a set of options is justified yet vs. the code and interface bloat that would come along with it. (It may also be possible to extend a plugin like this to add the options, rather than having those built into OJS.) |
@eddoff, we're not going to be able to find a balance of information that'll work for every journal, but in general I think authors find journals too opaque. In my opinion it's possible to let them know what's happening during the review process without e.g. compromising the integrity of the review. You may find this is something you need to customize locally. |
Two PKP PS hosted journals have recently asked to have review information hidden from authors, including how many review requests have been sent out and whether reviews are overdue. One publishers said it's unprofessional to have this information available to authors. Another said they have to spend a lot of time responding to queries from authors about the status of the reviews. |
Related discussion: https://forum.pkp.sfu.ca/t/authors-can-see-the-count-of-reviewer-assigned-to-submission/53069/4 |
I wanted to add a +1 for a possible review and rethinking of the current defaults here. I've also received feedback from editors unhappy with the level of detail presented, both because it creates an open window on what they feel should remain an internal process and also because it creates additional confusion for authors which leads to additional follow-up and work for editors. Maybe one way forward would be to provide well-defined status messages re: workflow state, but without all of the details and notifications. I'm including below some detailed feedback from an editor in case it's helpful.
|
Another PKP PS hosted client has requested this feature. |
These very detailed comments are indeed helpful in terms of community feedback from publishers and editors, if not from authors. I side with Alec's point is, that we are working against the extent of the opacity, in finding a balance. But as well, we are moving to a new level of peer review clarity to reassure the public and readers that this is what distinguishes scholarly publication (compared to preprints, for example). So as we move, as part of this journal integrity initiative, to posting the date at which the peer review is initiated (when the first reviewer agrees to review) and the number of reviewers who ultimately submitted reviews on the article landing page, we could extend the same courtesy to the author. That is, I'm in favor of authors being able to see the date the review process is initiated (as part of that integrity factor) and the number of reviewers. It's good when we can base these sorts of decisions on a larger strategy that follows from the responsibilities for making research publically available. |
Thanks to @aguen for connecting the discussion here with #6235. These two issues overlap closely and it is probably best to merge them into one. I'm going to copy the comments from that issue into this one, since there is a good discussion here. Describe the problem you would like to solve Similar information should be provided when reviews are completed, so that authors know that editors may need to seek further reviews, discuss the recommendations, and make a collective decision. Describe the solution you'd like Who is asking for this feature? |
A comment on the forum:
|
In addition, based on the editor's email above, when showing authors an assigned reviewer count, we need to hide or otherwise indicate reviewers who failed to respond with a review, so that authors do not expect to receive reviews from them. |
Closing this as it still needs consensus. Please consider making a proposal in the feature request category of our community forum where it can be discussed further. |
Re-opening; this is on the SciELO OxS improvements list. |
@alexxxmendonca can you make a specific proposal? I don't see a consensus in the comments above for what messages should be shown to authors and when these messages should be shown. |
Hi @NateWr, This is indeed very difficult to get the right balance. The concerns I've read on this thread are all very valid. It's a challenge to provide enough transparency without adding complexity or giving extra work to the editorial staff and editors. I've pondered about this and I'm going to describe how it is in ScholarOne. It seems to be a successful case given that the journals who use it don't seem to have problems with it (we don't receive any complaints from journals or authors). Task | What the authors see The "Awaiting Reviewer Scores" status is when a submission is under review. Authors do not know specifics, they don't know for how many reviewers the submission was sent, their deadlines and if they are overdue. Regardless of all reviews beung on time or overdue (even if only one of them are), authors still only see "Awaiting Reviewer Scores" on their view. The status only changes to the following one when the journal formally moves to the next step of the workflow. Again, this is how it is in ScholarOne and it's been like that for a very long time. It's not an area that is going through changes anytime soon, which seems to indicate that it works well for all parties. |
Thanks @alexxxmendonca. The one thing I'm missing from your proposal is an estimate of when the author might expect to know the results of the review. Will it be 5 days, 5 weeks or 5 months? In speaking with my friends, this uncertainty regarding timelines is the biggest source of stress and frustration for submitting authors, and erodes their power within the scholarly publishing ecosystem. In my view, we should design the editorial workflow to reduce this uncertainty wherever possible. |
Hi @NateWr Not sure I understood the question, but I don't think any journal can predict how long a peer review will take, and not sure they would like to inform that to the author on their submission, with risk of making the authors anxious after the deadline expires. A journal can always mention their average review time on their "Instructions to Authors" or "About the Journal" pages, but not getting into specifics for each paper. |
I support Alex's endorsement of ScholarOne's handling of this. Editors may not be able to estimate the time frame, especially when "awaiting reviewer scores," but to Nate's point authors can be reassured that their manuscript is moving through the four-step review process. That author awareness may also act as a slight nudge on the editors to keep the steps they control moving, while also enabling authors to ask if a step seems inordinately long (given the journal's average review time, say, over last two years, which OJS makes available to editors and could be posted, perhaps in the Publication Facts Label) That said, our steps would be more accurately set out as follows: Task | What the authors see
|
We do have information about this, in the form of due dates for review assignments. Posting averages may be nice transparency for the journal as a whole, but authors are interested in the specific timeline of their submission. |
These are purely deadlines. It doesn't mean they will be followed strictly at all. |
Hi all,
During PKP sprint in group about UI/UX, we spoken about giving less information about status of round review for the author.
As a first solution, I propose this plugin tested with ojs-stable-3.1.1.x which remove some information for the current round.
https://github.com/forgive38/plugin_RemoveInfoForAuthor
Simon
The text was updated successfully, but these errors were encountered: