Search citation statements
Paper Sections
Citation Types
Year Published
Publication Types
Relationship
Authors
Journals
The peer review process is used throughout science but has often been criticized for being inconsistent, with decisions dependent on the peers who did the reviewing. Much of the decision inconsistency arises from the differences between reviewers in terms of their expertise, training and experience. Another source of uncertainty is within reviewers as they must make a single recommendation (e.g. ‘Accept’), when they may have wavered between two (e.g. ‘Accept’ or ‘Reject’). We estimated the size of within-reviewer uncertainty using post-review surveys at three journals. We asked reviewers to think outside the recommendation they gave (e.g. ‘Accept’) and assign percentages to all other recommendations (e.g. ‘Major revision’). Reviewers who were certain could assign 100% to one recommendation. Twenty-three per cent of reviewers reported no uncertainty (95% confidence interval 19–27%). Women were associated with more uncertainty at one journal, and protocol papers were associated with more uncertainty at one journal. Reviewers commonly experience some uncertainty when peer-reviewing journal articles. This uncertainty is part of the variability in peer reviewers’ recommendation.
The peer review process is used throughout science but has often been criticized for being inconsistent, with decisions dependent on the peers who did the reviewing. Much of the decision inconsistency arises from the differences between reviewers in terms of their expertise, training and experience. Another source of uncertainty is within reviewers as they must make a single recommendation (e.g. ‘Accept’), when they may have wavered between two (e.g. ‘Accept’ or ‘Reject’). We estimated the size of within-reviewer uncertainty using post-review surveys at three journals. We asked reviewers to think outside the recommendation they gave (e.g. ‘Accept’) and assign percentages to all other recommendations (e.g. ‘Major revision’). Reviewers who were certain could assign 100% to one recommendation. Twenty-three per cent of reviewers reported no uncertainty (95% confidence interval 19–27%). Women were associated with more uncertainty at one journal, and protocol papers were associated with more uncertainty at one journal. Reviewers commonly experience some uncertainty when peer-reviewing journal articles. This uncertainty is part of the variability in peer reviewers’ recommendation.
PurposePeer review plays a crucial role in scientific writing and the publishing process, assessing the quality of research work. As the volume of paper submissions increases, peer review becomes increasingly burdensome, highlighting the importance of studying the duration of peer review. This study aims to explore the correlation between review aspect sentiment and the duration of peer review as well as the differences in this relationship across different disciplines and review rounds. Thus helping authors make targeted revisions and optimizations to their papers while reducing the duration of peer review, which enables authors’ research findings to reach the academic community and public domain more rapidly.Design/methodology/approachThe study employs a two-step approach to understand the impact of review aspects on the duration of peer review. First, it extracts fine-grained aspects from peer review comments and uses sentiment classification models to classify the sentiment of each review aspect. Then, it conducts a correlation analysis between review aspect sentiment and the duration of peer review. Additionally, the study calculates sentiment scores for various review rounds to explore the differences in the impact of review aspect sentiment on the duration of peer review across different review rounds.FindingsThe study found that there is a weak but significant negative correlation between the sentiment of the review and the duration of peer review. Specifically, the aspect clusters, such as Evaluation & Result and Impact & Research Value, exhibit a relatively stronger correlation with the duration of peer review. Additionally, the correlation between review aspect sentiments and the duration of peer review varies significantly in different review rounds.Originality/valueThe significance of this study lies in connecting peer review comments text with the peer review process. By analyzing the correlation between review aspects and the duration of peer review, it identifies aspects that have a greater impact on the duration of peer review. This helps improve the efficiency of peer review from the perspectives of authors, reviewers and editors. Thus alleviating the burden of peer review and accelerating academic exchange and knowledge dissemination.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.