Research peer review: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>Robert Badgett
mNo edit summary
 
(8 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{subpages}}
{{subpages}}
{{TOC|right}}
'''Research peer review''' is part of the editorial process of [[academic journal]]s and [[scientific journal]]s and is the "evaluation by experts of the quality and pertinence of research or research proposals of other experts in the same field. Peer review is used by editors in deciding which submissions warrant publication, by granting agencies to determine which proposals should be funded, and by academic institutions in tenure decisions."<ref>{{MeSH|Research peer review}}</ref><ref name="pmid8015119">{{cite journal |author=Justice AC, Berlin JA, Fletcher SW, Fletcher RH, Goodman SN |title=Do readers and peer reviewers agree on manuscript quality? |journal=JAMA |volume=272 |issue=2 |pages=117–9 |year=1994 |pmid=8015119 |doi=}}</ref>
'''Research peer review''' is part of the editorial process of [[academic journal]]s and [[scientific journal]]s and is the "evaluation by experts of the quality and pertinence of research or research proposals of other experts in the same field. Peer review is used by editors in deciding which submissions warrant publication, by granting agencies to determine which proposals should be funded, and by academic institutions in tenure decisions."<ref>{{MeSH|Research peer review}}</ref><ref name="pmid8015119">{{cite journal |author=Justice AC, Berlin JA, Fletcher SW, Fletcher RH, Goodman SN |title=Do readers and peer reviewers agree on manuscript quality? |journal=JAMA |volume=272 |issue=2 |pages=117–9 |year=1994 |pmid=8015119 |doi=}}</ref>


Peer review improves the quality of reporting<ref name="pmid8198342">{{cite journal |author=Goodman SN, Berlin J, Fletcher SW, Fletcher RH |title=Manuscript quality before and after peer review and editing at Annals of Internal Medicine |journal=Ann. Intern. Med. |volume=121 |issue=1 |pages=11–21 |year=1994 |pmid=8198342 |doi=|url=http://www.annals.org/cgi/content/full/121/1/11}}</ref> and readability<ref name="pmid8015120">{{cite journal |author=Roberts JC, Fletcher RH, Fletcher SW |title=Effects of peer review and editing on the readability of articles published in Annals of Internal Medicine |journal=JAMA |volume=272 |issue=2 |pages=119–21 |year=1994 |pmid=8015120 |doi=}}</ref> of manuscripts.<ref name="pmid17443635">{{cite journal |author=Jefferson T, Rudin M, Brodney Folse S, Davidoff F |title=Editorial peer review for improving the quality of reports of biomedical studies |journal=Cochrane Database Syst Rev |volume= |issue=2 |pages=MR000016 |year=2007 |pmid=17443635 |doi=10.1002/14651858.MR000016.pub3 |url= |accessdate=2008-06-26}}</ref>
Peer review is meant to improve the quality of reporting<ref name="pmid8198342">{{cite journal |author=Goodman SN, Berlin J, Fletcher SW, Fletcher RH |title=Manuscript quality before and after peer review and editing at Annals of Internal Medicine |journal=Ann. Intern. Med. |volume=121 |issue=1 |pages=11–21 |year=1994 |pmid=8198342 |doi=|url=http://www.annals.org/cgi/content/full/121/1/11}}</ref> and readability<ref name="pmid8015120">{{cite journal |author=Roberts JC, Fletcher RH, Fletcher SW |title=Effects of peer review and editing on the readability of articles published in Annals of Internal Medicine |journal=JAMA |volume=272 |issue=2 |pages=119–21 |year=1994 |pmid=8015120 |doi=}}</ref> of manuscripts.<ref name="pmid17443635">{{cite journal |author=Jefferson T, Rudin M, Brodney Folse S, Davidoff F |title=Editorial peer review for improving the quality of reports of biomedical studies |journal=Cochrane Database Syst Rev |volume= |issue=2 |pages=MR000016 |year=2007 |pmid=17443635 |doi=10.1002/14651858.MR000016.pub3 |url= |accessdate=2008-06-26}}</ref> The cost of manuscript peer review has been estimated at £165 million (US$326 million).<ref name="urlTimes Higher Education - Unpaid peer review is worth £1.9bn">{{cite web |url=http://www.timeshighereducation.co.uk/story.asp?sectioncode=26&storycode=402189&c=1 |title=Unpaid peer review is worth £1.9bn |author= Zoë Corbyn |authorlink= |coauthors= |date=2008 |format= |work= |publisher=Times Higher Education |pages= |language= |archiveurl= |archivedate= |quote= |accessdate=}}</ref>


Peer review is also used in reviewing of grant applications.<ref name="pmid17443627">{{cite journal |author=Demicheli V, Di Pietrantonj C |title=Peer review for improving the quality of grant applications |journal=Cochrane Database Syst Rev |volume= |issue=2 |pages=MR000003 |year=2007 |pmid=17443627 |doi=10.1002/14651858.MR000003.pub2 |url= |accessdate=2008-06-26}}</ref>
Peer review is also used in reviewing of grant applications.<ref name="pmid17443627">{{cite journal |author=Demicheli V, Di Pietrantonj C |title=Peer review for improving the quality of grant applications |journal=Cochrane Database Syst Rev |volume= |issue=2 |pages=MR000003 |year=2007 |pmid=17443627 |doi=10.1002/14651858.MR000003.pub2 |url= |accessdate=2008-06-26}}</ref> Research peer review of grant applications is time-consuming.<ref name="pmid9690424">{{cite journal| author=Wessely S| title=Peer review of grant applications: what do we know? | journal=Lancet | year= 1998 | volume= 352 | issue= 9124 | pages= 301-5 | pmid=9690424
| url=http://www.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pubmed&tool=clinical.uthscsa.edu/cite&email=badgett@uthscdsa.edu&retmode=ref&cmd=prlinks&id=9690424 | doi=10.1016/S0140-6736(97)11129-1 }}</ref>


The cost of peer review has been estimated at £165 million (US$326 million).<ref name="urlTimes Higher Education - Unpaid peer review is worth £1.9bn">{{cite web |url=http://www.timeshighereducation.co.uk/story.asp?sectioncode=26&storycode=402189&c=1 |title=Unpaid peer review is worth £1.9bn |author= Zoë Corbyn |authorlink= |coauthors= |date=2008 |format= |work= |publisher=Times Higher Education |pages= |language= |archiveurl= |archivedate= |quote= |accessdate=}}</ref>
==Effectiveness==
Peer review seems to successfully stratify articles. In one study, articles rejected by a [[academic journal]] were very unlikely to be subsequently published in a journal with higher [[impact factor]].<ref>Anonymous. [http://www.nature.com/emboj/about/emboj_rejects_2007.html Follow-up analysis of rejected manuscripts submitted to The EMBO Journal in 2007] The EMBO Journal</ref> The use reporting guidelines such as STROBE and CONSORT during peer review may help.<ref name="pmid22108262">{{cite journal| author=Cobo E, Cortés J, Ribera JM, Cardellach F, Selva-O'Callaghan A, Kostov B et al.| title=Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial. | journal=BMJ | year= 2011 | volume= 343 | issue= | pages= d6783 | pmid=22108262 | doi=10.1136/bmj.d6783 | pmc=PMC3222149 | url= }} </ref>


==Problems==
==Problems==
Problems with peer review have been summarized.<ref name="Bornmann">Bornmann L. [http://www.lutz-bornmann.de/icons/BornmannARIST.pdf Scientific peer review]. Annual Review of Information Science and Technology . </ref>
Reviewers may have biases in their judgments of manuscripts.<ref name="pmid8051481">{{cite journal |author=Ernst E, Resch KL |title=Reviewer bias: a blinded experimental study |journal=J. Lab. Clin. Med. |volume=124 |issue=2 |pages=178–82 |year=1994 |month=August |pmid=8051481 |doi= |url= |accessdate=2008-06-26}}</ref>
Reviewers may have biases in their judgments of manuscripts.<ref name="pmid8051481">{{cite journal |author=Ernst E, Resch KL |title=Reviewer bias: a blinded experimental study |journal=J. Lab. Clin. Med. |volume=124 |issue=2 |pages=178–82 |year=1994 |month=August |pmid=8051481 |doi= |url= |accessdate=2008-06-26}}</ref>


Reviewers may miss important mistakes in articles.<ref name="pmid9737492">{{cite journal |author=Baxt WG, Waeckerle JF, Berlin JA, Callaham ML |title=Who reviews the reviewers? Feasibility of using a fictitious manuscript to evaluate peer reviewer performance |journal=Ann Emerg Med |volume=32 |issue=3 Pt 1 |pages=310–7 |year=1998 |month=September |pmid=9737492 |doi= |url= |accessdate=2008-06-26}}</ref>
Reviewers may miss important mistakes in articles.<ref name="pmid9737492">{{cite journal |author=Baxt WG, Waeckerle JF, Berlin JA, Callaham ML |title=Who reviews the reviewers? Feasibility of using a fictitious manuscript to evaluate peer reviewer performance |journal=Ann Emerg Med |volume=32 |issue=3 Pt 1 |pages=310–7 |year=1998 |month=September |pmid=9737492 |doi= |url= |accessdate=2008-06-26}}</ref>
Reviewers may provide worse reviews as the reviewers progress in their careers.<ref name="pmid21074894">{{cite journal| author=Callaham M, McCulloch C| title=Longitudinal trends in the performance of scientific peer reviewers. | journal=Ann Emerg Med | year= 2011 | volume= 57 | issue= 2 | pages= 141-8 | pmid=21074894 | doi=10.1016/j.annemergmed.2010.07.027 | pmc= | url=http://www.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pubmed&tool=sumsearch.org/cite&retmode=ref&cmd=prlinks&id=21074894  }} </ref>


===Publication bias===
===Publication bias===
{{main|Publication bias}}
{{main|Publication bias}}


==New developments==
==Post-publication peer review==
Post-publication peer review may be limited by the lack of responses by authors to comments on their articles.<ref name="pmid20699306">{{cite journal| author=Gøtzsche PC, Delamothe T, Godlee F, Lundh A| title=Adequacy of authors' replies to criticism raised in electronic letters to the editor: cohort study. | journal=BMJ | year= 2010 | volume= 341 | issue=  | pages= c3926 | pmid=20699306 | pmc=PMC2919680 | doi=10.1136/bmj.c3926 }} </ref>
 
Recently, blog-based peer-review has been tested, yielding mixed results.<ref name="titleExperimental Use of Blog-Based Peer Review Gives Mixed Results - Chronicle.com">{{cite web |url=http://chronicle.com/free/2008/04/2332n.htm |title=Experimental Use of Blog-Based Peer Review Gives Mixed Results |accessdate=2008-04-15 |author=Young JR |authorlink= |coauthors= |date=2008-04-02 |format= |work= |publisher=The Chronicle of Higher Education |pages= |language= |archiveurl= |archivedate= |quote=}}</ref>
Recently, blog-based peer-review has been tested, yielding mixed results.<ref name="titleExperimental Use of Blog-Based Peer Review Gives Mixed Results - Chronicle.com">{{cite web |url=http://chronicle.com/free/2008/04/2332n.htm |title=Experimental Use of Blog-Based Peer Review Gives Mixed Results |accessdate=2008-04-15 |author=Young JR |authorlink= |coauthors= |date=2008-04-02 |format= |work= |publisher=The Chronicle of Higher Education |pages= |language= |archiveurl= |archivedate= |quote=}}</ref>
 
==References==
==References==
<references/>
<references/>[[Category:Suggestion Bot Tag]]

Latest revision as of 11:00, 11 October 2024

This article is a stub and thus not approved.
 Main Article
 Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
Audio [?]
Video [?]
 
https://en.citizendium.org/wiki/index.php?title=Research_peer_review&printable=yes
This editable Main Article is under development and subject to a disclaimer.

Research peer review is part of the editorial process of academic journals and scientific journals and is the "evaluation by experts of the quality and pertinence of research or research proposals of other experts in the same field. Peer review is used by editors in deciding which submissions warrant publication, by granting agencies to determine which proposals should be funded, and by academic institutions in tenure decisions."[1][2]

Peer review is meant to improve the quality of reporting[3] and readability[4] of manuscripts.[5] The cost of manuscript peer review has been estimated at £165 million (US$326 million).[6]

Peer review is also used in reviewing of grant applications.[7] Research peer review of grant applications is time-consuming.[8]

Effectiveness

Peer review seems to successfully stratify articles. In one study, articles rejected by a academic journal were very unlikely to be subsequently published in a journal with higher impact factor.[9] The use reporting guidelines such as STROBE and CONSORT during peer review may help.[10]

Problems

Problems with peer review have been summarized.[11]

Reviewers may have biases in their judgments of manuscripts.[12]

Reviewers may miss important mistakes in articles.[13]

Reviewers may provide worse reviews as the reviewers progress in their careers.[14]

Publication bias

For more information, see: Publication bias.


Post-publication peer review

Post-publication peer review may be limited by the lack of responses by authors to comments on their articles.[15]

Recently, blog-based peer-review has been tested, yielding mixed results.[16]

References

  1. ↑ Anonymous (2024), Research peer review (English). Medical Subject Headings. U.S. National Library of Medicine.
  2. ↑ Justice AC, Berlin JA, Fletcher SW, Fletcher RH, Goodman SN (1994). "Do readers and peer reviewers agree on manuscript quality?". JAMA 272 (2): 117–9. PMID 8015119. [e]
  3. ↑ Goodman SN, Berlin J, Fletcher SW, Fletcher RH (1994). "Manuscript quality before and after peer review and editing at Annals of Internal Medicine". Ann. Intern. Med. 121 (1): 11–21. PMID 8198342. [e]
  4. ↑ Roberts JC, Fletcher RH, Fletcher SW (1994). "Effects of peer review and editing on the readability of articles published in Annals of Internal Medicine". JAMA 272 (2): 119–21. PMID 8015120. [e]
  5. ↑ Jefferson T, Rudin M, Brodney Folse S, Davidoff F (2007). "Editorial peer review for improving the quality of reports of biomedical studies". Cochrane Database Syst Rev (2): MR000016. DOI:10.1002/14651858.MR000016.pub3. PMID 17443635. Retrieved on 2008-06-26. Research Blogging.
  6. ↑ Zoë Corbyn (2008). Unpaid peer review is worth £1.9bn. Times Higher Education.
  7. ↑ Demicheli V, Di Pietrantonj C (2007). "Peer review for improving the quality of grant applications". Cochrane Database Syst Rev (2): MR000003. DOI:10.1002/14651858.MR000003.pub2. PMID 17443627. Retrieved on 2008-06-26. Research Blogging.
  8. ↑ Wessely S (1998). "Peer review of grant applications: what do we know?". Lancet 352 (9124): 301-5. DOI:10.1016/S0140-6736(97)11129-1. PMID 9690424. Research Blogging.
  9. ↑ Anonymous. Follow-up analysis of rejected manuscripts submitted to The EMBO Journal in 2007 The EMBO Journal
  10. ↑ Cobo E, Cortés J, Ribera JM, Cardellach F, Selva-O'Callaghan A, Kostov B et al. (2011). "Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial.". BMJ 343: d6783. DOI:10.1136/bmj.d6783. PMID 22108262. PMC PMC3222149. Research Blogging.
  11. ↑ Bornmann L. Scientific peer review. Annual Review of Information Science and Technology .
  12. ↑ Ernst E, Resch KL (August 1994). "Reviewer bias: a blinded experimental study". J. Lab. Clin. Med. 124 (2): 178–82. PMID 8051481. Retrieved on 2008-06-26. [e]
  13. ↑ Baxt WG, Waeckerle JF, Berlin JA, Callaham ML (September 1998). "Who reviews the reviewers? Feasibility of using a fictitious manuscript to evaluate peer reviewer performance". Ann Emerg Med 32 (3 Pt 1): 310–7. PMID 9737492. Retrieved on 2008-06-26. [e]
  14. ↑ Callaham M, McCulloch C (2011). "Longitudinal trends in the performance of scientific peer reviewers.". Ann Emerg Med 57 (2): 141-8. DOI:10.1016/j.annemergmed.2010.07.027. PMID 21074894. Research Blogging.
  15. ↑ Gøtzsche PC, Delamothe T, Godlee F, Lundh A (2010). "Adequacy of authors' replies to criticism raised in electronic letters to the editor: cohort study.". BMJ 341: c3926. DOI:10.1136/bmj.c3926. PMID 20699306. PMC PMC2919680. Research Blogging.
  16. ↑ Young JR (2008-04-02). Experimental Use of Blog-Based Peer Review Gives Mixed Results. The Chronicle of Higher Education. Retrieved on 2008-04-15.
Retrieved from "https://citizendium.org/wiki/index.php?title=Research_peer_review&oldid=986802"