Research Analysis & Policy

Meta-Research: Reproducibility

Updated May 14, 2019 Curated Collections

Meta-research, or the scientific study of research practices, aims to characterize existing standards and ultimately improve the quality and reliability of scientific research. We collect here meta-research articles across PLOS. This section within the larger Meta-Research Collection focuses on Reproducibility.

Image Credit: fdecomite, flickr.com

Jump to section

Reproducibility
From the Web

Reproducibility

PLOS Biology Reproducible research practices, transparency, and open access data in the biomedical literature, 2015–2017
November 20, 2018 Joshua D. Wallach, Kevin W. Boyack, John P. A. Ioannidis
PLOS Biology The bench is closer to the bedside than we think: Uncovering the ethical ties between preclinical researchers in translational neuroscience and patients in clinical trials
June 6, 2018 Mark Yarborough, Annelien Bredenoord, Flavio D’Abramo, Nanette C. Joyce, Jonathan Kimmelman, Ubaka Ogbogu, Emily Sena, Daniel Strech, Ulrich Dirnagl
PLOS Biology What exactly is ‘N’ in cell culture and animal experiments?
April 4, 2018 Stanley E. Lazic, Charlie J. Clarke-Williams, Marcus R. Munafò
PLOS Biology Meta-research matters: Meta-spin cycles, the blindness of bias, and rebuilding trust
April 2, 2018 Lisa Bero
PLOS Biology How measurement science can improve confidence in research results
April 23, 2018 Anne L. Plant, Chandler A. Becker, Robert J. Hanisch, Ronald F. Boisvert, Antonio M. Possolo, John T. Elliott
PLOS Biology Meta-research: Why research on research matters
March 13, 2018 John P. A. Ioannidis
PLOS Biology Reproducible preclinical research—Is embracing variability the answer?
March 5, 2018 Natasha A. Karp
PLOS Biology Reproducibility of preclinical animal research improves with heterogeneity of study samples
February 22, 2018 Bernhard Voelkl, Lucile Vogt, Emily S. Sena, Hanno Würbel
PLOS Biology The Experimental Design Assistant
September 28, 2017 Nathalie Percie du Sert, Ian Bamsey, Simon T. Bate, Manuel Berdoy, Robin A. Clark, Innes Cuthill, Derek Fry, Natasha A. Karp, Malcolm Macleod, Lawrence Moon, S. Clare Stanford, Brian Lings
PLOS ONE A checklist is associated with increased quality of reporting preclinical biomedical research: A systematic review
September 13, 2017 SeungHye Han, Tolani F. Olonisakin, John P. Pribis, Jill Zupetic, Joo Heung Yoon, Kyle M. Holleran, Kwonho Jeong, Nader Shaikh, Doris M. Rubio, Janet S. Lee
PLOS Biology Can cancer researchers accurately judge whether preclinical reports will reproduce?
June 29, 2017 Daniel Benjamin, David R. Mandel, Jonathan Kimmelman
PLOS Biology The credibility crisis in research: Can economics tools help?
April 26, 2017 Thomas Gall, John P. A. Ioannidis, Zacharias Maniadis
PLOS Biology The need for a worldwide consensus for cell line authentication: Experience implementing a mandatory requirement at the International Journal of Cancer
April 17, 2017 Norbert E. Fusenig, Amanda Capes-Davis, Franca Bianchini, Sherryl Sundell, Peter Lichter
PLOS Biology Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature
March 2, 2017 Denes Szucs, John P. A. Ioannidis
PLOS Biology A Practical Guide for Improving Transparency and Reproducibility in Neuroimaging Research
July 7, 2016 Krzysztof J. Gorgolewski, Russell A. Poldrack
PLOS ONE A Bayesian Perspective on the Reproducibility Project: Psychology
February 26, 2016 Alexander Etz, Joachim Vandekerckhove
PLOS Biology Reproducible Research Practices and Transparency across the Biomedical Literature
January 4, 2016 Shareen A. Iqbal, Joshua D. Wallach, Muin J. Khoury, Sheri D. Schully, John P. A. Ioannidis
PLOS Biology Public Data Archiving in Ecology and Evolution: How Well Are We Doing?
November 10, 2015 Dominique G. Roche, Loeske E. B. Kruuk, Robert Lanfear, Sandra A. Binning
PLOS Biology The Economics of Reproducibility in Preclinical Research
June 9, 2015 Leonard P. Freedman, Iain M. Cockburn, Timothy S. Simcoe
PLOS ONE When Data Sharing Gets Close to 100%: What Human Paleogenetics Can Teach the Open Science Movement
March 23, 2015 Paolo Anagnostou, Marco Capocasa, Nicola Milia, Emanuele Sanna, Cinzia Battaggia, Daniela Luzi, Giovanni Destro Bisol
PLOS Biology Spatially Explicit Data: Stewardship and Ethical Challenges in Science
September 3, 2013 Joel Hartter, Sadie J. Ryan, Catrina A. MacKenzie, John N. Parker, Carly A. Strasser
PLOS ONE Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results
November 2, 2011 Jelte M. Wicherts, Marjan Bakker, Dylan Molenaar

From the Web

Reddit Elevated average risk of bias in work from leading institutions or work published in high-impact factor journals – AMA
January 13, 2016 Malcolm Macleod, David Howells
Biologue Meta-Research: Getting the Most Out of Research
January 4, 2016 Roli Roberts
Reddit Research Reproducibility – AMA
October 21, 2015 John Ioannidis, Robert M. Kaplan
Reddit Why publishing everything is more effective than just publishing significant findings – AMA
May 27, 2015 Jelte Wicherts
Reddit “p-hacking” in science publications – AMA
May 20, 2015 Megan Head
Biologue Metrics and Impact – Looking Beyond Research Articles
March 2, 2015 Stavroula Kousta