Research Analysis & Policy

Meta-Research: Reproducibility

Updated May 14, 2019 Curated Collections

Meta-research, or the scientific study of research practices, aims to characterize existing standards and ultimately improve the quality and reliability of scientific research. We collect here meta-research articles across PLOS. This section within the larger Meta-Research Collection focuses on Reproducibility.

Image Credit: fdecomite, flickr.com

Jump to section

Reproducibility
From the Web

Reproducibility

Image credit
Janeke88, Pixabay

PLOS Biology Reproducible research practices, transparency, and open access data in the biomedical literature, 2015–2017
November 20, 2018 Joshua D. Wallach, Kevin W. Boyack, John P. A. Ioannidis
Image credit
Pixabay

PLOS Biology The bench is closer to the bedside than we think: Uncovering the ethical ties between preclinical researchers in translational neuroscience and patients in clinical trials
June 6, 2018 Mark Yarborough, Annelien Bredenoord, Flavio D’Abramo, Nanette C. Joyce, Jonathan Kimmelman, Ubaka Ogbogu, Emily Sena, Daniel Strech, Ulrich Dirnagl
Image credit
10.1371/journal.pbio.2005282

PLOS Biology What exactly is ‘N’ in cell culture and animal experiments?
April 4, 2018 Stanley E. Lazic, Charlie J. Clarke-Williams, Marcus R. Munafò
Image credit
10.1371/journal.pbio.2005972

PLOS Biology Meta-research matters: Meta-spin cycles, the blindness of bias, and rebuilding trust
April 2, 2018 Lisa Bero
Image credit
GIF-Wikipedia/Wikispaces

PLOS Biology How measurement science can improve confidence in research results
April 23, 2018 Anne L. Plant, Chandler A. Becker, Robert J. Hanisch, Ronald F. Boisvert, Antonio M. Possolo, John T. Elliott
Image credit
Anna Miska-Alvarez

PLOS Biology Meta-research: Why research on research matters
March 13, 2018 John P. A. Ioannidis
Image credit
10.1371/journal.pbio.2005413

PLOS Biology Reproducible preclinical research—Is embracing variability the answer?
March 5, 2018 Natasha A. Karp
Image credit
10.1371/journal.pbio.2003693

PLOS Biology Reproducibility of preclinical animal research improves with heterogeneity of study samples
February 22, 2018 Bernhard Voelkl, Lucile Vogt, Emily S. Sena, Hanno Würbel
Image credit
10.1371/journal.pbio.2003779

PLOS Biology The Experimental Design Assistant
September 28, 2017 Nathalie Percie du Sert, Ian Bamsey, Simon T. Bate, Manuel Berdoy, Robin A. Clark, Innes Cuthill, Derek Fry, Natasha A. Karp, Malcolm Macleod, Lawrence Moon, S. Clare Stanford, Brian Lings
Image credit
fdecomite

PLOS ONE A checklist is associated with increased quality of reporting preclinical biomedical research: A systematic review
September 13, 2017 SeungHye Han, Tolani F. Olonisakin, John P. Pribis, Jill Zupetic, Joo Heung Yoon, Kyle M. Holleran, Kwonho Jeong, Nader Shaikh, Doris M. Rubio, Janet S. Lee
Image credit
10.1371/journal.pbio.2002212

PLOS Biology Can cancer researchers accurately judge whether preclinical reports will reproduce?
June 29, 2017 Daniel Benjamin, David R. Mandel, Jonathan Kimmelman
Image credit
Flickr user James Cridland

PLOS Biology The credibility crisis in research: Can economics tools help?
April 26, 2017 Thomas Gall, John P. A. Ioannidis, Zacharias Maniadis
Image credit
10.1371/journal.pbio.2001438

PLOS Biology The need for a worldwide consensus for cell line authentication: Experience implementing a mandatory requirement at the International Journal of Cancer
April 17, 2017 Norbert E. Fusenig, Amanda Capes-Davis, Franca Bianchini, Sherryl Sundell, Peter Lichter
Image credit
10.1371/journal.pbio.2000797

PLOS Biology Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature
March 2, 2017 Denes Szucs, John P. A. Ioannidis
Image credit
10.1371/journal.pbio.1002506

PLOS Biology A Practical Guide for Improving Transparency and Reproducibility in Neuroimaging Research
July 7, 2016 Krzysztof J. Gorgolewski, Russell A. Poldrack
Image credit
10.1371/journal.pone.0149794

PLOS ONE A Bayesian Perspective on the Reproducibility Project: Psychology
February 26, 2016 Alexander Etz, Joachim Vandekerckhove
Image credit
10.1371/journal.pbio.1002333

PLOS Biology Reproducible Research Practices and Transparency across the Biomedical Literature
January 4, 2016 Shareen A. Iqbal, Joshua D. Wallach, Muin J. Khoury, Sheri D. Schully, John P. A. Ioannidis
Image credit
10.1371/journal.pbio.1002295

PLOS Biology Public Data Archiving in Ecology and Evolution: How Well Are We Doing?
November 10, 2015 Dominique G. Roche, Loeske E. B. Kruuk, Robert Lanfear, Sandra A. Binning
Image credit
10.1371/journal.pbio.1002165

PLOS Biology The Economics of Reproducibility in Preclinical Research
June 9, 2015 Leonard P. Freedman, Iain M. Cockburn, Timothy S. Simcoe
Image credit
10.1371/journal.pone.0121409

PLOS ONE When Data Sharing Gets Close to 100%: What Human Paleogenetics Can Teach the Open Science Movement
March 23, 2015 Paolo Anagnostou, Marco Capocasa, Nicola Milia, Emanuele Sanna, Cinzia Battaggia, Daniela Luzi, Giovanni Destro Bisol
Image credit
10.1371/journal.pbio.1001634

PLOS Biology Spatially Explicit Data: Stewardship and Ethical Challenges in Science
September 3, 2013 Joel Hartter, Sadie J. Ryan, Catrina A. MacKenzie, John N. Parker, Carly A. Strasser
Image credit
10.1371/journal.pone.0026828

PLOS ONE Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results
November 2, 2011 Jelte M. Wicherts, Marjan Bakker, Dylan Molenaar

From the Web

Image credit
Reddit/PLOS

Reddit Elevated average risk of bias in work from leading institutions or work published in high-impact factor journals – AMA
January 13, 2016 Malcolm Macleod, David Howells
Image credit
118118485@N05

Biologue Meta-Research: Getting the Most Out of Research
January 4, 2016 Roli Roberts
Image credit
Reddit/PLOS

Reddit Research Reproducibility – AMA
October 21, 2015 John Ioannidis, Robert M. Kaplan
Image credit
Reddit/PLOS

Reddit Why publishing everything is more effective than just publishing significant findings – AMA
May 27, 2015 Jelte Wicherts
Image credit
Reddit/PLOS

Reddit “p-hacking” in science publications – AMA
May 20, 2015 Megan Head
Image credit
PLOS

Biologue Metrics and Impact – Looking Beyond Research Articles
March 2, 2015 Stavroula Kousta