LDI Executive Director contributes to HDSR special issue on Replicability in Science

December 21, 2020: LDI Executive Director Vilhuber's paper, Reproducibility and Replicability in Economics, which covers a brief history of reproducability and replicability in the academic field of economics, and a discussion of more general replicability and transparency, is published in issue 2:4 of the Harvard Data Science Review:

In 2019, The National Academies released the report Reproducibility and Replicability in Science which defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve rigor and transparency in the scientific enterprise. 

The conversation about this report and this vital topic continues in a recently published, special, twelve-article feature in issue 2:4 of the Harvard Data Science Review (HDSR).Guest edited by Victoria Stodden (University of Illinois, Urbana-Champaign), the special theme collection presents research and commentary from an interdisciplinary group of scholars and professionals. Articles include:

• Interview with Reproducibility and Replicability in Science Committee Chair Harvey V. Fineberg President of the Gordon and Betty Moore Foundation and HDSR guest editor, Victoria Stodden, committee member by HDSR Editor-in-Chief Xiao-Li Meng
• Self-Correction by Design by Marcia McNutt, President of NAS
• Leveraging the National Academies ‘Reproducibility and Replication in Science’ Report to Advance Reproducibility in Publishing by Manish Parasha, Assistant Director for Strategic Computing at the White House Office of Science and Technology Policy, and Director of the Office of Advanced Cyberinfrastructure at the National Science Foundation
• Toward Reproducible and Extensible Research: from Values to Action by Aleksandrina Goeva (Broad Institute), Sara Stoudt (Smith College), Ana Trisovic (Harvard University)
• Reproducibility and Replicability in Economics by Lars Vilhuber (Cornell University)
• Reproducibility and Replicability in Science, A Metrology Perspective by Anne L. Plant (National Institute of Standards and Technology) and Robert J. Hanisch (National Institute of Standards and Technology)
• Perspectives on Data Reproducibility and Replicability in Paleoclimate and Climate Science by Rosemary T. Bush (Northwestern University), Andrea Dutton (University of Wisconsin, Madison), Michael N. Evans (University of Maryland, College Park), Rich Loft (National Center for Atmospheric Research), and Gavin A. Schmidt (National Aeronautics and Space Administration)
• What We Know About Uncertainty in the Public Eye: An Overview and Call for Research on Public Perceptions of Uncertainty, Reproducibility, and Replicability in Science by Emily Howell
• Learning Lessons on Reproducibility and Replicability in Large Scale Genome-Wide Association Studies by Xihong Lin (Harvard University)
• Selective Inference: The Silent Killer by Yoav Benjamini (Tel Aviv University)
• Trust but Verify: How to Leverage Policies, Workflows, and Infrastructure to Ensure Computational Reproducibility in Publication by Craig Willis (University of Illinois at Urbana-Champaign) and Victoria Stodden
• Reproducibility and Replication of Experimental Particle Physics Results by Thomas R. Junk (Fermi National Accelerator Laboratory) and Louis Lyons (University of Oxford, Emeritus)

The editors hope to take advantage of the collaborative features available on the open-source publishing platform, PubPub, where HDSR is hosted. Readers around the world can freely read, annotate, and comment on the essays—continuing this important conversation