The case for formal methodology in scientific reform

Berna Devezer, Danielle J. Navarro, Joachim Vandekerckhove, Erkan Ozge Buzbas Current attempts at methodological reform in sciences come in response to an overall lack of rigor in methodological and scientific practices in experimental sciences. However, some of these reform attempts suffer from the same mistakes and over-generalizations they purport to address. Considering the costs of allowing false claims to become canonized, we argue for more rigor and nuance in methodological reform. By way of example, we present a formal analysis of three common claims in the metascientific literature: (a) that reproducibility is the cornerstone of science; (b) that data must not be used twice in any analysis; and (c) that exploratory projects are characterized by poor statistical practice. We show that none of these three claims are correct in general and we explore when they do and do not hold. DOI: 10.1098/rsos.200805


Devezer, B., Navarro, D. J., Vandekerckhove, J., & Buzbas, E. O. (2021). The case for formal methodology in scientific reform. Royal Society Open Science.


  title     = {The case for formal methodology in scientific reform},
  author    = {Devezer, B. and Navarro, D. J. and Vandekerckhove, J. and Buzbas, E. O.},
  journal   = {Royal Society Open Science},
  year      = {2021},
  doi       = {10.1098/rsos.200805},