Publications

     

Metastudies for robust tests of theory

B. Baribault and C. Donkin and D. R. Little and J. Trueblood and Z. Oravecz and D. van Ravenzwaaij and C. N. White and P. de Boeck and J. Vandekerckhove We describe and demonstrate an empirical strategy useful for discovering and replicating empirical effects in psychological science. The method involves the design of a metastudy, in which many independent experimental variables - that may be moderators of an empirical effect - are indiscriminately randomized. Radical randomization yields rich datasets that can be used to test the robustness of an empirical claim to some of the vagaries and idiosyncrasies of experimental protocols and enhances the generalizability of these claims. The strategy is made feasible by advances in hierarchical Bayesian modeling that allow for the pooling of information across unlike experiments and designs and is proposed here as a gold standard for replication research and exploratory research. The practical feasibility of the strategy is demonstrated with a replication of a study on subliminal priming. DOI: 10.1073/pnas.1708285114

Citation

Baribault, B., Donkin, C., Little, D. R., Trueblood, J. S., Oravecz, Z., van Ravenzwaaij, D., White, C. N., De Boeck, P., & Vandekerckhove, J. (2018). Metastudies for robust tests of theory. Proceedings of the National Academy of Sciences, 115, 2607–2612.

BibTeX

@article{baribault2018metastudies,
  title     = {Metastudies for robust tests of theory},
  author    = {Baribault, B. and Donkin, C. and Little, D. R. and Trueblood, J. S. and Oravecz, Z. and van Ravenzwaaij, D. and White, C. N. and De Boeck, P. and Vandekerckhove, J.},
  journal   = {Proceedings of the National Academy of Sciences},
  year      = {2018},
  volume    = {115},
  pages     = {2607--2612},
  doi       = {10.1073/pnas.1708285114},
}