Disciplinary Examples

Chin, J., & Zeiler, K. (2021). Replicability in Empirical Legal Research [Preprint]. LawArXiv. https://doi.org/10.31228/osf.io/2b5k4
Klapwijk, E. T., van den Bos, W., Tamnes, C. K., Raschle, N. M., & Mills, K. L. (2021). Opportunities for increased reproducibility and replicability of developmental neuroimaging. Developmental Cognitive Neuroscience, 47, 100902. https://doi.org/10.1016/j.dcn.2020.100902
Adewumi, M. T., Vo, N., Tritz, D., Beaman, J., & Vassar, M. (2021). An evaluation of the practice of transparency and reproducibility in addiction medicine literature. Addictive Behaviors, 112, 106560. https://doi.org/10.1016/j.addbeh.2020.106560
Janz, N., & Freese, J. (2020). Replicate Others as You Would Like to Be Replicated Yourself. PS: Political Science & Politics, 1–4. https://doi.org/10.1017/S1049096520000943
Bush, R., Dutton, A., Evans, M., Loft, R., & Schmidt, G. A. (2020). Perspectives on Data Reproducibility and Replicability in Paleoclimate and Climate Science. Issue 2.4, 2(4). https://doi.org/10.1162/99608f92.00cd8f85
Smith, L. M., Yu, F., & Schmid, K. (2020). Role of Replication Research in Biostatistics Graduate Education. Journal of Statistics Education, 1–17. https://doi.org/10.1080/10691898.2020.1844105
Prenkaj, B., Velardi, P., Distante, D., & Faralli, S. (2020). A Reproducibility Study of Deep and Surface Machine Learning Methods for Human-related Trajectory Prediction. Proceedings of the 29th ACM International Conference on Information & Knowledge Management, 2169–2172. https://doi.org/10.1145/3340531.3412088
Fekete, J.-D., Freire, J., & Rhyne, T.-M. (2020). Exploring Reproducibility in Visualization. IEEE Computer Graphics and Applications, 40(5), 108–119. https://doi.org/10.1109/MCG.2020.3006412
Kedron, P., Li, W., Fotheringham, S., & Goodchild, M. (2020). Reproducibility and replicability: opportunities and challenges for geospatial research. International Journal of Geographical Information Science, 1–19. https://doi.org/10.1080/13658816.2020.1802032
Minocher, R., Atmaca, S., Bavero, C., McElreath, R., & Beheim, B. (2020). Reproducibility of social learning research declines exponentially over 63 years of publication [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/4nzc7
Wooditch, A., Fisher, R., Wu, X., & Johnson, N. J. (2020). p-value Problems? An Examination of Evidential Value in Criminology. Journal of Quantitative Criminology. https://doi.org/10.1007/s10940-020-09459-5
Marks-Anglin, A., & Chen, Y. (2020). A Historical Review of Publication Bias [Preprint]. MetaArXiv. https://doi.org/10.31222/osf.io/zmdpk
Maassen, E., van Assen, M. A. L. M., Nuijten, M. B., Olsson-Collentine, A., & Wicherts, J. M. (2020). Reproducibility of individual effect sizes in meta-analyses in psychology. PLOS ONE, 15(5), e0233107. https://doi.org/10.1371/journal.pone.0233107
Ruggeri, K., Linden, S. van der, Papa, F., & Green, J. (2020). Standards for evidence in policy decision-making [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/fjwvk
Yang, Y., Youyou, W., & Uzzi, B. (2020). Estimating the deep replicability of scientific findings using human and artificial intelligence. Proceedings of the National Academy of Sciences, 201909046. https://doi.org/10.1073/pnas.1909046117
Bergh, D. D., & Oswald, F. L. (2020). Fostering Robust, Reliable, and Replicable Research at the Journal of Management. Journal of Management, 014920632091772. https://doi.org/10.1177/0149206320917729
Ulrich, R., & Miller, J. (2020). Meta Research: Replication of Significant Results --- Modeling the Effects of p-Hacking [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/tu7zr
Hail, L., Lang, M., & Leuz, C. (2020). Reproducibility in Accounting Research: Views of the Research Community. Journal of Accounting Research. https://doi.org/10.1111/1475-679X.12305
Fuller, A. K., Decker, D. J., Schiavone, M. V., & Forstchen, A. B. (2020). Ratcheting up Rigor in Wildlife Management Decision Making. Wildlife Society Bulletin, wsb.1064. https://doi.org/10.1002/wsb.1064
Edson Oliveira Jr, Zorzo, A. F., & Neu, C. V. (2020). Towards a conceptual model for promoting digital forensics experiments. Forensic Science International: Digital Investigation, 35, 301014. https://doi.org/10.1016/j.fsidi.2020.301014
Essawy, B. T., Goodall, J. L., Voce, D., Morsy, M. M., Sadler, J. M., Choi, Y. D., Tarboton, D. G., & Malik, T. (2020). A taxonomy for reproducible and replicable research in environmental modelling. Environmental Modelling & Software, 104753. https://doi.org/10.1016/j.envsoft.2020.104753
Planavsky, N., Hood, A., Tarhan, L., Shen, S., & Johnson, K. (2020). Store and share ancient rocks. Nature, 581(7807), 137–139. https://doi.org/10.1038/d41586-020-01366-w
Larson, M. J. (2020). Improving the Rigor and Replicability of Applied Psychophysiology Research: Sample Size, Standardization, Transparency, and Preregistration. Biofeedback, 48(1), 2–6. https://doi.org/10.5298/1081-5937-48.1.2
Gilmore, R. O., Cole, P. M., Verma, S., Aken, M. A. G., & Worthman, C. M. (2020). Advancing Scientific Integrity, Transparency, and Openness in Child Development Research: Challenges and Possible Solutions. Child Development Perspectives, 14(1), 9–14. https://doi.org/10.1111/cdep.12360
Irreproducibility is not a sign of failure, but an inspiration for fresh ideas. (2020). Nature, 578(7794), 191–192. https://doi.org/10.1038/d41586-020-00380-2
Hardwicke, T. E., Wallach, J. D., Kidwell, M. C., Bendixen, T., Crüwell, S., & Ioannidis, J. P. A. (2020). An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014–2017). Royal Society Open Science, 7(2), 190806. https://doi.org/10.1098/rsos.190806
Bienefeld, M., Böhm-Kasper, O., & Demmer, C. (2020). Highly recommended and yet neglected. The rarity of replication studies in educational science. Journal for Educational Research Online, 12(3), 3–22. http://nbn-resolving.de/urn:nbn:de:0111-pedocs-211840
Luo, Tianyi, Li, Xingyu, Wang, Hainan, & Liu, Yang. (2020). Research Replication Prediction Using Weakly Supervised Learning. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings.
Marone, L., Lopez de Casenave, J., & González del Solar, R. (2019). Mario Bunge’s systemic thesis of truth: implications for research practice and the “reproducibility crisis.” Humanities Journal of Valparaiso, 14, 363. https://doi.org/10.22370/rhv2019iss14pp363-376
Vijayakumar, R., & Cheung, M. W.-L. (2019). Assessing Replicability of Machine Learning Results: An Introduction to Methods on Predictive Accuracy in Social Sciences. Social Science Computer Review, 089443931988844. https://doi.org/10.1177/0894439319888445
Bryan, C. J., Yeager, D. S., & O’Brien, J. M. (2019). Replicator degrees of freedom allow publication of misleading failures to replicate. Proceedings of the National Academy of Sciences, 201910951. https://doi.org/10.1073/pnas.1910951116
Gabrieli, G., Scapin, G., Bornstein, M. H., & Esposito, G. (2019). Are Cry Studies Replicable? An Analysis of Participants, Setups, and Methods Adopted and Reported in Cry Studies. https://doi.org/10.20944/preprints201911.0176.v1
Isaacowitz, D. M. (2019). OPEN SCIENCE IN GERONTOLOGY: IMPLICATIONS FOR PUBLISHING. Innovation in Aging, 3(Supplement_1), S399–S400. https://doi.org/10.1093/geroni/igz038.1480
Damian, E., Meuleman, B., & van Oorschot, W. (2019). Transparency and Replication in Cross-national Survey Research: Identification of Problems and Possible Solutions. Sociological Methods & Research, 004912411988245. https://doi.org/10.1177/0049124119882452
Jamieson, K. H., McNutt, M., Kiermer, V., & Sever, R. (2019). Signaling the trustworthiness of science. Proceedings of the National Academy of Sciences, 116(39), 19231–19236. https://doi.org/10.1073/pnas.1913039116
Feng, X., Park, D. S., Walker, C., Peterson, A. T., Merow, C., & Papeş, M. (2019). A checklist for maximizing reproducibility of ecological niche models. Nature Ecology & Evolution. https://doi.org/10.1038/s41559-019-0972-5
Unger, J. M. (2019). Reproducible Findings in Systematic Reviews and Meta-analyses in Oncology: Verify, Then Trust. JAMA Oncology. https://doi.org/10.1001/jamaoncol.2019.2664
Gennetian, L. A., Tamis-LeMonda, C. S., & Frank, M. C. (2019). Advancing Transparency and Openness in Child Development Research: Opportunities [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/wbv2d
Roettger, T. B. (2019). Preregistration in linguistic research: Applications, challenges, and limitations [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/vc9hu
Kedron, P., Frazier, A. E., Trgovac, A. B., Nelson, T., & Fotheringham, A. S. (2019). Reproducibility and Replicability in Geographical Analysis. Geographical Analysis, gean.12221. https://doi.org/10.1111/gean.12221
Ziółkowski, A. (2019). The Stability of Philosophical Intuitions: Failed Replications of Swain et al. (2008). Episteme, 1–19. https://doi.org/10.1017/epi.2019.20
Crüwell, S., Stefan, A. M., & Evans, N. J. (2019). Robust Standards in Cognitive Science. Computational Brain & Behavior. https://doi.org/10.1007/s42113-019-00049-8
Grahe, J. E., Cuccolo, K., Leighton, D. C., & Cramblet Alvarez, L. D. (2019). Open Science Promotes Diverse, Just, and Sustainable Research and Educational Outcomes. Psychology Learning & Teaching, 147572571986916. https://doi.org/10.1177/1475725719869164
Hao, Q., Smith IV, D. H., Iriumi, N., Tsikerdekis, M., & Ko, A. J. (2019). A Systematic Investigation of Replications in Computing Education Research. ACM Transactions on Computing Education, 19(4), 1–18. https://doi.org/10.1145/3345328
Smith, C. A., Nolan, J., Tritz, D. J., Heavener, T. E., Pelton, J., Cook, K., & Vassar, M. (2019). Evaluation of Reproducible and Transparent Research Practices in Pulmonology Publications [Preprint]. Scientific Communication and Education. https://doi.org/10.1101/726505
Isaacowitz, D. M., & Lind, M. (2019). Open Science is for Aging Research, Too. Innovation in Aging, 3(4), igz028. https://doi.org/10.1093/geroni/igz028
Fladie, I. A., Evans, S., Checketts, J., Tritz, D., Norris, B., & Vassar, M. (2019). Can Orthopaedics become the Gold Standard for Reproducibility? A Roadmap to Success [Preprint]. Scientific Communication and Education. https://doi.org/10.1101/715144
Rios, J. A., Ihlenfeldt, S. D., Dosedel, M., & Riegelman, A. (2019). A Topical and Methodological Systematic Review of Meta‐Analyses Published in the Educational Measurement Literature. Educational Measurement: Issues and Practice, emip.12282. https://doi.org/10.1111/emip.12282
Anderson, J. M., Wright, B., Tritz, D., Horn, J., Parker, I., Bergeron, D., Cook, S., & Vassar, M. (2019). Evaluation of Indicators of Reproducibility and Transparency in Published Cardiology Literature [Preprint]. Cardiovascular Medicine. https://doi.org/10.1101/19002121
Bishop, D. V. M. (2019). The psychology of experimental psychologists: Overcoming cognitive constraints to improve research [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/hnbex