Social Science Examples

Vijayakumar, R., & Cheung, M. W.-L. (2019). Assessing Replicability of Machine Learning Results: An Introduction to Methods on Predictive Accuracy in Social Sciences. Social Science Computer Review, 089443931988844. https://doi.org/10.1177/0894439319888445
Bryan, C. J., Yeager, D. S., & O’Brien, J. M. (2019). Replicator degrees of freedom allow publication of misleading failures to replicate. Proceedings of the National Academy of Sciences, 201910951. https://doi.org/10.1073/pnas.1910951116
Isaacowitz, D. M. (2019). OPEN SCIENCE IN GERONTOLOGY: IMPLICATIONS FOR PUBLISHING. Innovation in Aging, 3(Supplement_1), S399–S400. https://doi.org/10.1093/geroni/igz038.1480
Damian, E., Meuleman, B., & van Oorschot, W. (2019). Transparency and Replication in Cross-national Survey Research: Identification of Problems and Possible Solutions. Sociological Methods & Research, 004912411988245. https://doi.org/10.1177/0049124119882452
Wolf, L. J., Rey, S. J., & Oshan, T. M. (2019). Open Code is not enough: Towards a replicable future for geographic data science (preprint). SocArXiv. https://doi.org/10.31235/osf.io/3hbnt
Gennetian, L. A., Tamis-LeMonda, C. S., & Frank, M. C. (2019). Advancing Transparency and Openness in Child Development Research: Opportunities (preprint). PsyArXiv. https://doi.org/10.31234/osf.io/wbv2d
Roettger, T. B. (2019). Preregistration in linguistic research: Applications, challenges, and limitations (preprint). PsyArXiv. https://doi.org/10.31234/osf.io/vc9hu
Kedron, P., Frazier, A. E., Trgovac, A. B., Nelson, T., & Fotheringham, A. S. (2019). Reproducibility and Replicability in Geographical Analysis. Geographical Analysis, gean.12221. https://doi.org/10.1111/gean.12221
Ziółkowski, A. (2019). The Stability of Philosophical Intuitions: Failed Replications of Swain et al. (2008). Episteme, 1–19. https://doi.org/10.1017/epi.2019.20
Crüwell, S., Stefan, A. M., & Evans, N. J. (2019). Robust Standards in Cognitive Science. Computational Brain & Behavior. https://doi.org/10.1007/s42113-019-00049-8
Grahe, J. E., Cuccolo, K., Leighton, D. C., & Cramblet Alvarez, L. D. (2019). Open Science Promotes Diverse, Just, and Sustainable Research and Educational Outcomes. Psychology Learning & Teaching, 147572571986916. https://doi.org/10.1177/1475725719869164
Hao, Q., Smith IV, D. H., Iriumi, N., Tsikerdekis, M., & Ko, A. J. (2019). A Systematic Investigation of Replications in Computing Education Research. ACM Transactions on Computing Education, 19(4), 1–18. https://doi.org/10.1145/3345328
Stojmenovska, D., Bol, T., & Leopold, T. (2019). Teaching Replication to Graduate Students. Teaching Sociology, 0092055X1986799. https://doi.org/10.1177/0092055X19867996
Isaacowitz, D. M., & Lind, M. (2019). Open Science is for Aging Research, Too. Innovation in Aging, 3(4), igz028. https://doi.org/10.1093/geroni/igz028
Rios, J. A., Ihlenfeldt, S. D., Dosedel, M., & Riegelman, A. (2019). A Topical and Methodological Systematic Review of Meta‐Analyses Published in the Educational Measurement Literature. Educational Measurement: Issues and Practice, emip.12282. https://doi.org/10.1111/emip.12282
Bishop, D. V. M. (2019). The psychology of experimental psychologists: Overcoming cognitive constraints to improve research (preprint). PsyArXiv. https://doi.org/10.31234/osf.io/hnbex
Chin, J. M., Ribeiro, G., & Rairden, A. (2019). Open forensic science. Journal of Law and the Biosciences, lsz009. https://doi.org/10.1093/jlb/lsz009
Sarafoglou, A., Hoogeveen, S., Matzke, D., & Wagenmakers, E.-J. (2019). Teaching Good Research Practices: Protocol of a Research Master Course. Psychology Learning & Teaching, 147572571985880. https://doi.org/10.1177/1475725719858807
Davis-Kean, P., & Ellis, A. (2019). An Overview of Issues in Infant and Developmental Research for the creation of Robust and Replicable Science (preprint). PsyArXiv. https://doi.org/10.31234/osf.io/m4576
Branney, P., Reid, K., Frost, N., Coan, S., Mathieson, A., & Woolhouse, M. (2019). A context-consent meta-framework for designing open (qualitative) data studies. Qualitative Research in Psychology, 16(3), 483–502. https://doi.org/10.1080/14780887.2019.1605477
Button, K. S., Chambers, C. D., Lawrence, N., & Munafò, M. R. (2019). Grassroots Training for Reproducible Science: A Consortium-Based Approach to the Empirical Dissertation. Psychology Learning & Teaching, 147572571985765. https://doi.org/10.1177/1475725719857659
Weston, S. J., Ritchie, S. J., Rohrer, J. M., & Przybylski, A. K. (2019). Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets. Advances in Methods and Practices in Psychological Science, 251524591984868. https://doi.org/10.1177/2515245919848684
Epskamp, S. (2019). Reproducibility and Replicability in a Fast-Paced Methodological World. Advances in Methods and Practices in Psychological Science, 251524591984742. https://doi.org/10.1177/2515245919847421
Ozier, O. (2019). Replication Redux : The Reproducibility Crisis and the Case of Deworming (No. WPS8835) (pp. 1–43). The World Bank. Retrieved from http://documents.worldbank.org/curated/en/118271556632669793/Replication-Redux-The-Reproducibility-Crisis-and-the-Case-of-Deworming
Hardwicke, T. E., Wallach, J., Kidwell, M., & Ioannidis, john. (2019). An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014-2017) (preprint). MetaArXiv. https://doi.org/10.31222/osf.io/6uhg5
Schnack, H. (2019). Assessing reproducibility in association studies. ELife, 8, e46757. https://doi.org/10.7554/eLife.46757
Aguinis, H., & Solarino, A. M. (2019). Transparency and replicability in qualitative research: The case of interviews with elite informants. Strategic Management Journal, smj.3015. https://doi.org/10.1002/smj.3015
Penders, B., Holbrook, J. B., & de Rijcke, S. (2019). Rinse and repeat: the situated value of replication across epistemic cultures (preprint). SocArXiv. https://doi.org/10.31235/osf.io/nfjb6
L. Haven, T., & Van Grootel, D. L. (2019). Preregistering qualitative research. Accountability in Research, 1–16. https://doi.org/10.1080/08989621.2019.1580147
Frank, M. C. (2019). Towards a more robust and replicable science of infant development. Infant Behavior and Development, 57, 101349. https://doi.org/10.1016/j.infbeh.2019.101349
Nosek, B. A., Beck, E. D., Campbell, L., Flake, J. K., Hardwicke, T. E., Mellor, D. T., … Vazire, S. (2019). Preregistration Is Hard, And Worthwhile. Trends in Cognitive Sciences, 23(10), 815–818. https://doi.org/10.1016/j.tics.2019.07.009
Eren, M. I., Bebber, M. R., Norris, J. D., Perrone, A., Rutkoski, A., Wilson, M., & Raghanti, M. A. (2019). Experimental replication shows knives manufactured from frozen human feces do not work. Journal of Archaeological Science: Reports, 27, 102002. https://doi.org/10.1016/j.jasrep.2019.102002
Chambers, C. (2019). What’s next for Registered Reports? Nature, 573(7773), 187–189. https://doi.org/10.1038/d41586-019-02674-6
Uhlmann, E. L., Ebersole, C. R., Chartier, C. R., Errington, T. M., Kidwell, M. C., Lai, C. K., … Nosek, B. A. (2019). Scientific Utopia III: Crowdsourcing Science. Perspectives on Psychological Science, 174569161985056. https://doi.org/10.1177/1745691619850561
Wuttke, A. (2019). Why Too Many Political Science Findings Cannot Be Trusted and What We Can Do About It: A Review of Meta-Scientific Research and a Call for Academic Reform. Politische Vierteljahresschrift, 60(1), 1–19. https://doi.org/10.1007/s11615-018-0131-7
Strømland, E. (2019). Preregistration and reproducibility. Journal of Economic Psychology. https://doi.org/10.1016/j.joep.2019.01.006
Anderson, D., Spybrook, J., & Maynard, R. (2019). REES: A Registry of Efficacy and Effectiveness Studies in Education. Educational Researcher, 48(1), 45–50. https://doi.org/10.3102/0013189X18810513
Stricker, J., & Günther, A. (2019). Scientific Misconduct in Psychology: A Systematic Review of Prevalence Estimates and New Empirical Data. Zeitschrift Für Psychologie, 227(1), 53–63. https://doi.org/10.1027/2151-2604/a000356
Camerer, C. F. (2019). Replication and other practices for improving scientific quality in experimental economics. In A. Schram & A. Ule, Handbook of Research Methods and Applications in Experimental Economics (pp. 83–102). Edward Elgar Publishing. https://doi.org/10.4337/9781788110563.00012
Christensen, G., & Miguel, E. (2018). Transparency, Reproducibility, and the Credibility of Economics Research. Journal of Economic Literature, 56(3), 920–980. https://doi.org/10.1257/jel.20171350
McBee, M. T., Makel, M. C., Peters, S. J., & Matthews, M. S. (2018). A Call for Open Science in Giftedness Research. Gifted Child Quarterly, 001698621878417. https://doi.org/10.1177/0016986218784178
Morgan-Short, K., Marsden, E., Heil, J., Issa II, B. I., Leow, R. P., Mikhaylova, A., … Szudarski, P. (2018). Multisite Replication in Second Language Acquisition Research: Attention to Form During Listening and Reading Comprehension. Language Learning, 68(2), 392–437. https://doi.org/10.1111/lang.12292
Gehlbach, H., & Robinson, C. D. (2018). Mitigating Illusory Results through Preregistration in Education. Journal of Research on Educational Effectiveness, 11(2), 296–315. https://doi.org/10.1080/19345747.2017.1387950
Artino, A. R., Driessen, E. W., & Maggio, L. A. (2018). Ethical Shades of Gray: Questionable Research Practices in Health Professions Education. BioRxiv, 256982. https://doi.org/10.1101/256982
Freese, J., & King, M. M. (2018). Institutionalizing Transparency. Socius: Sociological Research for a Dynamic World, 4, 237802311773921. https://doi.org/10.1177/2378023117739216
Chhin, C. S., Taylor, K. A., & Wei, W. S. (2018). Supporting a Culture of Replication: An Examination of Education and Special Education Research Grants Funded by the Institute of Education Sciences. Educational Researcher, 47(9), 594–605. https://doi.org/10.3102/0013189X18788047
Haddaway, N. R. (2018). Open Synthesis: on the need for evidence synthesis to embrace Open Science. Environmental Evidence, 7(1). https://doi.org/10.1186/s13750-018-0140-4
Mueller-Langer, F., Fecher, B., Harhoff, D., & Wagner, G. G. (2018). Replication studies in economics—How many and which papers are chosen for replication, and why? Research Policy. https://doi.org/10.1016/j.respol.2018.07.019
Kraft, M. A. (2018). Interpreting Effect Sizes of Education Interventions [working paper]. Retrieved from https://scholar.harvard.edu/mkraft/publications/interpreting-effect-sizes-education-interventions
Gage, N. A., & Stevens, R. N. (2018). Rigor, Replication, and Reproducibility: Increasing the Relevance of Behavioral Disorders Research. Education and Treatment of Children, 41(4), 567–588. https://doi.org/10.1353/etc.2018.0029