Social Science Examples

Gennetian, L. A., Tamis-LeMonda, C. S., & Frank, M. C. (2019). Advancing Transparency and Openness in Child Development Research: Opportunities (preprint). PsyArXiv. https://doi.org/10.31234/osf.io/wbv2d
Roettger, T. B. (2019). Preregistration in linguistic research: Applications, challenges, and limitations (preprint). PsyArXiv. https://doi.org/10.31234/osf.io/vc9hu
Kedron, P., Frazier, A. E., Trgovac, A. B., Nelson, T., & Fotheringham, A. S. (2019). Reproducibility and Replicability in Geographical Analysis. Geographical Analysis, gean.12221. https://doi.org/10.1111/gean.12221
Ziółkowski, A. (2019). The Stability of Philosophical Intuitions: Failed Replications of Swain et al. (2008). Episteme, 1–19. https://doi.org/10.1017/epi.2019.20
Crüwell, S., Stefan, A. M., & Evans, N. J. (2019). Robust Standards in Cognitive Science. Computational Brain & Behavior. https://doi.org/10.1007/s42113-019-00049-8
Grahe, J. E., Cuccolo, K., Leighton, D. C., & Cramblet Alvarez, L. D. (2019). Open Science Promotes Diverse, Just, and Sustainable Research and Educational Outcomes. Psychology Learning & Teaching, 147572571986916. https://doi.org/10.1177/1475725719869164
Hao, Q., Smith IV, D. H., Iriumi, N., Tsikerdekis, M., & Ko, A. J. (2019). A Systematic Investigation of Replications in Computing Education Research. ACM Transactions on Computing Education, 19(4), 1–18. https://doi.org/10.1145/3345328
Stojmenovska, D., Bol, T., & Leopold, T. (2019). Teaching Replication to Graduate Students. Teaching Sociology, 0092055X1986799. https://doi.org/10.1177/0092055X19867996
Isaacowitz, D. M., & Lind, M. (2019). Open Science is for Aging Research, Too. Innovation in Aging, 3(4), igz028. https://doi.org/10.1093/geroni/igz028
Rios, J. A., Ihlenfeldt, S. D., Dosedel, M., & Riegelman, A. (2019). A Topical and Methodological Systematic Review of Meta‐Analyses Published in the Educational Measurement Literature. Educational Measurement: Issues and Practice, emip.12282. https://doi.org/10.1111/emip.12282
Bishop, D. V. M. (2019). The psychology of experimental psychologists: Overcoming cognitive constraints to improve research (preprint). PsyArXiv. https://doi.org/10.31234/osf.io/hnbex
Chin, J. M., Ribeiro, G., & Rairden, A. (2019). Open forensic science. Journal of Law and the Biosciences, lsz009. https://doi.org/10.1093/jlb/lsz009
Sarafoglou, A., Hoogeveen, S., Matzke, D., & Wagenmakers, E.-J. (2019). Teaching Good Research Practices: Protocol of a Research Master Course. Psychology Learning & Teaching, 147572571985880. https://doi.org/10.1177/1475725719858807
Davis-Kean, P., & Ellis, A. (2019). An Overview of Issues in Infant and Developmental Research for the creation of Robust and Replicable Science (preprint). PsyArXiv. https://doi.org/10.31234/osf.io/m4576
Button, K. S., Chambers, C. D., Lawrence, N., & Munafò, M. R. (2019). Grassroots Training for Reproducible Science: A Consortium-Based Approach to the Empirical Dissertation. Psychology Learning & Teaching, 147572571985765. https://doi.org/10.1177/1475725719857659
Weston, S. J., Ritchie, S. J., Rohrer, J. M., & Przybylski, A. K. (2019). Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets. Advances in Methods and Practices in Psychological Science, 251524591984868. https://doi.org/10.1177/2515245919848684
Weston, S. J., Ritchie, S. J., Rohrer, J. M., & Przybylski, A. K. (2019). Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets. Advances in Methods and Practices in Psychological Science, 251524591984868. https://doi.org/10.1177/2515245919848684
Epskamp, S. (2019). Reproducibility and Replicability in a Fast-Paced Methodological World. Advances in Methods and Practices in Psychological Science, 251524591984742. https://doi.org/10.1177/2515245919847421
Ozier, O. (2019). Replication Redux : The Reproducibility Crisis and the Case of Deworming (No. WPS8835) (pp. 1–43). The World Bank. Retrieved from http://documents.worldbank.org/curated/en/118271556632669793/Replication-Redux-The-Reproducibility-Crisis-and-the-Case-of-Deworming
Hardwicke, T. E., Wallach, J., Kidwell, M., & Ioannidis, john. (2019). An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014-2017) (preprint). MetaArXiv. https://doi.org/10.31222/osf.io/6uhg5
Schnack, H. (2019). Assessing reproducibility in association studies. ELife, 8, e46757. https://doi.org/10.7554/eLife.46757
Penders, B., Holbrook, J. B., & de Rijcke, S. (2019). Rinse and repeat: the situated value of replication across epistemic cultures (preprint). SocArXiv. https://doi.org/10.31235/osf.io/nfjb6
L. Haven, T., & Van Grootel, D. L. (2019). Preregistering qualitative research. Accountability in Research, 1–16. https://doi.org/10.1080/08989621.2019.1580147
Frank, M. C. (2019). Towards a more robust and replicable science of infant development. Infant Behavior and Development, 57, 101349. https://doi.org/10.1016/j.infbeh.2019.101349
Nosek, B. A., Beck, E. D., Campbell, L., Flake, J. K., Hardwicke, T. E., Mellor, D. T., … Vazire, S. (2019). Preregistration Is Hard, And Worthwhile. Trends in Cognitive Sciences, 23(10), 815–818. https://doi.org/10.1016/j.tics.2019.07.009
Eren, M. I., Bebber, M. R., Norris, J. D., Perrone, A., Rutkoski, A., Wilson, M., & Raghanti, M. A. (2019). Experimental replication shows knives manufactured from frozen human feces do not work. Journal of Archaeological Science: Reports, 27, 102002. https://doi.org/10.1016/j.jasrep.2019.102002
Chambers, C. (2019). What’s next for Registered Reports? Nature, 573(7773), 187–189. https://doi.org/10.1038/d41586-019-02674-6
Nosek, B. A., Beck, E. D., Campbell, L., Flake, J. K., Hardwicke, T. E., Mellor, D. T., … Vazire, S. (2019). Preregistration Is Hard, And Worthwhile. Trends in Cognitive Sciences, S1364661319301846. https://doi.org/10.1016/j.tics.2019.07.009
Uhlmann, E. L., Ebersole, C. R., Chartier, C. R., Errington, T. M., Kidwell, M. C., Lai, C. K., … Nosek, B. A. (2019). Scientific Utopia III: Crowdsourcing Science. Perspectives on Psychological Science, 174569161985056. https://doi.org/10.1177/1745691619850561
Wuttke, A. (2019). Why Too Many Political Science Findings Cannot Be Trusted and What We Can Do About It: A Review of Meta-Scientific Research and a Call for Academic Reform. Politische Vierteljahresschrift, 60(1), 1–19. https://doi.org/10.1007/s11615-018-0131-7
Strømland, E. (2019). Preregistration and reproducibility. Journal of Economic Psychology. https://doi.org/10.1016/j.joep.2019.01.006
Anderson, D., Spybrook, J., & Maynard, R. (2019). REES: A Registry of Efficacy and Effectiveness Studies in Education. Educational Researcher, 48(1), 45–50. https://doi.org/10.3102/0013189X18810513
Stricker, J., & Günther, A. (2019). Scientific Misconduct in Psychology: A Systematic Review of Prevalence Estimates and New Empirical Data. Zeitschrift Für Psychologie, 227(1), 53–63. https://doi.org/10.1027/2151-2604/a000356
Camerer, C. F. (2019). Replication and other practices for improving scientific quality in experimental economics. In A. Schram & A. Ule, Handbook of Research Methods and Applications in Experimental Economics (pp. 83–102). Edward Elgar Publishing. https://doi.org/10.4337/9781788110563.00012
Christensen, G., & Miguel, E. (2018). Transparency, Reproducibility, and the Credibility of Economics Research. Journal of Economic Literature, 56(3), 920–980. https://doi.org/10.1257/jel.20171350
McBee, M. T., Makel, M. C., Peters, S. J., & Matthews, M. S. (2018). A Call for Open Science in Giftedness Research. Gifted Child Quarterly, 001698621878417. https://doi.org/10.1177/0016986218784178
Morgan-Short, K., Marsden, E., Heil, J., Issa II, B. I., Leow, R. P., Mikhaylova, A., … Szudarski, P. (2018). Multisite Replication in Second Language Acquisition Research: Attention to Form During Listening and Reading Comprehension. Language Learning, 68(2), 392–437. https://doi.org/10.1111/lang.12292
Gehlbach, H., & Robinson, C. D. (2018). Mitigating Illusory Results through Preregistration in Education. Journal of Research on Educational Effectiveness, 11(2), 296–315. https://doi.org/10.1080/19345747.2017.1387950
Artino, A. R., Driessen, E. W., & Maggio, L. A. (2018). Ethical Shades of Gray: Questionable Research Practices in Health Professions Education. BioRxiv, 256982. https://doi.org/10.1101/256982
Freese, J., & King, M. M. (2018). Institutionalizing Transparency. Socius: Sociological Research for a Dynamic World, 4, 237802311773921. https://doi.org/10.1177/2378023117739216
Chhin, C. S., Taylor, K. A., & Wei, W. S. (2018). Supporting a Culture of Replication: An Examination of Education and Special Education Research Grants Funded by the Institute of Education Sciences. Educational Researcher, 47(9), 594–605. https://doi.org/10.3102/0013189X18788047
Haddaway, N. R. (2018). Open Synthesis: on the need for evidence synthesis to embrace Open Science. Environmental Evidence, 7(1). https://doi.org/10.1186/s13750-018-0140-4
Mueller-Langer, F., Fecher, B., Harhoff, D., & Wagner, G. G. (2018). Replication studies in economics—How many and which papers are chosen for replication, and why? Research Policy. https://doi.org/10.1016/j.respol.2018.07.019
Kraft, M. A. (2018). Interpreting Effect Sizes of Education Interventions [working paper]. Retrieved from https://scholar.harvard.edu/mkraft/publications/interpreting-effect-sizes-education-interventions
Gage, N. A., & Stevens, R. N. (2018). Rigor, Replication, and Reproducibility: Increasing the Relevance of Behavioral Disorders Research. Education and Treatment of Children, 41(4), 567–588. https://doi.org/10.1353/etc.2018.0029
Krishna, A., & Peter, S. M. (2018). Questionable research practices in student final theses – Prevalence, attitudes, and the role of the supervisor’ s perceived attitudes. PLOS, 1–24. https://doi.org/10.17605/OSF.IO/RZTVM
Walker, R. M., Brewer, G. A., Lee, M. J., Petrovsky, N., & van Witteloostuijn, A. (2018). Best Practice Recommendations for Replicating Experiments in Public Administration. Journal of Public Administration Research and Theory. https://doi.org/10.1093/jopart/muy047
Cook, B. G., Lloyd, J. W., Mellor, D., Nosek, B. A., & Therrien, W. J. (2018). Promoting Open Science to Increase the Trustworthiness of Evidence in Special Education. Exceptional Children, 001440291879313. https://doi.org/10.1177/0014402918793138
Washburn, A. N., Hanson, B. E., Motyl, M., Skitka, L. J., Yantis, C., Wong, K. M., … Carsel, T. S. (2018). Why Do Some Psychology Researchers Resist Adopting Proposed Reforms to Research Practices? A Description of Researchers’ Rationales. Advances in Methods and Practices in Psychological Science, 251524591875742. https://doi.org/10.1177/2515245918757427
Bird, A. (2018). Understanding the replication crisis as a base rate fallacy. The British Journal for the Philosophy of Science, 0(0), xx–xx. https://doi.org/10.1093/bjps/axy051