25 febbraio 2019, Seminario "Mass pre-registered replication project: Insights, findings, and opportunities for researchers"
Il Dipartimento di Psicologia dei Processi di Sviluppo e Socializzazione organizza il seminario "Mass pre-registered replication project: Insights, findings, and opportunities for researchers", a cura del Prof. Gilad Feldman, Department of Psychology - University of Hong Kong.
Reproducibility and replicability are at heart of science, yet increasing evidence from recent years suggests that many of the findings in psychological science are irreproducible and non-replicable in what some termed as a “replication/reproducibility crisis” and a new “credibility revolution” calling for significant changes in the way we do science. Is there a crisis? Should this affect our research agenda? If so – how? I will begin the talk by discussing my own journey in the last 2-3 years to shift the focus of my research to judgment and decision-making (JDM) and endorse open-science practices and agenda, aiming to increase trustworthiness and reliability of my research. I will share main points from several projects on biases and heuristics, mainly pre-registered replications and extensions, and pre-registered meta-analyses. The core of the talk will be about ongoing mass replication effort at the University of Hong Kong (HKU), with ~40 concluded and ~8 ongoing pre-registered replications in guided thesis work and three undergraduate one-semester courses at HKU in the 2018 academic year, outlined in http://mgto.org/pre-registered-replications/ . Undergraduate students analyzed impactful JDM literature classics and attempted to reproduce methods and materials to conduct effect-size calculations and power analyses, design experiments, and adopt latest tools and templates in preregistering replications on the Open Science Framework (osf.io). We ran the experiments on well-powered Amazon Mechanical Turk American online samples (power = 0.95-0.99; N = 400-1050). Students wrote full submission-ready manuscripts of their findings with comprehensive supplementary materials. In the spirit of full transparency and open-science, all procedures, decisions, materials, datasets, and analyses/code are in the process of being shared on the Open Science Framework. Most importantly, I will offer open resources we developed such as course materials, collaborative guides, and tools that can be used by all in their research labs, as well as invite early career researchers to join us as lead collaborators in this project to integrate outstanding student reports to journal submissions.
Gilad Feldman, Assistant Professor, Department of Psychology, University of Hong Kong (HK)
lunedì 25 febbraio 2019, ore 11.00
Aula "Ezio Ponzo"
(3° piano, stanza 329)
Dipartimento di Psicologia dei Processi di Sviluppo e Socializzazione
Facoltà di Medicina e Psicologia
Via dei Marsi, 78 - 00185 Roma