META-REP 2024: Programme
Venue: Katholische Akademie in Bayern, Mandlstraße 23, 80802 München (Germany). Please contact meta-rep.conference[at]psy.lmu.de in case of any questions.
Click or tap on the respective talk to see details and abstract.
Catering will be provided at the conference venue during coffee and lunch breaks.
Monday, October 28
Note: Please make sure you are registered before attending a workshop.
| Konferenzraum (+ Viereckhof EG) | Viereckhof OG | Viereckhof Heuboden | |
|---|---|---|---|
| 8:00 | Check-In | ||
| 9:00 | Workshop 1: Replication Games Abel Brodeur (University of Ottawa) | Workshop 2: Multiverse Analysis Cassie Ann Short & Daniel Kristanto (Universität Oldenburg) | Workshop 3: FAIR Data Management Jan Kustermann & Ruben Brück (ZPID Trier) |
| 17:30 | Check-In | ||
| 18:00 - 21:00 | Welcome Reception | ||
Breaks on Monday: 8.00 welcome coffee, 12:30 - 13:30 lunch, 15:00 coffee break, 18:00 welcome reception
Tuesday, October 29
| Vortragssaal | Konferenzraum | Viereckhof EG | |||||
|---|---|---|---|---|---|---|---|
| 8:00 | Check-In | ||||||
| 9:00 | Welcome Address Mario Gollwitzer | - - | - - | ||||
| 9:15 | Keynote How forecasts of replicability and other structured deliberation protocols can improve peer review Fiona Fidler (University of Melbourne) | - - | - - | ||||
| 10:15 | Coffee Break | ||||||
| 1.1 Replication & Reproduction Activities I | 1.2 Multiverse & Meta-Analysis | 1.3 Heterogeneity & (In-)Determinacy | |||||
| 10:45 | A principled definition of reproduction outcomes Florian Kohrt (Ludwig-Maximilians-Universität München) | CEO gender pay inequality: A multiverse analysis Martin Götz (University of Zurich) | True chance and as-if chance contribute to the unpredictability of social life Judith Glaesser (Methods Center Tübingen University) | ||||
| 11:05 | Second-order uncertainty and the epistemic functions of replication activities Felix Schönbrodt (Ludwig-Maximilians-Universität München) | Inference on multiverse meta-analysis Filippo Gambarota (University of Padova) | Heterogeneity in effect sizes: Evidence and implications Felix Holzmeister (University of Innsbruck) | ||||
| 11:25 | Replication of null results: Absence of evidence or evidence of absence? Samuel Pawel (University of Zurich) | Change of d-irection: Alternative methods for meta-analysis in psychology Irene Alfarone (Universität Innsbruck) | Cultural Variability and Replicability in Aggression Studies Yashvin Seetahul (University of Innsbruck) | ||||
| 11:45 | A systematic comparison of correspondence measures for prospective replications Dennis Kondzic (Freie Universität Berlin) |
| Influence of Operationalization on Heterogeneity of Effects in Teaching Quality Talha Sajjad (DIPF | Leibniz Institute for Research and Information in Education) | ||||
| 12:05 | Reproducibility is predicted by methodological complexity Daniele Fanelli (Heriot-Watt University) | - - | Perceptual tasks and individual differences in dyslexia research Tatiana Logvinenko (Ludwig Maximilian University of Munich) | ||||
| 12:30 | Lunch Break | ||||||
| 2.1 Successful but Meaningless? Relevant Replication Needs Theory and Behavior (Symposium) | 2.2 Replication & Reproduction Activities II | 2.3 Methodological Decisions and Reporting | |||||
| 14:00 | Replication is Essential to Theory Testing John Protzko (Central Connecticut State University) | [cancelled] | The importance of reporting and interpreting critical effect sizes Ambra Perugini (University of Padua) | ||||
| 14:20 | Differentiate between explorative and theory-driven research. Juliane Burghardt (Karl Landsteiner University of Health Sciences) | Predicting Social Science Results Daniel Evans (University of Bonn) | A multiple testing approach for improving the replicability of reported findings Juliane Wilcke (LMU Munich) | ||||
| 14:40 | A categorization framework to evaluate theories based on entities, activities and their emergent properties Torsten Martiny-Huenger (UiT The Arctic University of Norway) | OSIRIS Project: Understanding and Advancing Reproducibility Magdalena Kozula (KU Leuven) | Researcher degrees of freedom and minP-adjustment Maximilian M. Mandl (LMU München) | ||||
| 15:00 | The importance of standardised approaches in experimental research Thomas Schultze (Queen's University Belfast) | The iRISE Theory Work Package: Methodology and First Results Rachel Heyard (Center for Reproducible Science, University of Zurich) | Science as distributed open-source knowledge development Lennart Wittkuhn (University of Hamburg) | ||||
| 15:20 | Why we study behavior—and how: On the utility of observing action J. Lukas Thürmer (U Salzburg & PU Seeburg Castle) | Dimensions of Redoing - mapping and standardizing Replication Efforts Maximilian Frank (Ludwig-Maximilians-Universität München) |
| ||||
| 15:40 | Coffee Break | ||||||
| 3.1 Multiverse analyses in research areas with an exceptionally large number of analytical choices (Symposium) | 3.2 Research Quality | 3.3 Formalisation | |||||
| 16:20 | Advancing Methodological Transparency in Neuroscience: The Comet Toolbox for Robust Dynamic Functional Connectivity and Multiverse Analysis Micha Burkhardt (Carl von Ossietzky Universität Oldenburg) | Fundamental misalignments of current research in psychology Julia Schnepf (Maastricht University) | [cancelled] | ||||
| 16:40 | Transparent and representative pipeline sampling for large EEG multiverse analyses Cassie Ann Short (Carl von Ossietzky Universität Oldenburg) | [cancelled] | Model misspecification Manuel Rausch (Hochschule Rhein-Waal) | ||||
| 17:00 | A Reinforcement Learning Approach to Multiverse Analysis in Cognitive Network Neuroscience Daniel Kristanto (Carl von Ossietzky Universität Oldenburg) | Problematic student data collection behaviors Marlene S. Altenmüller (LMU Munich) | Bayes-optimal and Heuristic Models of Confidence Reports: A Replication Study Cem Tabakci (KU Eichstätt - Ingolstadt) | ||||
| 17:20 | Post-selection Inference in Multiverse Analysis (PIMA): an inferential framework based on the sign flipping score test Anna Vesely (University of Bologna) | Research Quality Evaluation (RESQUE) Framework Anne Gärtner (TU Dresden) | Data Simulation for Everyone: An Interactive Tool for Data Simulation using DAGs Finn Luebber (Universität zu Lübeck) | ||||
| 17:40 | Extending the evaluation of theory-based hypotheses via evidence synthesis Yasin Altinisik (Sinop University, Statistics Department) | - - | Visual Argument Structure Tool (VAST) Daniel Leising (TU Dresden) | ||||
| 18:30 | ECR Meeting Informal meeting of conference participants at an early career stage | ||||||
Wednesday, October 30
| Vortragssaal | Konferenzraum | Viereckhof EG | ||||||
|---|---|---|---|---|---|---|---|---|
| 4.1 Causal Interpretations of Effect Heterogeneity in Replication Research (Symposium) | 4.2 Analysis Robustness | 4.3 Replication Studies | ||||||
| 9:00 | A statistical framework for investigating the causal impact of study characteristics on replicability Steffi Pohl (Freie Universität Berlin ) | Reproducibility of AI/ML methods in computational social science M. Taimoor Khan (GESIS Leibniz institut for the social sciences) | Replicating experiments using continuous trajectory tracking in VR Omar Jubran (RPTU Kaiserslautern) | |||||
| 9:20 | Conceptual Replications to Understand Context Sensitivity Mathias Twardawski (Ludwig-Maximilians-Universität München) | How Do Modifications of Validated Scales Impact Replicability in Existing Data? Caroline Maria Böhm (University of Kaiserslautern-Landau) | [cancelled] | |||||
| 9:40 | Understanding Differences in the Evaluative Conditioning Effect across Online and Lab-Settings Anne Gast (University of Cologne) | A many-analyst study on EEG research approaches Elena Cesnaite (Münster University) | L2 Vocabulary Learning: A close replication of Teng and Zhang (2021) Özkan Kırmızı (Karabuk University ) | |||||
| 10:00 | Guidelines for Realizing Conceptual Replication Studies with Causal Interpretations Marie-Ann Sengewald (Leibniz Institute for Educational Trajectories) | Settling Settler Mortality – An Expert Survey on the Replication Debate between Acemoglu et al. (2001) and Albouy (2012) Martin Buchner (University of Duisburg-Essen & RWI ) | Does biased media coverage bias people's risk perception? Thorsten Pachur (Technical University of Munich) | |||||
| 10:20 | Discussion Rickard Carlsson (Linnaeus University) |
|
| |||||
| 10:40 | Coffee Break | |||||||
| 11:00 | Poster Session | |||||||
| 12:30 | Lunch Break | |||||||
| 14:00 | Keynote Which research is worth doing well? Daniel Lakens (Eindhoven University of Technology) | - - | - - | |||||
| 15:00 | Coffee Break | |||||||
| 5.1 Theory Specification | 5.2 What do we know about heterogeneity in replications? – Conceptual and methodological problems in the measurement of variation in experimental results (Symposium) | 5.3 Registered Reports & Pre-Registration | ||||||
| 15:40 | Beyond data: Theoretical aspects of comparing results across studies Herbert Bless (University of Mannheim) | Explaining effect size heterogeneity in meta-analyses: findings of large multi-lab replication studies Marcel van Assen (Tilburg University) | Pre-Registration and Pre-Analysis Plans in Experimental Economics Taisuke Imai (Osaka University) | |||||
| 16:00 | Operationalizing Theoretical Rigor Nele Freyer (TU Dresden) | How to compare the heterogeneity of effects of different sizes? – Conceptual considerations and empirical results Frank Renkewitz (Uni Erfurt) | Preregistration Deviations in Industrial and Organizational Psychology Ann-Kathrin Torka (TU Dortmund University) | |||||
| 16:20 | Replicability and the vagueness of theoretical concepts in the social sciences Fabian Hutmacher (Julius-Maximilians-Universität Würzburg) | Refining our Expectations and Explanations of Heterogeneity with the Intercept-Slope Correlation Jens H. Fünderich (University of Erfurt) | Preregistration in Psychology Olmo van den Akker (QUEST Center) | |||||
| 16:40 | To be FAIR: Theory Development Needs an Update Aaron Peikert (Max Planck Institute for Human Development) | Score ReLiability? - Attempting to explain heterogeneity in effect sizes using measuring quality Lukas J. Beinhauer (University of Erfurt) | Assessing the quality of pre-registrations in psychological research Lena Hahn (Trier University and Leibniz Institute for Psychology (ZPID)) | |||||
| 17:00 | Systematic Consensus-Building in Science Daniel Leising (TU Dresden) | Insights into effect size heterogeneity from an ordinal modelling perspective – results of a simulation study Maximilian Frank (Ludwig-Maximilians-Universität München) | - - | |||||
| 18:30 | Conference Dinner Cafe Ludwig im Petuelpark | |||||||
Thursday, October 31
| Vortragssaal | Konferenzraum | Viereckhof EG | |
|---|---|---|---|
| 6.1 The Role of Language for Replicability in the Social and Behavioral Sciences (Symposium) | 6.2 Validity | 6.3 Meta-Science Tools and Methods | |
| 9:00 | Ensuring and Assessing the Replicability of Social Science Research Using Text as Data Johannes Breuer (GESIS - Leibniz Institute for the Social Sciences) | [cancelled] | Representative norms, accurate personality maps, and generalisable inferences: Ask MrP and you shall receive Taym Alsalti (Leipzig University) |
| 9:20 | Quantifying Concept Definitions in Academic Texts: Insights Into Variability in Conceptualization Xenia Schmalz (Ludwig-Maximilians-University Munich) | A slippery slope: Topographic variation as an Instrumental Variable Nils Haveresch (RWI-Leibniz Institute for Economic Research) | FEAR BASE: A Collaborative Database and Meta-Analysis online tool Maria Bruntsch (University of Bielefeld) |
| 9:40 | Is It an Issue that Constructs Are Not Measured as Defined? An Empirical Evaluation of Dyslexia Research as a Case Study Anna Yi Leung (Ludwig-Maximilians-University Munich) | Predicting the Success of Replication Based on Validity Indicators Patrick Smela (Universität zu Köln) | [cancelled] |
| 10:00 | On measurement non-invariance and how it affects replication Andrea Hildebrandt (Carl von Ossietzky Universität Oldenburg) | - - | Lack of Reproducibility in Social Science Models Over Decades Julian Reinhold (University of Duisburg-Essen) |
| 10:20 | Coffee Break | ||
| 7.1 Advancing the Reproducibility and Replicability of Social Science Research With Observational Data (Symposium) | 7.2 Assessing and Implementing Replication | 7.3 - | |
| 11:00 | Assessing the Potential and Actual Replicability of Computational Communication Science Philipp Knöpfle (LMU Munich) | Putting science reform into practice: what do replications do? Stephanie Meirmans (Amsterdam UMC, The Netherlands) | - - |
| 11:20 | Examining the analytical reproducibility of secondary data analyses in educational research Aleksander Kocaj (Institute for Educational Quality Improvement, Humboldt-Universität zu Berlin) | An international interdisciplinary project for learning through replication Franziska Strunz (Universität der Bundeswehr München) | - - |
| 11:40 | Replicability and Robustness in Development Economics Florian Neubauer (RWI - Institute for Economic Research) | Automatisation of large-scale data extraction to estimate replicability Julian Quandt (Wu Vienna University of Business and Economics) | - - |
| 12:00 | Reproduce Me If You Can: A Reproducibility Assessment of Observational Social Science Studies Using ESS Data Laura Schächtele (LMU Munich) | - - | - - |
| 12:30 | Farewell Session Mario Gollwitzer | - - | - - |
| 13:00 - 14:00 | Lunch Break | ||
×
load abstract ...