META-REP 2024: Programme
Venue: Katholische Akademie in Bayern, Mandlstraße 23, 80802 München (Germany). Please contact meta-rep.conference[at]psy.lmu.de in case of any questions.
The programme is still preliminary and might be changed or adjusted.
Click or tap on the respective talk to see details and abstract.
Monday, October 28
Note: Please make sure that you have registered for the workshop you want to attend.
| Konferenzraum | Viereckhof EG | Studienbibliothek | |
|---|---|---|---|
| 8:00 | Check-In | ||
| 9:00 | Workshop 1: Replication Games Abel Brodeur (University of Ottawa) | Workshop 2: Multiverse Analysis Cassie Ann Short & Daniel Kristanto (Universität Oldenburg) | Workshop 3: FAIR Data Management Jan Kustermann & Ruben Brück (ZPID Trier) |
| 17:30 | Check-In | ||
| 18:00 | Welcome Reception | ||
Tuesday, October 29
| Vortragssaal | Viereckhof EG | Viereckhof OG | |||||
|---|---|---|---|---|---|---|---|
| 8:00 | Check-In | ||||||
| 9:00 | Welcome Address Mario Gollwitzer | - - | - - | ||||
| 9:15 | Keynote How forecasts of replicability and other structured deliberation protocols can improve peer review Fiona Fidler (University of Melbourne) | - - | - - | ||||
| 10:15 | Coffee Break | ||||||
| 1.1 Replication & Reproduction Activities I | 1.2 Multiverse & Meta-Analysis | 1.3 Heterogeneity & (In-)Determinacy | |||||
| 10:45 | A principled definition of reproduction outcomes Florian Kohrt (Ludwig-Maximilians-Universität München) | CEO gender pay inequality: A multiverse analysis Martin Götz (University of Zurich) | True chance and as-if chance contribute to the unpredictability of social life Judith Glaesser (Methods Center Tübingen University) | ||||
| 11:05 | Second-order uncertainty and the epistemic functions of replication activities Felix Schönbrodt (Ludwig-Maximilians-Universität München) | Inference on multiverse meta-analysis Filippo Gambarota (University of Padova) | Heterogeneity in effect sizes: Evidence and implications Felix Holzmeister (University of Innsbruck) | ||||
| 11:25 | Replication of null results: Absence of evidence or evidence of absence? Samuel Pawel (University of Zurich) | Change of d-irection: Alternative methods for meta-analysis in psychology Irene Alfarone (Universität Innsbruck) | Cultural Variability and Replicability in Aggression Studies Yashvin Seetahul (University of Innsbruck) | ||||
| 11:45 | A systematic comparison of correspondence measures for prospective replications Dennis Kondzic (Freie Universität Berlin) | Validity Issues in Meta-analysis Ye Sun (City University of Hong Kong) | Influence of Operationalization on Heterogeneity of Effects in Teaching Quality Talha Sajjad (DIPF | Leibniz Institute for Research and Information in Education) | ||||
| 12:05 | Reproducibility is predicted by methodological complexity Daniele Fanelli (Heriot-Watt University) |
| Perceptual tasks and individual differences in dyslexia research Tatiana Logvinenko (Ludwig Maximilian University of Munich) | ||||
| 12:30 | Lunch Break | ||||||
| 2.1 Successful but Meaningless? Relevant Replication Needs Theory and Behavior (Symposium) | 2.2 Replication & Reproduction Activities II | 2.3 Methodological Decisions and Reporting | |||||
| 14:00 | Replication is Essential to Theory Testing John Protzko (Central Connecticut State University) | Who provides replicable data? Raphael H. Heiberger (University of Stuttgart) | The importance of reporting and interpreting critical effect sizes Ambra Perugini (University of Padua) | ||||
| 14:20 | Differentiate between explorative and theory-driven research. Juliane Burghardt (Karl Landsteiner University of Health Sciences) | Predicting Social Science Results Daniel Evans (University of Bonn) | A multiple testing approach for improving the replicability of reported findings Juliane Wilcke (LMU Munich) | ||||
| 14:40 | A categorization framework to evaluate theories based on entities, activities and their emergent properties Torsten Martiny-Huenger (UiT The Arctic University of Norway) | OSIRIS Project: Understanding and Advancing Reproducibility Magdalena Kozula (KU Leuven) | Researcher degrees of freedom and minP-adjustment Maximilian M. Mandl (LMU München) | ||||
| 15:00 | The importance of standardised approaches in experimental research Thomas Schultze (Queen's University Belfast) | The iRISE Theory Work Package: Methodology and First Results Rachel Heyard (Center for Reproducible Science, University of Zurich) | Science as distributed open-source knowledge development Lennart Wittkuhn (University of Hamburg) | ||||
| 15:20 | Why we study behavior—and how: On the utility of observing action J. Lukas Thürmer (U Salzburg & PU Seeburg Castle) | Dimensions of Redoing - mapping and standardizing Replication Efforts Maximilian Frank (Ludwig-Maximilians-Universität München) |
| ||||
| 15:40 | Coffee Break | ||||||
| 3.1 Multiverse analyses in research areas with an exceptionally large number of analytical choices (Symposium) | 3.2 Research Quality | 3.3 Formalisation | |||||
| 16:20 | Advancing Methodological Transparency in Neuroscience: The Comet Toolbox for Robust Dynamic Functional Connectivity and Multiverse Analysis Micha Burkhardt (Carl von Ossietzky Universität Oldenburg) | Fundamental misalignments of current research in psychology Julia Schnepf (Maastricht University) | Formalizing the Scientific Method and Scientific Practice Michael Zehetleitner (Catholic University Eichstätt-Ingolstadt) | ||||
| 16:40 | Transparent and representative pipeline sampling for large EEG multiverse analyses Cassie Ann Short (Carl von Ossietzky Universität Oldenburg) | Implementing Data Review Bernhard Clemm von Hohenberg (GESIS Leibniz Institute for the Social Sciences) | Model misspecification Manuel Rausch (Hochschule Rhein-Waal) | ||||
| 17:00 | A Reinforcement Learning Approach to Multiverse Analysis in Cognitive Network Neuroscience Daniel Kristanto (Carl von Ossietzky Universität Oldenburg) | Prevalence and actor-dependent risk factors of publication bias Désirée Nießen (GESIS – Leibniz Institute for the Social Sciences) | Bayes-optimal and Heuristic Models of Confidence Reports: A Replication Study Cem Tabakci (KU Eichstätt - Ingolstadt) | ||||
| 17:20 | Post-selection Inference in Multiverse Analysis (PIMA): an inferential framework based on the sign flipping score test Anna Vesely (University of Bologna) | Problematic student data collection behaviors Marlene S. Altenmüller (LMU Munich) | Data Simulation for Everyone: An Interactive Tool for Data Simulation using DAGs Finn Luebber (Universität zu Lübeck) | ||||
| 17:40 | Extending the evaluation of theory-based hypotheses via evidence synthesis Yasin Altinisik (Sinop University, Statistics Department) | Research Quality Evaluation (RESQUE) Framework Anne Gärtner (TU Dresden) | Visual Argument Structure Tool (VAST) Daniel Leising (TU Dresden) | ||||
| 18:00 | - - | Estimating the replicability from manuscript text Youyou Wu (University College London) | - - | ||||
| 18:20 | ECR Meeting | ||||||
Wednesday, October 30
| Vortragssaal | Viereckhof EG | Viereckhof OG | ||||||
|---|---|---|---|---|---|---|---|---|
| 4.1 Causal Interpretations of Effect Heterogeneity in Replication Research (Symposium) | 4.2 Analysis Robustness | 4.3 Replication Studies | ||||||
| 9:00 | A statistical framework for investigating the causal impact of study characteristics on replicability Steffi Pohl (Freie Universität Berlin ) | Reproducibility of AI/ML methods in computational social science M. Taimoor Khan (GESIS Leibniz institut for the social sciences) | Replicating experiments using continuous trajectory tracking in VR Omar Jubran (RPTU Kaiserslautern) | |||||
| 9:20 | Conceptual Replications to Understand Context Sensitivity Mathias Twardawski (Ludwig-Maximilians-Universität München) | How Do Modifications of Validated Scales Impact Replicability in Existing Data? Caroline Maria Böhm (University of Kaiserslautern-Landau) | Cross-scale reproducibility in the non-visual effects of light on humans Manuel Spitschan (Technical University of Munich & Max Planck Institute for Biological Cybernetics) | |||||
| 9:40 | Understanding Differences in the Evaluative Conditioning Effect across Online and Lab-Settings Anne Gast (University of Cologne) | A many-analyst study on EEG research approaches Elena Cesnaite (Münster University) | L2 Vocabulary Learning: A close replication of Teng and Zhang (2021) Özkan Kırmızı (Karabuk University ) | |||||
| 10:00 | Guidelines for Realizing Conceptual Replication Studies with Causal Interpretations Marie-Ann Sengewald (Leibniz Institute for Educational Trajectories) | Settling Settler Mortality – An Expert Survey on the Replication Debate between Acemoglu et al. (2001) and Albouy (2012) Martin Buchner (University of Duisburg-Essen & RWI ) | Empirical Audit of Construal Level Theory Smriti Mehta (University of California, Berkeley) | |||||
| 10:20 | Discussion Rickard Carlsson (Linnaeus University) | A Meta-Reanalysis of Survey Experiments on Attitudes towards Immigration Stephan Dochow-Sondershaus (Copenhagen University) | Does biased media coverage bias people's risk perception? Thorsten Pachur (Technical University of Munich) | |||||
| 10:40 | - - |
|
| |||||
| 11:00 | Coffee Break | |||||||
| 11:00 | Poster Session | |||||||
| 12:30 | Lunch Break | |||||||
| 14:00 | Keynote Which research is worth doing well? Daniel Lakens (Eindhoven University of Technology) | - - | - - | |||||
| 15:00 | Coffee Break | |||||||
| 5.1 Theory Specification | 5.2 What do we know about heterogeneity in replications? – Conceptual and methodological problems in the measurement of variation in experimental results (Symposium) | 5.3 Registered Reports & Pre-Registration | ||||||
| 15:40 | Beyond data: Theoretical aspects of comparing results across studies Herbert Bless (University of Mannheim) | Explaining effect size heterogeneity in meta-analyses: findings of large multi-lab replication studies Marcel van Assen (Tilburg University) | A Matched Pairs Comparison of Registered Reports and Traditional Paper Authors Amanda Montoya (University of California, Los Angeles) | |||||
| 16:00 | Operationalizing Theoretical Rigor Nele Freyer (TU Dresden) | How to compare the heterogeneity of effects of different sizes? – Conceptual considerations and empirical results Frank Renkewitz (Uni Erfurt) | Pre-Registration and Pre-Analysis Plans in Experimental Economics Taisuke Imai (Osaka University) | |||||
| 16:20 | Replicability and the vagueness of theoretical concepts in the social sciences Fabian Hutmacher (Julius-Maximilians-Universität Würzburg) | Refining our Expectations and Explanations of Heterogeneity with the Intercept-Slope Correlation Jens H. Fünderich (University of Erfurt) | Preregistration Deviations in Industrial and Organizational Psychology Ann-Kathrin Torka (TU Dortmund University) | |||||
| 16:40 | To be FAIR: Theory Development Needs an Update Aaron Peikert (Max Planck Institute for Human Development) | Score ReLiability? - Attempting to explain heterogeneity in effect sizes using measuring quality Lukas J. Beinhauer (University of Erfurt) | Preregistration in Psychology Olmo van den Akker (QUEST Center) | |||||
| 17:00 | Systematic Consensus-Building in Science Daniel Leising (TU Dresden) | Insights into effect size heterogeneity from an ordinal modelling perspective – results of a simulation study Maximilian Frank (Ludwig-Maximilians-Universität München) | Assessing the quality of pre-registrations in psychological research Lena Hahn (Trier University and Leibniz Institute for Psychology (ZPID)) | |||||
| 18:00 | Conference Dinner Cafe Leopold | |||||||
Thursday, October 31
| Vortragssaal | Viereckhof EG | Viereckhof OG | |
|---|---|---|---|
| 6.1 The Role of Language for Replicability in the Social and Behavioral Sciences (Symposium) | 6.2 Validity | 6.3 Meta-Science Tools and Methods | |
| 9:00 | Ensuring and Assessing the Replicability of Social Science Research Using Text as Data Johannes Breuer (GESIS - Leibniz Institute for the Social Sciences) | Lost in the Design Space? Construct Validity in the Microfinance Literature Lise Masselus (RWI Leibniz Institute for Economic Research) | Representative norms, accurate personality maps, and generalisable inferences: Ask MrP and you shall receive Taym Alsalti (Leipzig University) |
| 9:20 | Quantifying Concept Definitions in Academic Texts: Insights Into Variability in Conceptualization Xenia Schmalz (Ludwig-Maximilians-University Munich) | A slippery slope: Topographic variation as an Instrumental Variable Nils Haveresch (RWI-Leibniz Institute for Economic Research) | FEAR BASE: A Collaborative Database and Meta-Analysis online tool Maria Bruntsch (University of Bielefeld) |
| 9:40 | Is It an Issue that Constructs Are Not Measured as Defined? An Empirical Evaluation of Dyslexia Research as a Case Study Anna Yi Leung (Ludwig-Maximilians-University Munich) | Predicting the Success of Replication Based on Validity Indicators Patrick Smela (Universität zu Köln) | An experiment on consequences of pre- and postpayments for survey participation Becker Rolf (University of Bern) |
| 10:00 | On measurement non-invariance and how it affects replication Andrea Hildebrandt (Carl von Ossietzky Universität Oldenburg) | - - | Lack of Reproducibility in Social Science Models Over Decades Julian Reinhold (University of Duisburg-Essen) |
| 10:20 | Coffee Break | ||
| 7.1 Advancing the Reproducibility and Replicability of Social Science Research With Observational Data (Symposium) | 7.2 Assessing and Implementing Replication | 7.3 - | |
| 11:00 | Assessing the Potential and Actual Replicability of Computational Communication Science Philipp Knöpfle (LMU Munich) | Putting science reform into practice: what do replications do? Stephanie Meirmans (Amsterdam UMC, The Netherlands) | - - |
| 11:20 | Examining the analytical reproducibility of secondary data analyses in educational research Aleksander Kocaj (Institute for Educational Quality Improvement, Humboldt-Universität zu Berlin) | An international interdisciplinary project for learning through replication Franziska Strunz (Universität der Bundeswehr München) | - - |
| 11:40 | Replicability and Robustness in Development Economics Florian Neubauer (RWI - Institute for Economic Research) | Automatisation of large-scale data extraction to estimate replicability Julian Quandt (Wu Vienna University of Business and Economics) | - - |
| 12:00 | Reproduce Me If You Can: A Reproducibility Assessment of Observational Social Science Studies Using ESS Data Laura Schächtele (LMU Munich) | - - | - - |
| 12:30 | Farewell Session Mario Gollwitzer | - - | - - |
×
load abstract ...