Replication Research Symposium

The reproducibility crisis has shifted research focus toward improving the methodological integrity of animal experiments. Contributing factors to replication failure are being addressed, prompting the reassessment of fundamental methodological principles. For instance, rigorous standardization may restrict inference space and compromise external validity. To counter this, heterogenization...

Single case research designs are widely used in special education and related fields to evaluate interventions. The most commonly used approach to analyze these graphs is visual analysis. Despite existing challenges such as low interrater reliability, systematic bias, or a lack of training for raters, this method is most frequently applied due to its perceived simplicity and quick...

When analyzing electroencephalographic (EEG) data, researchers face a maze of potential methods and analytical approaches. But how much do these choices actually influence the results? The EEGManyPipelines (EMP) project addressed this question through a large-scale collaborative effort to test the robustness of EEG findings across different analysis strategies. In this unprecedented study, a...

Most experimental studies in social psychology rely on dichotomous factor-level designs, testing only the direction of effects rather than their functional form. As a result, replication efforts often reproduce these limited designs, reinforcing a narrow approach to theory testing. We argue that replication efforts should move beyond dichotomous designs to systematically map the shape of...

In a multi-lab replication study, my colleagues and me (Brohmer et al., 2024, https://doi.org/10.5334/irsp.522) recently replicated a classic effect of gender-fair language (Stahlberg et al., 2001, https://doi.org/10.1026//0033-3042.52.3.131): Participants, who were prompted to name celebrities via gender-fair language (e.g., "Bitte nennen Sie drei Politiker*innen"; English: "Please name three...

In many disciplines, multiverse analysis gains popularity as an important tool to strengthen the openness and transparency of research. Yet, multiverse analysis does not seem to be a common method in applied psychology, if it is known at all. Our key goal is to introduce the topic of multiverse analysis to applied psychology and to provide detailed guidance on how to run a multiverse analysis....

Infant research is particularly prone to problems of generalizability, and replications have not been part of standard practice. The Manybabies consortium has been established to run high-powered multi-lab studies, thereby increasing the robustness of infant research findings. The Manybabies model proposes a radically collaborative, large-scale and open approach to research grounded in...

Reproducibility is a core element of the scientific method. In the Geosciences, knowledge derived from geodata is frequently communicated through maps, and the computational methods used to produce these maps vary in their ease of reproduction. We present the results of a study in which we attempted to reproduce the maps included in geoscientific publications. We collected 27 candidate papers,...

Relational mobility, a socioecological variable, reflects the degree to which individuals in a society have opportunities to form new relationships and leave old ones. Previous research suggests that higher levels of relational mobility are associated with greater self-disclosure as an adaptive strategy to maintain valuable social ties. However, the advent of COVID-19 pandemic has...

Title: Replication of the Chameleon Effect (Chartrand & Bargh, 1999, Study 1)

In 1999, Chartrand and Bargh first demonstrated that humans have a natural tendency to mimic one another. The Chameleon Effect, named after this phenomenon, refers to “nonconscious mimicry of the postures, mannerisms, facial expressions, and other behaviors of one’s interaction partners, such that one’s behavior...

Unsuccessful replications often lead to fierce debates between replicators and original authors. This paper investigates whether arguably impartial experts reach consensus on a famous yet unsettled replication debate about the seminal paper by Acemoglu, Johnson, and Robinson (2001) and the replication by Albouy (2012). We successfully recruited experts from the pool of scholars citing one of...