I4R (@I4Replication) header
I4R (@I4Replication) profile picture

I4R

@I4Replication

The Institute for Replication (I4R) works to improve the credibility of science by promoting and conducting reproductions and replications.

i4replication.org/
Joined December 2021
  • Tweets2.5K
  • Following0
  • Followers7K
398Media
Photo by I4R (@I4Replication)Photo by I4R (@I4Replication)Photo by I4R (@I4Replication)Photo by I4R (@I4Replication)Photo by I4R (@I4Replication)Photo by I4R (@I4Replication)Photo by I4R (@I4Replication)Photo by I4R (@I4Replication)Photo by I4R (@I4Replication)Photo by I4R (@I4Replication)
🧵1/ Our first meta-science paper (with 350+ coauthors) is published today in Nature. It presents one of the largest-ever reproducibility projects in economics & political science. Here’s what we found 👇
Image from I4R (@I4Replication)
9
230
30
590
110,544
We are hosting 3 Replication Games in France on December 8th and 10th, 2026. Cities: Toulouse, Poitiers and Montpellier. Social science articles will be reproduced! Registration links on the posters and below.
Image from I4R (@I4Replication)
Image from I4R (@I4Replication)
Image from I4R (@I4Replication)
3
2
1
7
1,401
Toulouse Dec 8th: surveymonkey.ca/r/5BMYXMD Poitiers Dec 10th: surveymonkey.ca/r/562W5SX Montpellier Dec 10th: surveymonkey.ca/r/562XW3K
599
We are hosting Replication Games on January 21, 2027 at University of Cologne. Economic articles will be reproduced! Register here: surveymonkey.ca/r/cologne_re…
Image from I4R (@I4Replication)
5
10
1,141
Already 115 registered participants within 24 hours. 10 slots left!
Image from I4R (@I4Replication)
2
5
600
We are hosting Replication Games on Friday November 27th, 2026 at Uni Marburg. Studies on conflict, political violence, and early childhood interventions for education and health will be reproduced! Register here: surveymonkey.ca/r/5Z3L7V8
Image from I4R (@I4Replication)
1
10
688
Serious data sharing policy and looking for a data editor. That's amazing and quite impressive given the norms in this field. @JSportsSci
Image from I4R (@I4Replication)
Image from I4R (@I4Replication)
2
21
1,922
Looking for 125 researchers to participate in virtual forensic AI games! We will give you an AI report that documents irregularities in sports/exercise related articles. Also releasing our open source new I4R AI Audit Protocol. Details in this 🧵. Join us!
Image from I4R (@I4Replication)
1
8
19
1,725
Register here: docs.google.com/forms/d/e/1F… Only graduate students and researchers holding a PhD. Contributors will be eligible for coauthorship of a meta-paper. Dates: Anytime between Nov 2nd and Nov 13th. Should be one day of work, but you have total flexibility.
1
463
Two more retractions and a discussion of what we learned. 🧵 #CRAVEFiles
Image from I4R (@I4Replication)
1
6
1
27
2,680
The first retraction is the PNAS article. PNAS investigated for months and finally retracted yesterday. In the notice, they allowed authors to respond. No mention of our work.
Image from I4R (@I4Replication)
1
2
7
824
A researcher whose work we were examining asked our chair to investigate concerns about somebody else’s publications at the same university (different field). Our investigation was now generating further allegations from someone already under scrutiny. #CRAVEFiles
1
4
21
3,854
We are paraphrasing rather than publishing the email: The sender asked our chair to independently check concerns about EIGHT other publications, request data and code where needed, and contact the journals.
1
4
1,389
Episode 3 from our 1-day I4R workshop is out. Katharina Miller discusses: From Reproducibility to Responsibility: Open Science in the Age of AI Podcast: open.spotify.com/episode/6ax… Blog: i4replication.org/blog/from-…
2
2
1,255
You agree to the retraction, but "the factor structure originally reported in the article has been replicated in multiple language versions of the CRAVE using independent samples" That’s great. Can you share the data and codes for these other articles? 🧵#3 #CRAVEFiles
1
3
1
13
4,519
1st thread: nitter.cf/I4Replication/status/2… 2nd thread: nitter.cf/I4Replication/status/2…
I4R (@I4Replication) profile pictureI4R@I4ReplicationOct 13
Replying to @I4Replication
First thread: nitter.cf/I4Replication/status/2…
1
1
1,059
One of us thought it would be a good idea to check the original authors’ public git history. We found deleted data… 🧵#2 #CRAVEFiles
1
7
32
5,478
First thread: nitter.cf/I4Replication/status/2…
I4R (@I4Replication) profile pictureI4R@I4ReplicationOct 12
Our chair and a few replicators investigated a paper about elite footballers. And missed the bigger story. An independent researcher showed us what we had failed to see. This is I4R’s CRAVE–football investigation. It starts with a PNAS paper. #CRAVEFiles
Image from I4R (@I4Replication)
1
1
1
6
2,518
Our chair and a few replicators investigated a paper about elite footballers. And missed the bigger story. An independent researcher showed us what we had failed to see. This is I4R’s CRAVE–football investigation. It starts with a PNAS paper. #CRAVEFiles
Image from I4R (@I4Replication)
1
25
7
99
34,936
On May 28, 2025, an I4R replicator, Niklas Jakobsson, contacted our chair about the PNAS article. The identification of elite sports people, especially in early career stages, is of considerable commercial interest and also of interest for the players affected by this testing.
1
1
10
4,479
One paper. Then another. And another. Next week, we’ll release findings from a large-scale investigation into data irregularities across papers with overlapping authors. Duplicated observations. Unexpected patterns. Questions that kept leading to more papers. Stay tuned.
12
87
8,362
Can we trust the scientific evidence guiding policies to fight tropical diseases? The Institute for Replication is organizing Replication Games focused on tropical disease research at #TropMed26! 📅 November 18, 2026 📍 Washington, DC area + virtual participation 🧵👇
Image from I4R (@I4Replication)
1
1
3
1,158
During the Replication Games, teams of researchers will: ✅ Reproduce findings from published studies ✅ Check the robustness of key results ✅ Identify potential errors or inconsistencies ✅ Assess the reliability of evidence informing global health interventions
1
490
We had an amazing time at the University of Münster. Our replicators covered papers across psychology, public health and political science! Huge thanks to Bernd Schlipphak, Katrin Schmietendorf, Lukas Röseler and Oliver Kamps for organizing.
Image from I4R (@I4Replication)
3
966
Over the past two years, I4R partnered with Psychological Science on a large reproducibility project. 67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers. Paper: econstor.eu/bitstream/10419/… Here's what we learned 🧵
Image from I4R (@I4Replication)
1
15
4
46
8,363
Reproducibility depends heavily on where you start. From authors' final analysis data: ✅: 58.2% fully reproducible 🟡: 32.8% partially reproducible ❌: 9.0% not reproducible From raw data: ✅: 28.4% fully reproducible 🟡: 34.3% partially reproducible ❌: 37.3% not reproducible
Image from I4R (@I4Replication)
1
4
2
16
2,095
1/ Episode 2 from our 1-day I4R workshop is out. Jan Marcus, Josephina Weinerova & René Bekkers ask: How can we link publications to replications, so anyone reading a paper can instantly see whether its findings have been retested? 🧵
1
1
4
1,895
2/ Right now, a replication can exist and still be almost invisible to someone reading the original paper. That makes it harder for researchers, reviewers, students, journalists, and policymakers to know what evidence has accumulated around a finding.
1
2
518
Our comment on “Raising Health Awareness in Rural Communities” is finally published in REStat (MIT Press). But the retraction we had been told was coming never happened. Can lawyers derail a retraction? This case raises that uncomfortable question. 🧵
2
25
3
57
13,536
Back mid-2025, the editors told us the article would be retracted. We later learned that lawyers had become involved. The expected retraction never appeared. To be VERY clear: this thread is not a complaint about the REStat editors. Quite the opposite.
1
16
2,465
Some of us are having fun today in Germany at the Freiburg Replication Games! Meanwhile, others are in Montreal for a workshop on AI and open science that we’re co-organizing. A busy and entertaining weekend for I4R!
Image from I4R (@I4Replication)
Image from I4R (@I4Replication)
1
12
1,465

No more items