Derik K (@dozenaltech) profile picture

scientist, technologist finding the bugs in science @ https://nitter.cf/t.co/nPhUzzRgIK

SF / Cambridge MA
Joined January 2012
Photo by Derik K (@dozenaltech)Photo by Derik K (@dozenaltech)Photo by Derik K (@dozenaltech)Photo by Derik K (@dozenaltech)Photo by Derik K (@dozenaltech)Photo by Derik K (@dozenaltech)Photo by Derik K (@dozenaltech)Photo by Derik K (@dozenaltech)Photo by Derik K (@dozenaltech)Photo by Derik K (@dozenaltech)
I used Fable 5.2 to simulate the Bay Area through 250 years of history. Zoom to any city or neighborhood, select any year back to 1769, and see what it looked like. bay.theojaffee.net
30
23
5
388
30,313
Replying to @mattsclancy
I've been thinking a lot about this too @MetascienceObs. I'll probably do a more detailed writeup on your questions, but here are some thoughts: [ Context - we've developed an AI toolkit for deep forensic auditing (when you want a detailed teardown): metascienceobservatory.org/f… With a model like Sonnet 5.5 on the backend it's really good at running things like statcheck and the GRIM test in a comprehensive manner, and can also check for improper image duplication/re-use and copypaste issues in datasets. We've already been finding a lot of issues -- a small fraction have been published here metascienceobservatory.org/f… ] Here are two big challenges we're grappling with: 1. Figuring out triage/ prioritization. Running any AI system over papers creates a firehose of issues, most minor. We're finding most papers have 2-10 minor calculation issues or minor contradictions/ inaccuracies (hopefully with AI peer review coming online this will trend towards 0 in the future). Our system has a low false positive rate, but cheaper methods yield false positives as well. So, triage is really important. In our system, we have an adjudicator rank things on a "severity ladder" scale borrowed partially from the Black Spatula project (see metascienceobservatory.org/f…). The worst issues are surfaced for PubPeer posts, letters to the editor, etc. But we're still figuring out how to manage everything and balance the overall pipeline between breadth and depth. We're probably going to end up with a funnel with three or four tiers. 2. How to surface major issues to scientists and people who would care about them. I'm a big fan of PubPeer. The PubPeer plugin has 40,000 users. That's something, but it's only a fraction of working scientists. We're thinking of posting on our own platform - explore.metascienceobservato…, even though nobody uses it right now. Ideally, Pubmed and Google Scholar should start flagging papers where AI has found major issues -- at least have an overlay people can turn on if they want it. Also, funders should warn people if their grants cite work that has major issues. Similarly, journals should alert authors if their submitted paper cites work that contains major issues. On the "which organization" question - well, we're giving this a go at the Metascience Observatory, where "we" means me collaborating with @dozenaltech. But the task is so large there is room for many others as well. That's why we're open sourcing some of our tooling - so others can use it. I'd also like to get funding agencies involved in our effort, or see them stand up their own programs, although there doesn't seem to be much appetite among funding agencies for work that might expose fraud or research misconduct. Ideally, I'd like there to be a new scientific culture where it's expected that researchers will either check a centralized system for existing AI audits or use their own AI to audit every paper plan to cite. This is especially important for papers that will be included in widely-read literature reviews or meta-analyses.
1
4
102
Derik K retweeted
For the past year, I have been building Rial, a platform to certify real evidence. A world where nothing is real is a very scary world to me. We no longer trust public discourse, most institutions, and less and less do we trust what we see. When what we believe is not based on evidence, it all reduces to rhetoric, and those who get to control it have more power today than ever in human history. In 2024 I was part of an AI Safety community in Buenos Aires and was at the same time working in fraud prevention, financing a documentary I desperately wanted to shoot. It was about the effects of the installation of internet antennas in a rural community in Argentina. The study was led by anthropologists, and I was shooting with the excuse of recording visual evidence of the process. Because of my busy schedule and limited resources I knew it would be a long time before I finished editing it, and I thought, when this comes out, AI image generation models will be so accurate this could as well be generated content, and then, what was the point? I made Rial because I believe we have the right to know what is real. I don’t want to chase fake content, I want to give the power back to anyone who speaks with truth. Our V1 is thought for businesses, accessible to anyone now through our webpage or your coding terminal. You can already request images and include Rial in any flow using our mcp. Please use, criticize, give feedback. Let’s recover trust in visual truth.
Nobody can tell what’s real anymore, so we built something that can.  Today we are introducing Rial, the verification layer and infrastructure for visual evidence.  For insurers paying claims, marketplaces managing returns, newsrooms spreading the news, delivery companies, logistics, home inspections, if you make decisions based on visual evidence, this is for you. So, what can you do with Rial today?
18
11
5
118
48,050
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: darioamodei.com/post/we-must…
10,541
16,299
11,365
87,517
77,152,612
Hey babe, I have a great romantic Valentine’s Day date idea: EAG SF 2026
2
1
32
1,201
We out here at the @ProBillionaires march! Defeat the wealth tax!
787
220
1,277
3,485
3,017,418
JOEVER. (2024)
15
1,649
28
19,608
572,769
Cable's trying to end #netneutrality & break the Internet for profit. 36 hours left to stop em battleforthenet.com
21
1,592
289
New product announcement! Meet the Model B+. raspberrypi.org/introducing-…
22
412
128
Oh my god, Google's been trying to warn us all along!
14
400
102
Today is the one year anniversary of the Internet blackout that was crucial in defeating SOPA and PIPA. #InternetFreedomDay
2
156
30