Christopher Settles (@never_settles_) header
Christopher Settles (@never_settles_) profile picture

@refresh_dev (YC P25), building RL training gyms for computer use | believer in communities

San Francisco
Joined February 2022
Photo by Christopher Settles (@never_settles_)Photo by Christopher Settles (@never_settles_)Photo by Christopher Settles (@never_settles_)Photo by Christopher Settles (@never_settles_)Photo by Christopher Settles (@never_settles_)Photo by Christopher Settles (@never_settles_)Photo by Christopher Settles (@never_settles_)Photo by Christopher Settles (@never_settles_)Photo by Christopher Settles (@never_settles_)Photo by Christopher Settles (@never_settles_)
Christopher Settles retweeted
Think 16 types cover it all? You might be far more complex.

315
93
5,593
20,179,083
Christopher Settles retweeted
Can today’s LLMs generate rubrics that reliably evaluate tomorrow’s smarter models? Automated rubric generation can save enormous expert effort, but prior work didn’t evaluate responses from LLMs released after the rubric-generator model. Our new paper investigates how to best scale test-time compute for this, developing a new rubric generation pipeline called Rubricon. Rather than just relying on LLM self-critique, Rubricon grounds rubric-refinement in how candidate rubrics actually score example responses. Compared to 4 other synthetic rubric generation methods across 5 diverse benchmarks, Rubricon rubrics consistently score model responses more like human experts do [1/n]
7
5
2
63
4,562
Christopher Settles retweeted
I went through every data vendor that launched in the last 3 weeks. Almost all of them are lying about their revenue, their lab partnerships, and their backgrounds. (skip to 1:04 if you want to skip context) Too many founders and VCs have been fooled by these people. Stop believing everything you hear. Data is much harder than most people think.
my unfiltered thoughts on the data industry right now: there are too many brokers in the data space. in the last 4 months this industry has become the new equivalent to dropshipping. i have no issue with that. but if your entire moat is spam calling smb owners all day and begging them to license their data for a micro1 referral fee, you are not going to make it, and you are not the next mercor. most of you are not building anything at all. to everyone reading this, and the hundreds of other posts on your timeline from 18 year old sf kids claiming $200m run rates please ignore them. these are the modern day elizabeth holmes’. they're taking one day of contracted (not paid) revenue and multiplying it by 365. the worst i've seen is someone who made $100k off a micro1 referral fee in 6 hours and claimed they're at a $73m run rate (12 (daily working hours) / 6 x $100k x 365). this is literal fraud, especially if you raise money off of this claim. you see this in a lot of yc companies in recent batches. the only businesses i see surviving this are the giants that already exist (mercor, micro1, surge ai, turing) and the non consensus bets: consumer data collection apps like kled, robotics data collection companies like build ai and meckaai, etc. tldr: don’t believe everything you read, and just brokering company data is not a venture scale business and should not be claimed as such.
150
67
39
1,588
335,103
Christopher Settles retweeted
I’m dead 😂
17
6
94
3,347
Christopher Settles retweeted
We are releasing Ultramarine 1 Flash, a frontier-class model built for knowledge work. It is open-source and achieves similar performance to Fable 5, while being 60x cheaper. It was post-trained by a team of 5 for ~$300k all-in. Available on API now, with weights releasing in 2 weeks.
602
693
380
8,106
1,757,386
Christopher Settles retweeted
Huge day for us today: @resend is now billing through Autumn This is a full circle moment. @johnyeo_ using the Resend API is actually what inspired us to build a devtool in the first place. They set the standard for product quality and user experience. They moved to @autumnpricing because they needed a single, reliable engine to monetize all the new products they ship, and their growing enterprise motion meant a lot more custom contracts to manage. Resend is the most downloaded email API in the world and growing like crazy. We’re super proud they chose us to meter, enforce and bill their highest-volume workloads.
55
14
4
255
16,492
Christopher Settles retweeted
Today we're launching WebCloneBench: a benchmark which measures a model's ability to explore, copy, build and test various web apps. For each task, we give the model a reference site from one of Gmail, Google Sheets, Jira, DocuSign, Shopify Admin, Craigslist, Figma, Slack and Zendesk. It is instructed to build a fully feature-complete clone of every part of the application with an 8 hour time limit.
11
18
5
90
11,968
Christopher Settles retweeted
Too many people claim that coding LLMs can handle 3D, but how exactly? We need more benchmarks on this.
Introducing Blender Bench v1 (BBv1): a benchmark for frontier LLMs on 20 realistic 3D production workflows including animation, modeling, rigging, cloth & surfacing. GPT-6 Astra leads overall; Claude Opus 5.5 wins modeling & cloth simulation.
3
27
3,994
Christopher Settles retweeted
New continual benchmark just dropped! Excited to chug away at this, the models are good in some aspects but we are still far away from models making high fidelity 3d movies.
Introducing Blender Bench v1 (BBv1): a benchmark for frontier LLMs on 20 realistic 3D production workflows including animation, modeling, rigging, cloth & surfacing. GPT-6 Astra leads overall; Claude Opus 5.5 wins modeling & cloth simulation.
8
2
36
812
Christopher Settles retweeted
a YC partner who closed millions in founder-led sales just laid out her 8 rules for cold email
71
84
8
1,341
118,365
Christopher Settles retweeted
Replying to @csparks1919
Here's the thing nobody tells you about AirPods — timing is everything. 💡 Overcook them and they're ruined. Nail it and they're genuinely the best thing you'll eat all week. The right AirPod, cooked the right way, is pure magic. 🎧
1
5
117
Christopher Settles retweeted
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics. The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra. The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
5,639
19,977
14,813
119,710
75,449,101
Christopher Settles retweeted
asked gpt6 to draw michael jackson in google calendar
122
308
96
6,172
1,105,207
Christopher Settles retweeted
Introducing Omnara: the open-source alternative to Claude Managed Agents. Omnara is an API for creating and interacting with production-grade agents. You build the agent. Omnara handles hosting, durable state, sandboxes, permissions, secrets, and the rest of the production infrastructure. Available now @omnara
72
43
9
380
94,687
Christopher Settles retweeted
Meta MSL superstar “The word general in artificial general intelligence is loosely defined. Much of the flexibility we observe in current LLMs may be interpolation across the extraordinary breadth of internet data rather than pure extrapolation beyond it.”
This quoted post is unavailable.
2
6
71
10,672
Christopher Settles retweeted
Hello again, world! Hacker News has been pretty quiet on X. Time to fix that. Starting today, we'll be sharing interesting things people are building, discovering, and discussing on HN. And let us know what's caught your eye lately. There's always room for another great link!
659
552
154
19,765
2,466,873
Christopher Settles retweeted
I love backing borderless founders.
23
20
4
456
91,952
Christopher Settles retweeted
Introducing Lumbridge.ai and rs.lumbridge.ai - an experimental RSPS built for AI agents Connect your Claude, Codex, Pi, Hermes, etc and let it run wild GitHub: github.com/samheutmaker/lumb…
okay yeah there's something to learn here
42
23
6
561
100,395
Christopher Settles retweeted
hey! super excited to announce human behavior v2 ;) we raised $5M from @paulg, @ycombinator, @generalcatalyst, @vercel to put your company on autopilot product analytics told you what happened … human behavior now just handles it
265
130
73
946
526,517