We need better evals. One of the motivations behind working on FrontierSWE and releasing it was that at the time we were seeing many blogs about how agents running for many hours could accomplish incredible tasks like how: - Cursor built a web browser from scratch - Bun had an agent rewrite Bun in rust - Anthropic built a C compiler. We saw that many benchmarks in coding were saturated (SWE-Bench Pro etc) and wanted a benchmark that could accurately reflect ultra long horizon and extremely difficult software engineering tasks that would usually take humans weeks to months in an attempt to measure AI progress With Muse Spark 1.3 and Gemini Flash 3.8 scoring similarly as a Fable 5.1 or Astra on benchmarks like DeepSWE, its clear that the need for really good benchmarks that accurately reflect model progress that are both fair and hard for frontier models is much needed I might be biased but FrontierSWE is the only coding benchmark that still remains unsaturated and most closely reflects the preferences of day to day developers At Proximal, we are committing millions of dollars in the next few months to creating better evals for the community in domains like software engineering, science, hardware engineering, etc. If you are excited about this kind of work, we'd love to chat with you. The team is very lean (3 people) and has a lot of autonomy and resources.