Nice DeepSWE score! Does it survive a lowercase filename?
Introducing MaxxBench: 89 DeepSWE tasks with small changes to the instructions or starting code. Same engineering problem, slightly different requirement.
Models clustered around 74% on DeepSWE end up 23 pp apart.
Good at coding, or good at DeepSWE? 🧵
If Sarkesian is still the Longhorns coach on Monday Texas has to stop calling itself a football school and leave the SEC
136
Basically a list of my daily if not hourly thoughts.
The deep amount of anxiety people in tech are feeling is off the charts. Had a couple conversations with people of various ages and the themes are:
- Every day there are 5 new earth shattering new tech breakthroughs. I can’t keep up. Should I be keeping up? Am I falling behind?
- What does my career and skill mean in the age of AI? Is software engineering a 30yr long career any more? Is product management?
- Is my only hope to start a company?
- At the very least, it feels like I should join a startup but which one? Everything seems either overvalued or has no moat.
- Okay I joined a startup. Is my company’s equity worth anything or will this be another Airtable or Miro?
- Startup is doing well. How in the world am I supposed to find a significant other?
- Will these immigration policy shifts allow me to be here long term?
- Will I ever be able to afford a house and a life in the Bay Area amidst the biggest wealth creation event of all time?
- Okay, I figured all of that out. What is my purpose? I’m wealthy but no one really cares. I don’t really know what to do with it. Am I supposed to start a company?
- Alright I found peace in kids. But I’m worried about them. How does one raise kids in this climate? What are the rules of this new world order?
Many of these concerns are of course not limited to tech or the Bay, although it feels particularly concentrated here (versus what I see in NYC). Maybe some people will read this and feel anxious themselves, and for that I apologize.
For the rest, just know that it’s not just you who feels this way. It’s a lot of people!
105
Nick Hallmark retweeted
Stanley Druckenmiller renders an unfavorable opinion of Treasury Secretary Scott Bessent's use of buybacks to defend against higher yields in a market that is functioning normally.
"I have spent five decades trading on a simple premise: Markets aggregate information no committee possesses, and prices are how that information reaches decision makers. The long-term Treasury yield is the most important price in the world. It is also the only fiscal disciplinarian the U.S. has left."
"Every basis point of artificial yield suppression is a subsidy to procrastination."
"Return buybacks to their stated purpose: small, scheduled, off-the-run liquidity operations announced at quarterly refundings, never off-cycle responses to yield levels. Term out the debt honestly and pay the price the market sets."
"If the 30-year must trade at 5.5% to clear, that isn’t a crisis. It is an invoice. Then do the only thing that durably lowers long-term yields: address the primary deficit."
wsj.com/opinion/let-the-bond…
Nick Hallmark retweeted
i really don't want to use your agent, i want to use my agent to use your thing.
Coolest thing I’ve seen in a long time. totally in a rabbit hole now reading about these models
Introducing GEN-1.5, a one-shot learner.
It can learn new tasks in a few seconds. Show it what to do, and it generalizes.
This capability emerged from pretraining on physical data at scale, as a step towards our mission of building general intelligence for the physical world.
1
108
Nick Hallmark retweeted
How Anthropic's new results post would read without the PR:
Claude orchestrated open-source protein design models, PXDesign, RFdiffusion, Genie, BoltzGen, from a 30k-token expert prompt and 12,500 H100-hours of compute, and designed binders against 14 of 15 targets. Hit rates of 22–35% against a 10–15% baseline, where some of those tools already report similar numbers on their own.
The orchestration is genuinely impressive. But the open-source models did most of the lifting, and they came from the Baker lab, Columbia, MIT, ByteDance Seed, and most of them were already wet-lab validated before Claude touched them.
Which also sets the ceiling. All these generators share a single PDB-shaped training distribution, so calling four of them doesn't diversify away the blind spot, since they fail together. The targets that worked are the well-studied ones.
So the valid claim is that an agent can now drive this stack competently in the regime where the stack already works.
Instead, we got this announcement:
Many drugs work by binding to a specific target in the body and blocking or changing what it does. An important first step in the drug development process is designing a molecule that can bind tightly to its target. Traditionally, that's meant weeks or months of expert work per target, sifting through a large number of candidates to identify the few that work.
We wanted to test if Claude could successfully design novel protein binders from scratch (also called de novo design). With a protein design prompt written by a human expert, Claude autonomously designed protein binders against 14 out of 15 targets.
We then worked with Adaptyv Bio and Twist Bioscience, who independently built and tested the proteins Claude designed.
This take must go so hard when you have no idea how the pied-a-terre tax actually works.
I wonder if @NYCDSA co-chair @unionGustavo's parents will pay the pied-a-terre tax on the rowhouse they bought him in Bed-Stuy (Gustavo *E.* Gordillo is the father of our local Gustavo *L.*). The home showed up on the list Mamdani's office released.
Fair market value: $1,457,000
1
140
Nick Hallmark retweeted
The timing of Amazon Prime Day depressed retail sales in July. Prime Day normally falls in July but happened in June this year. As a result, sales in June were juiced at July's expense. Average out the two months, core retail sales and food services, up just 0.1% per month.
Nick Hallmark retweeted
Thanks to the coordinated efforts of the U.S. military and our gulf allies, the seven-day average for oil leaving the Strait of Hormuz is currently up to almost 9 million barrels per day.
When combined with the additional 5-7 million barrels per day leaving the region via newly upgraded pipelines and export facilities, total oil flows are currently averaging approximately 15 million barrels per day.
On Sunday alone, over 20 million barrels left the Arabian gulf region, which is above the pre-conflict average.
guys you do know you can just disable thinking, and instead give it a "deep_think" tool, and it will call it with internal CoT reasoning format right?
gl fixing that
Yankees need to deal with Caballero… dudes a mid rate ball player at best and just plays tiki-tac ball. For a primary base stealer his OBP is absolute trash. His entire gimmick is going by “the letter of the rule” and then bitches when it gets called against him. Grow up
Jose Caballero takes too long getting to first base on a walk and is called for a pitch clock violation making Austin Wells start his at bat with an 0-1 count
161
Nick Hallmark retweeted
I would have assumed it was fairly obvious, but in case it's not: a million-line codebase (also known as a "harness"), running at inference time, orchestrating thousands of calls to a neural network for any given task, is the exact definition of a "neurosymbolic architecture"
Nick Hallmark retweeted
MUST READ: "... Since attacking Iran in February, Trump’s immediate demands have shrunk from a sprawling list of concessions [...] to just one: that Iran allow the Strait of Hormuz to return to its prewar state..."
ft.com/content/87b039cf-7eb0…
Nick Hallmark retweeted
Land of the Rising Wage. In Japan, the Labor Ministry reports that nominal wages climbed 3.4% from a year earlier. The upward momentum in Japanese wage growth is notable. By contrast, in the US, the ECI measure for wages & salaries cooled to 3.1% in Q2.
Nick Hallmark retweeted
“The Fed’s work is only as effective as the public’s understanding of it, and you, the press, are essential to keeping the public informed about what we do and why. The people we serve benefit from your careful reporting.” Jay Powell at his last presser.
Nick Hallmark retweeted
This is like the Enron CEO cursing at the analyst on the earnings call. Never a good sign.
This would go a lot harder if @NickTimiraos wasn’t literally a reporter whose job is like you know… reporting… which is uh kinda supposed to be without his own opinions and analysis… you know the kind of fact based reporting Scott and others say we need more of…
One of the highlights of the Warsh Fed has been watching stenographers posing as journalists, like the WSJ’s Nick Timiraos, reduced to reporting Fed backroom gossip because they’re incapable of performing real economic or monetary policy analysis without being spoon-fed.
118































