Agent Security lead @ U.S. Center for AI Standards and Innovation. Prev: science of deep learning PhD @ Harvard
Joined March 2014
- Tweets113
- Following53
- Followers644
- Likes147
Ben Edelman retweeted
To prepare for and respond to SI control incidents, NIST CAISSI, NSA SISC, and CISA have authored voluntary practices for organizations training and evaluating highly capable agents.
This paper does a fantastic job conveying that:
(1) Deep learning abounds in miraculous empirical regularities
(2) A beautiful scientific theory has emerged over the past decade to explain the miracles
(3) Yet most fundamental questions remain mysteries. The best is yet to come.
1/ Deep learning is going to have a scientific theory. We can see the pieces starting to come together, and it's looking a lot like physics!
We're releasing a paper pulling together these emerging threads and giving them a name: learning mechanics.
🔨 arxiv.org/pdf/2604.21691 🔧
Excited to be part of this initiative. Join our team to advance the frontier of agent security research and standards! usajobs.gov/job/856267900
The future of AI is agentic, and America is leading the way to make it secure and interoperable.
A new AI Agent Standards Initiative is launching this week @NIST to drive industry-led standards and open protocols that build trust and advance innovation. nist.gov/news-events/news/20…
Ben Edelman retweeted
Excited to share @NIST+CAISI’s initial public draft on how to run and report results of automated evals.
If you have opinions on evals, we’d love your feedback — help us improve the AI evals ecosystem!
Public comments accepted through March 31st via [email protected].
more in🧵
Ben Edelman retweeted
One of the best places if you have technical background and care about AI going well!
Ben Edelman retweeted
Seems like a great opportunity for technical talent to come into government and help the USG make sound, technically informed decisions on AI
CAISI is hiring for a bunch of exciting new roles, from partnerships to technical experts in AI x bio / chem and more.
They're serious about bringing in strong researchers & engineers and letting them do good work.
Based in DC or SF:
nist.gov/caisi/careers-caisi
Ben Edelman retweeted
CAISI is hiring for a bunch of exciting new roles, from partnerships to technical experts in AI x bio / chem and more.
They're serious about bringing in strong researchers & engineers and letting them do good work.
Based in DC or SF:
nist.gov/caisi/careers-caisi
People sometimes ask me how to leverage a technical background to jump into U.S. AI policy. As of this week my answer is straightforward: apply to join us at CAISI! We're a startup within government, and we're doing a hiring surge.
The United States is the center of the AI revolution. We need dedicated public servants to ensure our government is smart on AI issues.
My Agent Security team is hiring Research Engineers & Scientists. Other teams are hiring people with strong technical backgrounds too: Frontier Assessment, Cyber, Chem/Bio, Applied Systems, and Partnerships. Job postings are listed here: nist.gov/caisi/careers-caisi
At CAISI, we're the U.S. government's leading experts on agent security. We published this RFI so deployers, developers, and experts can provide insights that inform our research and NIST guidelines development. Responses due March 9th!
Ben Edelman retweeted
CAISI is recruiting an intern to support an agent security standards project. Position closes Jan. 15 for a February start. Please help spread the word. Details in thread:
Ben Edelman retweeted
This is cool work by CAISI to publish a case study on models cheating on evals in practice!
nist.gov/caisi/cheating-ai-a…
What should AI evaluators do about models cheating on agent evals? In a new write-up from the U.S. Center for AI Standards and Innovation, we characterize cheating, share examples from our logs, and suggest evaluation practices aimed at reducing cheating's incidence and impact.🧵
As part of our mission, CAISI both directly evaluates models and seeks to advance best practices for AI measurement science. Learn more about our eval cheating work by reading the full write-up below! This work was led by Maia Hamin. nist.gov/caisi/cheating-ai-a…
And, btw, this is part of the first batch of posts on our new CAISI Research Blog! nist.gov/blogs/caisi-researc…