senior advisor @ CAISSI, @NIST | personal acct. | 🚀
San Francisco, CA
Joined August 2015
- Tweets671
- Following714
- Followers1.1K
- Likes16K
To prepare for and respond to SI control incidents, NIST CAISSI, NSA SISC, and CISA have authored voluntary practices for organizations training and evaluating highly capable agents.
Grounded in established cybersecurity best practices, the document provides novel considerations for operational excellence in SI training and evaluation.
nist.gov/news-events/news/20…
Excited for CAISI’s AI Agent Standards Initiative for a secure and interoperable frontier! If this sounds like your cup of tea, we’re hiring: ai.usajobs.gov/job/856268900….
The future of AI is agentic, and America is leading the way to make it secure and interoperable.
A new AI Agent Standards Initiative is launching this week @NIST to drive industry-led standards and open protocols that build trust and advance innovation. nist.gov/news-events/news/20…
Peter Cihon retweeted
Excited to share @NIST+CAISI’s initial public draft on how to run and report results of automated evals.
If you have opinions on evals, we’d love your feedback — help us improve the AI evals ecosystem!
Public comments accepted through March 31st via [email protected].
more in🧵
🚨CAISI is hiring🚨
including roles to work on frontier AI lab partnerships and standards development on my team.
Please help spread the word, and see Ben’s thread for more info:
Peter Cihon retweeted
This is a great way to contribute technical expertise toward public service. I recommend applying!
CAISI is hiring for a bunch of exciting new roles, from partnerships to technical experts in AI x bio / chem and more.
They're serious about bringing in strong researchers & engineers and letting them do good work.
Based in DC or SF:
nist.gov/caisi/careers-caisi
Peter Cihon retweeted
Seems like a great opportunity for technical talent to come into government and help the USG make sound, technically informed decisions on AI
CAISI is hiring for a bunch of exciting new roles, from partnerships to technical experts in AI x bio / chem and more.
They're serious about bringing in strong researchers & engineers and letting them do good work.
Based in DC or SF:
nist.gov/caisi/careers-caisi
Peter Cihon retweeted
CAISI is hiring for a bunch of exciting new roles, from partnerships to technical experts in AI x bio / chem and more.
They're serious about bringing in strong researchers & engineers and letting them do good work.
Based in DC or SF:
nist.gov/caisi/careers-caisi
Peter Cihon retweeted
People sometimes ask me how to leverage a technical background to jump into U.S. AI policy. As of this week my answer is straightforward: apply to join us at CAISI! We're a startup within government, and we're doing a hiring surge.
CAISI has published an RFI about securing AI agents. It seeks insights from AI agent deployers, developers, and computer security researchers. Questions address the current threat landscape, mitigations, measurements, and other security considerations unique to AI agents.
Responses are due March 9 and will inform ongoing CAISI research and the development of voluntary guidelines. For more information, please see CAISI’s blog which links to the full RFI in the Federal Register.
nist.gov/news-events/news/20…
Peter Cihon retweeted
CAISI is recruiting an intern to support an agent security standards project. Position closes Jan. 15 for a February start. Please help spread the word. Details in thread:
CAISI is recruiting an intern to support an agent security standards project. Position closes Jan. 15 for a February start. Please help spread the word. Details in thread:
The internship runs February-April. It is unpaid; possible full or part time. CAISI has offices in Washington, DC and San Francisco, and may consider remote candidates. Current students (at least half-time in an accredited school) with U.S. citizenship are welcome to apply.
To be considered, please request a faculty member provide a paragraph of recommendation in email to [email protected]Â no later than January 15.
Peter Cihon retweeted
US CAISI is hiring -- the internal govt name is "IT Specialist" but it is effectively a research scientist role!
Salary is $120,579 to - $195,200 per year & you work on AI evaluation within government agencies! Dream job for the right person.
Details: lnkd.in/exJgkqr5
Peter Cihon retweeted
What should AI evaluators do about models cheating on agent evals? In a new write-up from the U.S. Center for AI Standards and Innovation, we characterize cheating, share examples from our logs, and suggest evaluation practices aimed at reducing cheating's incidence and impact.🧵
Peter Cihon retweeted
I’ll be in San Diego for @NeurIPSConf this week, Tues-Friday. If you’re curious about collaborating with or working at CAISI, please reach out!