Jonathan Davis retweeted
Topic: The game got faster: an update to my afterword in Threat Driven Software Development
Threat Driven Software Development: amazon.com/dp/0135567386
1/ I wrote the afterword for this book by Michael Howard (@michael_howard), Lee Holmes (@Lee_Holmes), Sherrod DeGrippo (@sherrod_im) and Shawn Hernan. That was last December, before agentic development hit its stride and the frontier security model boom. It argued that security is an iterated game, not a one time negotiation. These are my own views.
2/ In Robert Axelrod's tournaments, tit for tat won by cooperating first and then answering each move in kind. I used it as an analogy for proportionate governance: make the secure path the fastest and time box every exception before it turns into culture. Most security failures I see are leadership and management failures in disguise.
3/ The game is the same, but it moves much faster now. Each round is a tool call. Every agent in my personal bot swarm has its own skills, access and dependencies. Trust has to be earned every round.
4/ Controls on each agent don't add up to fleet security. Pass work down a chain and each agent checks its own front door while nobody watches the hallway between.
5/ Log agents the way you'd log people: an identity, scoped credentials and logs it can't modify, tied to the delegation chain. Check authority outside the model, and approve high impact actions before they run.
6/ A violation is a reason to look closer. My recent post on detecting hijacked agents goes deeper: nitter.cf/assumebreach/status/21… Respond in proportion, and forgive fast once remediation is verified.
7/ Every dependency is a player too. A tool server shapes what your agent sees and does. An attestation tells you where it was built and nothing about whether it's safe.
8/ Assume breach is something you practice every round. Build a gameboard where the secure path is fastest.
Topic: Detection engineering for agents: telling a hijacked agent from a merely wrong one
nitter.cf/wunderwuzzi23/status/2…
genai.owasp.org/llmrisk/llm0…
1/ A hijacked agent can still finish the user's task, and a wrong one can still cross a boundary. Johann Rehberger reports a sentinel agent stopping a lab agent overnight when it tried to reach a different host. Telling hijacked from just wrong is the detection problem. Credit to Johann: I love his research. He was a top researcher and leader at Microsoft, where he built and led a red team. I was lucky to connect with him at a past MSRC event, and I appreciate everything he gives the AI security community.
2/ Start with provenance: label every source by trust level and tie it to each tool call. Timing alone doesn't prove causation, and injections can fire later.
3/ Then baseline tools and targets by agent role. Remember that an expected tool can still carry an unauthorized action.
4/ Follow the data, even to familiar services. OWASP describes image URL exfiltration: a renderer fetches an image URL carrying secrets and data leaks without any extra tool call. Constrain image loading.
5/ Dig into scope pressure, like attempts to get around a denial or unapproved changes to memory.
6/ A model judge exposed to attacker content can be injected too, so I treat its verdict as supporting evidence.
7/ For red teams: test injections that keep normal tool patterns, and measure false alarms as well as misses. Check authorization before the call runs.
8/ Capture telemetry in logs agents can't modify, tied to the agent, user and delegation chain. When I review an agent rollout, my question is whether we can reconstruct what executed, under whose authority, and what data left.
This…
People who have been in research fields develop a felt sense that most "research" (in almost any field that isn't exactingly technical) is research theater, and many superstar careers enjoy star status not because of a unique connection to the truth but because of a unique connection with an audience. No one really has the time or stature to, from a position of objectivity and trust, bring popular researchers to heel. But it will get increasingly hard to hide from serious critique. The machines can do critique now, at the level of depth and rigor previously only possible for the academically deranged. We're going to have to revise a lot of what we "know" about the world that isn't really knowledge but is actually just received popular consensus - like floating voltages without grounding wires. The grounding wires are coming.
In a few minutes, millions of nerds looking for that #PHP patch goodness will know the suffering of countless parents who maniacally pressed refresh trying to get Taylor/Dua/Sabrina concert tickets for their tween daughters. 😂
It is amazing to see one of the finest minds in security posting publicly. Craig is a titan of the Microsoft security universe. He is an absolute must follow for any security folks out there.
1/ We talk about red team and blue team like they’re opposite tribes. In agent systems they converge. The probe that finds the open tool path is the same instrumentation that proves what the agent changed. Offense and defense share a stack.
2/ Egress maps, identity graphs, signed action logs, kill switches — dual-use by design. You use them to break the story the system tells itself. Then you leave them in place so operators can see, stop, and reconstruct. The difference is intent and who holds the switch.
3/ Build once for both. If your red team needs a special backdoor to validate a finding, you didn’t test the defense. you bypassed it. Same tools. Same truth. Over time that’s the only posture that scales.
Jonathan Davis retweeted
Authority is not a string in the system prompt.Most coding agents still run ambient authority: name a file or a command and the tool will do it. Repo READMEs, comments, and tool output become injection surfaces that redirect real actions. New harness research is clear — cut a task ceiling from trusted input first, store typed capabilities outside the model, check every tool call against the agent that issued it.
Injection can still ask. It shouldn’t be allowed to act.
Jonathan Davis retweeted
Microsoft Digital Defense 2026 report out today. Vulns weaponized in under 24 hrs. Exposed cloud workloads hit in ~5. Offense is at machine speed now. Defense has to be too. Worth your time. microsoft.com/en-us/corporat…
I am with John on this one. @poteto is super smart and engaging. this is a great session. Well worth you time.
God damn. I cannot recommend more strongly that everyone, EVERYONE, whether you’re an Eng, pm, or even investor/finance bro, watch this. At LEAST the first half. @poteto was on the react compiler team at meta and an EM at Netflix.
What struck me most is the CLEAR skepticism she once had about agents, how she talks through all the problems IN DETAIL, but how she systematized solving those problems and sort of climbed up the hill of agent incompetence despair.
Finally had a chance to look at this. Phenomenal work @CyberCakeX
Oh my god. @CyberCakeX has progressed their Harden Windows Security app into something phenomenal. It's even on the App Store!
hotcakex.github.io/
I've mentioned it before but this is $250k cyber consultant security advice and tooling for home user machines essentially.
The Rome Statute of the International Criminal Court, Article 33, states that:
“Orders to commit genocide or crimes against humanity are manifestly unlawful.”
Nuremberg Principle IV states:
“The fact that a person acted pursuant to order of his Government or of a superior does not relieve him from responsibility under international law, provided a moral choice was in fact possible to him.”
Israeli and American friends, especially those of you in the armed forces and those in positions of political power. Please do not aide and abet this ongoing attempt at civilizational murder.
You have a moral choice available to you.
The destruction of the support struts of Iranian civilization being carried out in your name is an unambiguous crime against humanity.
For your own sakes, for all our sakes, stop this unnecessary and unjust war of aggression.
This is a superb little essay containing a super important and counterintuitive insight: Don’t tell reasoning models how to do anything, focus on describing your outcome, constraints, context, audience etc. As soon as I applied this insight, my own effectiveness with AIs exploded. Instead of giving my model of choice my half baked blend of systems, frameworks and execution ideas, I tell it what I want and marvel as it creates an entirely unique optimized plan, framework, methodology or solution just for my problem.
Don’t over-engineer your AI harness (Bitter Lesson Engineering)
danielmiessler.com/blog/bitt…
Jonathan Davis retweeted
If you dig Microsoft, and love OpenClaw, make sure you follow Omar! He's the CVP of Word and is doing some amazing things with #OpenClaw in his spare time. He has a HomeClaw home automation kit, and a great OpenClaw playbook. nitter.cf/OmarShahine/status/202…
My @OpenClaw Playbook (How I set my Lobster up with day by day updates, successes and failures) and HomeClaw an Apple Home bridge for OpenClaw that I wrote and published on GitHub. Details below👇#openclaw
omarknows.ai/p/lobster-gets-…
I have to agree. The only problem with Nate is that he is so prolific, it can be hard to keep up with him, and every video/post is high value!
I have been following @natebjones podcast daily now for over a month, and I feel I have learned more about what is going on in AI than I have in a year of personal research. Give his podcast a try, highly recommended.
Nate’s Substack natesnewsletter.substack.com…
Love to see our MVPs producing this sort of high quality, actionable guidance to help our customers to secure themselves better.
Collect Microsoft Graph Activity Logs in Azure Monitor for improved inspections of your SaaS tenant.
demiliani.com/2023/10/17/col…
#azure #azuremonitor #telemetry #security #msdyn365bc
Why does #Ireland have so much more bot traffic than #Denmark? 67% vs 18% according to radar.cloudflare.com. Presumably it is due to AS32934 (Facebook) or possibly Ireland's large AWS/Azure footprint?
Is the next phase of #LLM #GenerativeAI going to be about seeding advertisements into the responses?
My wife prompted a commercial AI tool with "new years resolutions, an abundance of new years resolutions" and it shilled for CBD oil! 😁


















