julian (@herdingbots) profile picture

Head of Engineering Strategy. Building internal AI tools & DevEx by day. herding an army of AI agents by night.

Laguna Beach, CA
Joined May 2026
Photo by julian (@herdingbots)Photo by julian (@herdingbots)Photo by julian (@herdingbots)Photo by julian (@herdingbots)Photo by julian (@herdingbots)Photo by julian (@herdingbots)Photo by julian (@herdingbots)Photo by julian (@herdingbots)Photo by julian (@herdingbots)Photo by julian (@herdingbots)
So glad Jason said what we were all thinking about this scandal involving a super powerful male CEO cheating on his wife with three women, two of them his subordinates and one of them a probable Chinese asset, to devastating effect: this is because of DEI
RESET ALL BOARDS TO BE RANKED BY SHARES HELD. NO MORE DEI AND VIRTUE SIGNALING BOARDS NO MORE "EXPERTS" ONLY WARRIORS WITH SKIN IN THE GAME
42
48
2
1,058
41,655
Hi @Spotify, you traced my Chef’s Kiss illustration. It even has the wonky hand that I’ve regretted since I originally drew it. (There should be a pinky in the front instead of a thumb.) In a time when designers are getting less and less work, this really sucks to see!
164
3,821
71
65,777
1,243,132
I‘m paying for @YouTube premium and I still see unskippable ads….👀
2
466
julian retweeted
🌊💙 WE WERE ALWAYS BLUE
957
3,725
1,190
28,869
7,879,436
Compaction is a mistake. When an agent's context fills up, tools like Codex and Claude Code compact it: 1. The model prefills the entire session again 2. It writes a summary of everything so far 3. A new session starts from that summary I measured this on a real ~400k-token session with Opus 5.5: → 38 s and $1.99 when the prompt cache has expired → 29 s and $0.17 when it hasn't And the summary is lossy. The exact error message, the file path, the one number you needed is often gone. So I do something new for Mainplane Context retrieval works the other way around. Mainplane keeps the full record of every session as a file. When the context fills up, a new session starts right away with one instruction: "You are continuing session X. Retrieve key context from it as you go." The agent searches the old session and copies the exact lines it needs, when it needs them. Same session, same model: 15 s and $0.10 to get back to work. It does not depend on a cache hit, and nothing is paraphrased. This is the bitter lesson applied to agent memory. Don't hand-design what the model should remember. Give it the full record and good tools, and let it decide. Mainplane is open source (MIT). Link in the first comment.
Context compaction was a mistake The bitter lesson is to let the LLM manage its own context. Here is how I do this in Mainplane
312
154
123
3,594
562,335
julian retweeted
Native iPhone Duo apps, built with Expo. Ship yours before your AppleCare appointment!
368
803
419
11,746
1,114,307
And so it begins
OpenRouter served 5.2T tokens yesterday. We did ~1.8T (1/3 of their volume) on just 64x B300 and 64x M890P. Where do all GPUs go? 😂😂😂
48
julian retweeted
every product i use should just be a headless mcp, that feeds into an agent, where i never have to think about anything underneath. except for our product, of course. in our product, customers love the ui and love us very much. we're special that way.
150
412
109
7,093
339,161
This is retarded. Instead of reducing GDPR bloat regulatory shit they make small businesses jump through... They propose to let AI companies use your personal data to train AI. I am not anti-AI but this is duality of EU fake "citizen protection". dismantle the whole thing ffs (GDPR I mean).
‼️ EU governments approved a GDPR change to let companies train AI on Europeans' personal data without consent. It makes AI training a possible "legitimate interest", judged case by case. Parliament must still agree. Max Schrems calls it a "digital expropriation" of Europeans.
40
44
1
474
31,817
I want to submit my taxes via API to the @irs @shl
1
38
Here is official trailer, You Can See Everything
2,200
13,147
5,737
179,350
39,485,041
Did a write-up of my own German exit tax solution. TLDR: Needed 13 tax advisors, 1.5 years, and 18.7k€. Tax advisors shady as hell. Highlights: You have to pay 2k€ to a notary to move your companies into a new structure. The notary is missing the right document template. You have to pay another tax advisor 1.9k€ for said document template. After paying 1.9k€ for the template, the notary reads it out loud to you and you pay them another 2k€ for that
44
18
5
460
72,613
julian retweeted
efficient markets in shambles
JUST IN: NVIDIA's $12,930,300,000 acquisition of Hugging Face contains an easter egg. The number 129,303 is the decimal conversion of Unicode point U+1F917. The 🤗 emoji.
87
262
12
7,649
551,369
We should get rid of income tax and instead increase taxes on „money making money“ More taxes for wealth that comes from no work.
Fascinating numbers here from Kiko in El Pais. With a salary of €97,500 you are in the 1%, but you need €164,000 to be in the 1% by income. Piketty watchers will note the emergence of a gap between those who get a salary (workers) and those who have an income (including assets such as property, shares) When owning assets becomes more rewarding than actually working, wealth inevitably concentrates into fewer and fewer hands — eventually distorting the economy and undermining democracy itself.
1
1
102
A website for trading fake money is a net negative.
Coinbase CEO Brian Armstrong says donating to charity is net negative "The common view is that philanthropy is this noble cause, and Bill Gates is like 'I'm going to go rehabilitate my image and do philanthropy.'" "A lot of charities and philanthropies are actually net negative for the world and they get captured. It's remarkably hard to find a foundation that has not gotten captured by ideology.” “By trying to do something good, like criminal justice reform, it turns out they just increased crime. I have a donor advised fund and I put money toward things helping civilization advance, but I don't think at this moment I would ever create a foundation." "If you look at the Ford Foundation, I think Henry Ford would be turning over in his grave if he knew what they were up to.” “I have a DAF, a donor advised fund, and I just try to put money toward things that I think are helping civilization advance. But I don't think at this moment I would ever create a foundation."
45
116
7
2,182
119,198
If the founder of an eval company doesn’t know how much RaN you need for local AI, you know we’re in a bubble lol
Just canceled my Mac Studio order. After sharing on X that I ordered a Mac Studio with 96GB of RAM, which I thought could be my first foray into local ai, a bunch of people told me, this just wouldn't cut it. This was already really expensive for me, never spent even close to this much on a single computer. So, I don't think I can afford local ai right now. I think I'll just need to continue to live vicariously through people here on X with much bigger budgets than me! Thanks for all the feedback everyone, definitely would rather save the money here if this isn't powerful enough to run local ai in a meaningful way.
77
I used to drive a Tesla. It almost killed me 4 times within 4 years and 100k miles…
Just gonna leave this here
56
Stripe can cut the cost because they safe on payment fees and therefore the business is immediately more profitable.
Stripe has finalized an agreement to acquire OpenRouter for more than $7 billion, according to a report from Bloomberg. This is more than five times the $1.3 billion valuation from OpenRouter's funding round just 82 days ago.
49
SpaceX makes up roughly 0.054% of Norwegians sovereign wealth fund.
And now you know what powers Scandy social welfare…American cowboy capitalism
56
Who is running the Google Design account and why does all their content look like it was designed by a 16 year old girl that just discovered canva?
Change your app's look without touching code. With the Styles API, you can swap colors and visuals dynamically. Instead of forking components, you can keep them tied to Material and skip the maintenance pain for updates. Try it here: developer.android.com/develo… #GoogleDesign #MaterialDesign #JetpackCompose #AndroidDev #UXDesign #MobileAppDev
1
1
76