Mike Legemah (@TechFishBbq) header
Mike Legemah (@TechFishBbq) profile picture

Principal AI Engineer. I catch agentic AI failures before they cost millions, not after. Evals + agentic systems for regulated enterprise. https://nitter.cf/t.co/wNKtykyGgV

New York, NY
Joined March 2009
Photo by Mike Legemah (@TechFishBbq)Photo by Mike Legemah (@TechFishBbq)Photo by Mike Legemah (@TechFishBbq)Photo by Mike Legemah (@TechFishBbq)Photo by Mike Legemah (@TechFishBbq)Photo by Mike Legemah (@TechFishBbq)Photo by Mike Legemah (@TechFishBbq)Photo by Mike Legemah (@TechFishBbq)Photo by Mike Legemah (@TechFishBbq)Photo by Mike Legemah (@TechFishBbq)
Everyone tests their agents. Few test the handoffs between them. A peer agent’s output is untrusted input: check type, provenance and permissions before the next agent acts. A2A moves messages. It doesn’t make them trustworthy. Quorel’s handoff evals are nearly ready.
1
37
Mike Legemah retweeted
Should people jump into AI Governance, AI Project Management, AI Product Management, or AI Cloud Engineering without understanding the fundamentals of those fields? No. Learn your domain first. Then learn how to apply AI. AI knowledge alone doesn’t replace domain expertise.
6
13
1
87
3,280
Mike Legemah retweeted
Adding “AI” to your job title doesn’t replace knowing your craft. AI Governance. AI Project Management. AI Product Management. AI Cloud Engineering. Learn the fundamentals. Then apply AI. My latest Substack explains why domain expertise still matters. 👇 careerrehab.substack.com/p/l…
🤖 Made with AI
1
1
19
682
Most AI evals run after the fact, in a dashboard nobody opens. Better: an MCP tool the agent calls mid-turn. Deterministic checks first, a judge only for the ambiguous middle, and a verdict (allow, warn, block) before anything ships. Building this as Quorel. Waitlist soon.
1
1
26
Things companies call a layoff before they call it a layoff: - A reorganization - A strategic realignment - Rightsizing - A voluntary exit program - Investing in the future - An opportunity for growth - Promoted to customer
20
14
135
6,618
In regulated AI, an eval score isn’t a metric. It’s release evidence. Pin model, prompt, tools and policy versions. Version the eval set. Set thresholds by risk before the run. Classify every miss. Rerun on any change. If you can’t reproduce it, it’s an opinion.
1
35
Mike Legemah retweeted
Please keep learning skills beyond AI. There are many paths into tech, and your expertise doesn’t have to revolve around AI. A few skills to build: • SQL and data analysis • Networking and IT troubleshooting • Software testing and quality assurance • Business analysis and process improvement • Cloud administration • Cybersecurity • ServiceNow or Salesforce administration • Project management Build practical experience, solve real problems, and show the results on your résumé. AI can complement your skills it doesn’t have to be your entire career.
4
24
2
154
4,375
Mike Legemah retweeted
Job applications asking “May we contact your current employer?" NO????? I'm trying to leave quietly, not announce my escape.
27
109
5
2,910
55,124
Mike Legemah retweeted
The math of logging one win a day is almost unfair. 🧵
1
1
15
5 things before an agent goes to production in a regulated enterprise: 1. Deterministic policy enforcement 2. Audit + observability 3. Evals as release gates 4. Bounded autonomy 5. Lifecycle governance mleg.tech – at Deer Park, NY
1
28
Mike Legemah retweeted
Have a good week!
2
2
8
1,313
Mike Legemah retweeted
One thing I’ve learned today is that a LOT of Airbnb hosts haven’t realized they’re actually in the hospitality industry, not the real estate industry.
222
5,993
140
110,794
1,227,097
My good sis @KanikaTolver just confirmed what I’ve been telling some people over the last couple of years.
1
1,117
Mike Legemah retweeted
Your review is judged against a rubric. How many lines of it can you back with evidence? LogPact's gap analysis shows which competencies have wins logged and which are empty, while there's still time to fix it. Pro, 14-day trial: logpact.com/?utm_source=x&ut…
1
2
15
Prove a single-agent workflow before you build a multi-agent one. Every extra agent is another handoff to secure and another failure mode to audit. If you need several: delegation never grants permissions, and protocol compliance is not trust.
6
1
6
164
Why do non-US recruiters always think it’s a good idea to call you before they email you a job description? Do they think people are just sitting around doing nothing?
2
1
191
Mike Legemah retweeted
Unpopular opinion: the brag doc is bad advice. Blank docs need you to remember them. You don't. Smaller works: 1 win, 1 sentence, 60 sec, every day. 30 days → 30 dated wins. Free challenge starts Oct 26: logpact.com/challenge?utm_so…
1
2
49
LLM judge: "summary is grounded." 5-line script: "the claim ID it cites doesn't exist." Believe the script. Deterministic checks first. Judge for the rest, validated against human labels. Evals are release gates, not QA.
1
2
70