Laurent Py retweeted
Current benchmarks miss the central challenge in agent optimization.
Most evaluations test one-shot improvement, while real-world use requires recursive optimization as new tasks continue to arrive.
To study this, we built a two-phase continual-learning evaluation on hard Terminal-Bench 2.0 tasks, comparing GEPA, Meta Harness, and RELAI.
The methods behaved very differently:
- GEPA improved initially but transferred negatively to unseen tasks, indicating overfitting.
- Meta Harness transferred well but could not continue improving.
- RELAI was the only method that both generalized to unseen tasks and improved again without regressing prior performance.
Full results are in the article below.
You can access RELAI’s continual-learning engine to run similar optimization studies and apply it to your own agents at relai.ai
Laurent Py retweeted
Merci à Packmind d'être sponsor Bronze de Devoxx France 2025 @packmind_app
Laurent Py retweeted
Remember when GitHub said that Copilot helped engineers write code 55% faster?
Well, a first of its kind study has concluded that this will lead to a doubling of the rate of code churn - the percentage of lines that are reverted or updated less than two weeks after being authored.
The report was pretty scathing in its analysis, saying:
Code generated during 2023 more resembles an itinerant contributor, prone to violate the DRY-ness of the repos visited.
Laurent Py retweeted
Je suis ravi de lancer le podcast "Tech Lead Corner" dédié aux missions des Tech Leaders.
Quel joie d'accueillir @DorraBartaguiz, VP Tech chez @ArollaFr, pour ce premier épisode 😊(dont voici un extrait)
A retrouver sur tlc.packmind.com
Why is it so hard for big companies to successfully innovate and disrupt? linkedin.com/pulse/why-so-ha…
3
76
Laurent Py retweeted
ChatGPT is one of those rare moments in technology where you see a glimmer of how everything is going to be different going forward.
Laurent Py retweeted
Linear in the software engineering project management world feels like what Figma is in the design world.
I don’t know any startup that went back to another tool after using Linear, and have not seen software engineers before raving about *a project management tool*
Once you've used @linear , every other product appears inferior.
Peak usability engineering.
Laurent Py retweeted
This is exactly what happened at Uber Eats 3-4 years ago.
A few key leaders who were executing amazing at Uber Eats were denied their L+1 promotion thanks to Uber Prime’s bureaucracy. So they went to L+2 to DoorDash and are still crushing it. What a loss for Uber, win for DD.
This Post is from an account that no longer exists. Learn more
Laurent Py retweeted
If the best public cloud company (Snowflake) trades at 20X EV/NTM revenue with 60% NTM growth at scale and +FCF, mid-stage startups are not going to do rounds in the near term at much bigger multiples
Expectations still meeting the asphalt of reality for private software co’s
Laurent Py retweeted
Things that don’t exist:
• “Zero to one” product manager
• Viral content marketer
• Full stack engineer
• Designer who can prototype
If you find one, don’t fuck it up because they can start their own company. They don’t actually need you.
Laurent Py retweeted
I'm proud of many things we do at Atlassian. But when we support each other I'm the proudest of all: linkedin.com/pulse/when-cult…
Laurent Py retweeted
Looking forward to moderating next week's fireside chat on @YourZephyr's 10 years of success in the @Atlassian Marketplace with @SmartBear visionary @py_laurent and others.
Happy birthday @AtlassianMarket!
#QualityAtSpeed #OpenDevOps solution on @Jira sprou.tt/1wrTE84aNqC
I voted today #presidentielles2022 and so grateful I could when I think about all these autocratic countries and the ongoing war
Laurent Py retweeted
This what you need to know today about #AtlassianApps -> paper.li/atlassianapps/15488… #Atlassian - vía @cucumberbdd @kreuzwerker @zapier #devops #jira
Laurent Py retweeted
It is not even 4PM on the first day back and I have already seen:
$100M pre for pre-product company.
$1BN pre for $1M ARR company.
$10BN pre for company less than 15 months old.
My oh my, welcome 2022.
Laurent Py retweeted
Short-term results come from intensity. Long-term results come from consistency.
Laurent Py retweeted
Two facts many people don't know:
1) The global median income has doubled in 17 years from 2000 to 2017. A stunningly rapid progress the world has *never* seen before. (Adjusted for prices, so not due to inflation)
2) Still half the people in the world have less than $7 per day
Laurent Py retweeted
Replying to @bgurley
Great. We can now rule out that it was engineered by Microsoft
























