Infinite data generation for robotic AI (ps. we're hiring!)
Joined December 2024
- Tweets53
- Following46
- Followers1.9K
- Likes123
Pinned Tweet
🚀 We’re thrilled to announce the release of Lucky Engine 2026.3! "The Matrix for Robots" is now 100% Agentic 🤖✨
To train autonomy, you need a "Matrix" a virtual playground where they can learn before touching the physical world.
Today, we are dropping Lucky Engine 2026.3, and we think that it redefines how synthetic environments are built.
• Real-time ray tracing & path tracing
• 100% agentic (AI agents fully control the engine)
• Upload a photo → instant data generation for your policies
• Graph-based procedural generation, AI generated determinism
• No Blender required. Here’s what’s inside 🧵 👇
3️⃣ 100% Agentic: Photo-to-Policy 📸
AI agents like Claude, Codex, DeepSeek or any other now directly drive Lucky Engine.
Prompt "build a living room and have a G1 clean up the table" or upload a reference photo of a hotel room, and your AI agent will generate the full 3D simulation scene natively inside the engine with the task you have in mind, exporting LeRobot 3.0 format instantly.
It now takes 5 to 60 minutes to build an entire scene, and does not require you to be a game developer or a technical artist.
4️⃣ Photorealism:
By pairing real-time photorealism with procedural node graphs and direct LLM control, Lucky Engine 2026.3 eliminates the manual bottleneck of creating 3D environments for autonomous robots.
Together, photorealistic rendering, procedural generation, and native AI integration make Lucky Engine 2026.3 one of the most powerful tools for robotics development.
Get started with Lucky Engine 2026.3 today:
📚 Documentation: docs.luckyrobots.com
📁 Follow us on Discord for daily livestreams starting soon: discord.gg/guYtYzfnt3
💻 Download & try it now: luckyrobots.com
What will your AI build first? Drop a comment below 👇
2️⃣ Visual Procedural Generation 🕸️
Skip external modeling software entirely. Build meshes, materials, and complete scenes natively using visual node graphs.
Use your AI deterministically: using seeds and procedural generation done by Lucky, instruct it to build the exact same coffee machine every single run until you're done fine-tuning and training your perfect policy. Real physics geometry, zero hallucinations.
Expose parameters to tweak, randomize, or regenerate physics-ready geometry near-instantly.
1️⃣ Real-Time Ray Tracing 💡
Robots need photorealistic environments to bridge the sim-to-real gap. We brought movie-grade path tracing into real-time rendering; putting Lucky Engine on par with AAA game engines, if not better than most.
Set up multi-camera rigs and capture photorealistic training output directly inside the engine, as many and as high quality as you like.
You bring the robot. We build the simulation.
We create the full scene: environment, robot scripting, for whatever you're training or deploying. A warehouse, a home, anything, with domain randomization.
Then you choose how it gets used:
- We hand you the scenes, you collect data and test yourself
- We run & test your policies and report back
- We generate the data and hand it over, ready to train on
We're selecting 3 robotics teams and putting up to $50K of Lucky engineering behind each project. In return, we want to publish the results together.
DM us or reply with what you want to build!
Real-world LiDAR is noisy and surface-dependent. You need your simulated LiDAR to also reflect that.
To use it, grab the latest preview build
luckyrobots.com/download
Then check out the LiDAR Maze example project
We're on a mission to put an end to teleop!
Sim2real with Lucky Sim🤝LeRobot
Create your env and output teleop-equivalent data in the @huggingface LeRobot format, train and then deploy to real.
docs.luckyrobots.com/stable/…
Lucky Robots retweeted
“A fellowship for senior roboticists and researchers who need a simulator that can keep up with what they're building.”
I think diverse avenues for funding researchers is great for pushing the robotics field forward!
Love to see it! ❤️
Lucky Robots retweeted
Lucky robots fellowship is for researchers who are looking for a simulator that bends to their will, not the other way around.
we're looking to partner with a select few researchers in a paid fellowship to push robotics research into the next frontier
Lucky Robots retweeted
Well, here it is! We just shipped the very first version of Lucky Engine - a game engine purpose-built for robotics. Download now on Windows, Linux, and macOS - free for research & personal use: luckyrobots.com
Go train some robots... or make some games. This is just the beginning, and we're planning to update frequently as we keep working hard. ❤️
Lucky Robots retweeted
Trying to get something from epic tech demo that runs on individual machines to an actual first release is heckin humbling
This is just the beginning of what we're cooking, I cannot wait to share more
Use it, tell us what you like, hate, & want. My DMs are open & we're hiring!
Lucky Robots retweeted
I'm not the best judge of robotics simulators, but this is easily the most user-friendly one I've used.
It actually runs well on a Mac.
Feels more like the Unity editor / game engine than other simulators.
luckyrobots.com/#engine" – at San Francisco, CA
We are super excited to share with you our initial release of Lucky Engine. We are building a robotics engine from the ground up to be what we wished we could find in a simulator before
When you need to produce millions or billions of domain randomized episodes, you can use Lucky Hub to offload that work to us, and see your dataset created overnight. Lucky Hub is now live, and cloud-scaled recording will be coming very soon.
We are very proud to share this with you, please let us know what you think and want added or changed! We will be adding a lot more very soon: Warp, RL frameworks, expanding scene generation, can’t wait to share with you all!
Download: luckyrobots.com/