Jeremy van Reenen retweeted
Nah, this is actually insane.
The fact that I can record a scene with my phone and have AI turn it into something completely different, while still responding to my actions and surroundings?
I've already started imagining the things I could create with this. ๐
Y'all will get tired of me.
@Simulon, please hurry up with the Android version. I'm getting this the moment it drops. ๐
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
Jeremy van Reenen retweeted
A Chinese maker designed and built this cute crab robot โ and open-sourced it!
He even gave away 100 crabs for free to encourage fun remixes and more creative uses!
@Chinaretold
Jeremy van Reenen retweeted
In @Simulon, you can turn any image into a 3D neural asset and bring it into the real world.
Dracula started as a single image. A minute later, heโs riding a real RC car across my dining table, with his cape swinging through the turns. When the car goes over the edge, he jumps off the car and stays on the table.
All of this happens procedurally, with no prompting. He responds to the space and whatโs happening around him. The inset shows the original footage.
What would you bring into the world? Drop an image in the replies and tell me what youโd like to see it do. Iโll pick a few and bring your ideas to life.
Jeremy van Reenen retweeted
Playing around with Simulon today, video coming up later.
As a preview: Mech Vs Cat.
I know who I have my money on...
๐ค Made with AI
Jeremy van Reenen retweeted
So cool! ๐
๐ค Made with AI
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
Jeremy van Reenen retweeted
One year ago, I would have never imagined that we could reach this level of Mixed Reality with complex interactions. This is an incredible achievement at @Simulon but you would be surprised by how easy it is to use! Give it a try! (Android version is launching soon!)
Hereโs how @Simulon Reality-Aware Rendering works. I placed my raptor next to the water and dropped a stone in to see how heโd respond.
His 3D placement sets his starting position and scale. When the recording starts, he becomes a ghost, leaving me to shape the performance through actions, gestures and spoken instructions. Simulon uses the recorded scene to generate his behaviour and integrate him into the footage afterward.
Instead of typing a prompt, spinning the slot machine and hoping for the best, you can show it, say it and perform it. Your intent, timing and spatial context are right there in the recording. Itโs a much more intuitive way to create.
This breakdown is generated procedurally, summarising the actual reasoning behind the result.
Jeremy van Reenen retweeted
Reality-Aware Rendering is a new mode in the Simulon app that turns a phone recording into a rendered scene. The demo runs about a minute and eighteen seconds.
Per the creator, you place neural assets with your phone and act out the scene. When you stop recording, it reads what you do, what you say and the place around you, and the assets respond to all of it. The final is regenerated from the recording as a new performance, not a copy of the footage.
Why it matters: it points to a way of making visual effects that starts from a phone and a real room instead of a studio pipeline. It is available now on iPhone, with Android coming.
Credit: @diveshnaidoo
Jeremy van Reenen retweeted
Check out this Reality-Aware rendering feature from the new @Simulon 2.0. This is a game changer.
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
Jeremy van Reenen retweeted
How it works nitter.cf/diveshnaidoo/status/21โฆ
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
Jeremy van Reenen retweeted
Simulon is insanely good.
Anyone remotely interested in 3D, CG, and cinema should toy with it for fun.
You can do this in 3 minutes, app download included. Try it.
Hereโs how @Simulon Reality-Aware Rendering works. I placed my raptor next to the water and dropped a stone in to see how heโd respond.
His 3D placement sets his starting position and scale. When the recording starts, he becomes a ghost, leaving me to shape the performance through actions, gestures and spoken instructions. Simulon uses the recorded scene to generate his behaviour and integrate him into the footage afterward.
Instead of typing a prompt, spinning the slot machine and hoping for the best, you can show it, say it and perform it. Your intent, timing and spatial context are right there in the recording. Itโs a much more intuitive way to create.
This breakdown is generated procedurally, summarising the actual reasoning behind the result.
Let the force be with you @Simulon
You can try this right now for free. We are live on the AppStore - apps.apple.com/us/app/simuloโฆ
Jeremy van Reenen retweeted
็กฎๅฎๆ่ถฃ๐
ไพๆกไธ็่พ่ไนๆฏๆ็ๅฐๅฎ ็ฉ
่ฟ็งไบๅจๆนๅผ่ฎฉไบบๅฐ่ฑกๆทฑๅป
ๆๆ็็ไธๅฏๆ่ฎฎหถโน๊ดโนหถ๏ผ
๐ค Made with AI
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
Jeremy van Reenen retweeted
this is truly magical
unlocks so much potential for creation and play
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
Jeremy van Reenen retweeted
You can try this right now for free. We are live on the AppStore - apps.apple.com/us/app/simuloโฆ
Jeremy van Reenen retweeted
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
Jeremy van Reenen retweeted
Video generation is not new but at @Simulon the keyword was always about control. How do you navigate through vfx with the least friction possible? How do you maximise creativity? Impossible question but I think a path of the answer is here!
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
Jeremy van Reenen retweeted
Look at this carefully.
This opens up a whole new world of creative possibilities for creative people.
Here are ten ways this could be used :
1. Filmmakers: shoot a dialogue scene in a real cafรฉ, drop your character into the booth, and act it out with your phone as the camera.
2. Musicians: record a song in a real room, lock the mood and feeling of that place, then let the listener step inside and choose the next verse.
3. Theatre artists: rehearse a scene on a real street corner, place the other character in the space, and run lines without a stage.
4. Painters and visual artists: hang a work in a real gallery wall, walk around it with the phone, and show collectors how it lives in the room.
5. Novelists and world-builders: drop a character into a real city block and let readers walk the opening chapter as a short scene.
Endless possibilities....
But it's the ones with great IP will make the most of this.
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.