Building real-time AI. @Agoraio https://nitter.cf/t.co/mBwrplb81B
San Diego, CA
Joined February 2013
- Tweets61
- Following1.1K
- Followers180
- Likes16.2K
Pinned Tweet
One really cool use case I’ve been exploring with Jev: a semantic VAD for real-time voice AI.
I plugged it into @AgoraIO ConvoAI and used the live transcript + recent conversation as context to decide whether the user has actually finished speaking.
That makes Jev surprisingly good at handling things like hesitation, unfinished thoughts, and those moments where you stop talking for a second because you’re still figuring out what you want to say.
It’s a nice example of where Jev fits really well in a real-time AI loop.
Here’s what it looks like in action 👇
Jay F retweeted
🗣️ User: "STOP!"
🤖 AI Agent: "Sure! But first, let me explain..."
Why is interrupting a Voice AI agent so hard? 👀
Because stopping audio playback ≠ cancelling the entire pipeline.
VAD → ASR → LLM → TTS → Playback
Barge-in is a real-time coordination problem, not just a mute button.
That's where Agora Conversational AI comes in. ⚡
#VoiceAI #Agora #AIEngineering
Jay F retweeted
Jev was multimodal all along
Yep, the Jev you know and love was an image model this whole time. We just chose to disable it because models tend to be less intelligent on other modalities.
Header: TypeSafe-Danger-Zone-Images: true
Jay F retweeted
Inside Agora Conversational AI: What Powers a Real-Time AI Agent? nitter.cf/i/broadcasts/1PKqrNLyz…
Jay F retweeted
I’m in SF this week with the @AgoraIO team for @Techweek_!
Looking forward to seeing what people are shipping, and talking a lot of voice AI, real-time AI, and developer tools.
If you’re around, come say hi.
Jay F retweeted
Some cool things developers have been building with Agora lately 👀
☕️ Spidey is a friendly AI companion that helps you manage tasks by voice. By @HaimantikaM .
⚔️ Voice Arena brings two voice agents with different turn-taking and interruption settings into a live battle. By @HarishKotra .
🎙️ Jev VAD explores when a voice agent should listen or keep talking. By @SoCalJayF .
🎧 An interactive podcast where you can jump in and talk to two AI hosts. By @zicojzc.
Jay F retweeted
Getting Started with Agora Conversational AI nitter.cf/i/broadcasts/1pKdRDvrb…
Jay F retweeted
Built @typesafeai Jev with @AgoraIO to control my Mac by voice - play a video, open folders, navigate the web, and close tabs.
Here’s a quick demo 👇
Thank you @BhosalePratim for the inspiration and @hermes_f for the video editing cool tricks from @OpenAIDevs
I've always wanted a way to talk to my Mac and do things on the go.
Until now, it was super slow.
So I built Macbrow.
Voice-controlled browser and computer-use agent.
Built using @GradiumAI @browser_use and @typesafeai
Still early and a work in progress.
github.com/timpratim/macbrow
Jay F retweeted
Tone and delivery shape how spoken communication is understood, and Google’s latest Gemini 3.8 Flash TTS and Flash-Lite TTS models address a persistent limitation in voice AI by giving developers finer control over how generated speech sounds and adapts throughout a conversation.
We’re excited about the new models’ ability to direct emotion, pace, character, and accent – plus a library of 20,000+ voices!
Our thoughts on what this opens up for real-time voice builders: agora.io/en/blog/a-new-gener…
Jay F retweeted
Vercel will be officially sponsoring tailwindcss.com. That's a given. We as a community and industry owe @adamwathan and team a lot. Tailwind is foundational web infrastructure at this point (it fixed CSS 😉). I've also reached out to Adam to explore how we can make this a longer-term commitment.
Jay F retweeted
RIP Bram Moolenaar – 1961-2023
groups.google.com/g/vim_anno… – at San Francisco, CA
ALT RIP Bram Moolenaar (image of vim editor)
Jay F retweeted
Argentina wins the World Cup!!!!!!
Messi is the greatest of all time!!
Legendary player. Legendary game. The greatest sporting event I've ever seen in my life.
I love you all!!!!!!!!!!
Jay F retweeted
Let's go Messi and Argentina!!
I'm watching the game live while running on a treadmill, otherwise I would die of stress over the game.
Jay F retweeted
leftists unable to understand inflation due to high currency emission will now be a constant in american politics.
Wondering why your Thanksgiving groceries cost more this year? It’s because greedy corporations are charging Americans extra just to keep their stock prices high. This is outrageous. businessinsider.com/big-comp…
