Cheng-I Jeff Lai (@jefflai108) profile picture
San Francisco
Joined October 2022
Photo by Cheng-I Jeff Lai (@jefflai108)
Today, I’m incredibly excited to announce that Kotoba (@kotoba_tech) is joining ElevenLabs (@ElevenLabs) to push the boundaries of voice AI in Japan and East Asia. From day one, Kotoba’s mission has been to build world-class AI models and products from Japan that make a meaningful difference in people’s lives. I’m incredibly proud of what we’ve built over the past three and a half years—from our work on Agentforce and voice AI models powering products at major global companies to our collaboration with YOASOBI and the popular Kotoba translation app. In that time, we grew from two people to a team of 15 and raised more than $23 million, all while staying lean and focused on bringing our research into people’s hands. As proud as I am of what we’ve achieved, I’m even more excited about what we can accomplish with ElevenLabs. With Kotoba’s research talent and deep understanding of the region alongside ElevenLabs’ global leadership in voice AI, we’re building a true dream team! Voice AI is opening up new ways for people to interact with AI and connect across languages. People and businesses in Japan and East Asia deserve the very best of it—and we’re committed to delivering it. Together, we’re taking a major step toward building a frontier AI lab in Tokyo: developing world-class voice AI models for a global audience and accelerating localization to bring the best voice AI products to Japan and East Asia. A huge thank you to Mati (@mati) and Piotr(@dabkowski_piotr) for envisioning this partnership with us. And to the Kotoba team, our investors, partners, friends, and families—thank you for believing in us and supporting us over the past three and a half years. Chapter 2 starts now! Nori
31
53
20
351
23,013
Cheng-I Jeff Lai retweeted
Introducing Live 3: a full-duplex voice model built for real-time voice agents. No more awkward pauses on phone calls or getting interrupted mid-sentence by voice agents. It knows listening cues ("mm-hmm" and "ahan"), understands interruptions, and never cuts in between conversations. Use it here: s.fish.audio/yf7utj
Introducing @FishAudio Live 3: a full-duplex voice model that listens, says "mm-hmm," and knows when to shut up. Enterprise? Book a demo for your free custom agent: s.fish.audio/vxhgs6 Reply with your use case - we'll build it free for the first 1,000 people.
57
27
10
376
23,941
Cheng-I Jeff Lai retweeted
1/ starting today, muse and meta ai will run on new specialized models trained using muse wonder. ACTIVE MEMORY: models can reason across time and better remember what matters ACTIVE FOCUS: enabling muse to continue working towards a goal even when met with roadblocks
168
170
50
2,713
230,011
Cheng-I Jeff Lai retweeted
NVIDIA Nemotron 3 Diarization is now available on ModelScope—adding live speaker attribution to existing ASR workflows without replacing the transcription model. 🎙️ 🤖 modelscope.ai/models/nv-comm… 👥 Processes streaming audio and returns speaker labels and timestamps for up to eight speaker slots in a single conversation. ⚡ Its end-to-end streaming architecture avoids separately combining voice activity detection, speaker embeddings, clustering, and post-processing. 🧠 The 99.2M-parameter model uses a 31-layer Transformer encoder with RoPE and builds on NVIDIA’s Streaming Sortformer architecture. 🔌 Pair it with Nemotron ASR, Parakeet, Canary, Whisper, or another ASR system to create speaker-attributed transcripts. 🏢 Designed for meetings, contact centers, clinical conversations, live captioning, media analysis, and multi-party voice agents. 🖥️ Supports NVIDIA Ampere, Hopper, and Blackwell GPUs, with inference through NeMo Speech C++.
🤖 Made with AI
3
10
1
71
5,141
Cheng-I Jeff Lai retweeted
Big update: @WaveFormsAI was acquired by @Meta. Today at #MetaConnect, you’ll see a little of what we’ve all been building. ✨🤖
21
27
5
340
50,740
Even in chaotic moments, people can be kind
1
13
4,268
Speech‑to‑speech generation eliminates the need for separate (TTS) text‑normalization and prosody modeling, both of which are notoriously hard.
1
1
14
2,200
Free will, so often overlooked, becomes priceless only when it slips away.
2
1,461