Pinned Tweet
Passing the Turing test for voice agents.
We just shipped a major ElevenAgents update:
- Lower-latency, smoother turn-taking with new conversational model
- Expressive Mode for contextual emotional delivery
- Available in 70+ languages
Really excited to have @eglyman join me on stage at @ElevenLabs Summit on November 11 in NYC!
Eric is a two-time founder building one of the fastest-growing fintechs - we are happy partners and have used Ramp internally for years. Eric & Ramp team are great: always on, very supportive, technical. And just fun: great taste in how they build, and in how they tell the story to the world.
We’ll get stuck into how to manage token spend, deploying agents to supercharge your business, and true customer obsession.
See you in New York!
Mati Staniszewski retweeted
New from ElevenLabs research: Today we’re sharing more about Cue, our new forced alignment model. It places every character on the audio timeline with more precision than any other aligner we tested. That means the right words show up at the right time.
Forced alignment is the step that turns a transcript into timestamps. It’s how subtitles land on time, how dubbed lines match the speaker, and how clicking a word in a transcript jumps to the moment it was said. Most open-source aligners are built for short, clean clips in a limited set of languages. Cue is one model that handles recordings of any length in a single pass. On real-world audio, it was more accurate than every open-source aligner we tested in all 29 languages of our benchmark. It aligns an hour of audio in about half a second on one GPU.
Cue already powers every Speech to Text transcription on ElevenLabs, and it’s available on its own through the Forced Alignment API.
Read the full post: elevenlabs.io/blog/cue-align…
Mati Staniszewski retweeted
Vercel × @ElevenLabs: 14 models on AI Gateway, 50% off through Nov 9.
• Realtime voice agents
• Music
• Sound effects
• Multi-voice dialogue
• Streaming speech over WebSockets
• Speech to text
vercel.com/blog/elevenlabs-o…
Mati Staniszewski retweeted
Coming to ElevenLabs Summit NYC? So are the CEO of @CustomersBank, @Nasdaq's head of AI, and the head of CX at @interbr.
Sam Sidhu, Doug Hamilton, and Daniela Mineiro join our CFO Ethan Tandowsky on stage Nov 11.
Apply to join: elevenlabs.io/summit/new-yor…
We’re hiring in Australia. Just spent a week with our team in Sydney and Melbourne (incredible!) - 22 people now, 900k users across the region, and Australian data residency for enterprise launching soon.
If you want to build voice and agents from the ground up, get in touch!
Mati Staniszewski retweeted
How Harvey's marketing org is using @figma, @ElevenLabs and @claudeai to:
- Create entire launch films with agents
- Build tailored demo videos for each customer using sales calls and account insights
- Script and voice hundreds of films overnight
While burning 15 billion tokens over 2 weeks.
Deep dive by @gabepereyra and @ShawnFarsai:
How @ShawnFarsai uses @figma @ElevenLabs and @claudeai to create hyper personalized marketing videos with agents
Breaking down language barriers is a big part of why we started ElevenLabs.
Eleven Realtime Translation brings that now to live calls!
This week, we launched Eleven Realtime for voice agents that talk to people. Now we’re opening a limited alpha of Eleven Realtime Translation, for people who need to talk to each other.
Eleven Realtime Translation builds live voice translation into calls. Each person can speak their own language and hear the other person in theirs, in a natural voice, while the call is happening. It works in more than 90 languages and detects each speaker’s language automatically.
Access is open to enterprise customers during the alpha.
New ElevenLabs model.
Our fastest yet for voice agents - Eleven Realtime listens, thinks and replies in under half a second.
Mati Staniszewski retweeted
NTT Docomo Business is trialing a voice agent for older residents of Aizuwakamatsu, Fukushima, built on ElevenAgents.
Heavy snow can make it hard for older residents to leave home in winter. With Takeda Health Foundation and the cooperation of Aizuwakamatsu City, NTT Docomo Business deployed CONN, its AI assistant, to share local information and hold everyday conversations.
Read the full story: elevenlabs.io/blog/ntt-docom…
Mati Staniszewski retweeted
We run our own customer support on ElevenAgents. It’s resolved over 22,000 tickets a month and cut our response time down from hours to 60 seconds.
Our support team already had standard operating procedures for every major kind of ticket, like refunds, billing changes, and voice clone questions. We turned each one into a set of steps the agent follows. The agent can also look up what it needs about a customer, read text, screenshots, and PDFs, reply in the customer's language, take actions, and hand off to our team when a person is needed.
Read how we built it: elevenlabs.io/blog/how-we-so…
Today, Baroness Campbell addressed the House of Lords with an AI recreation of her voice - a first for the UK Parliament.
Proud we could help Baroness Campbell keep her own voice, whenever she needs it.
Today, Baroness Campbell of Surbiton delivered a speech in the @UKHouseofLords using an AI recreation of her voice, built by ElevenLabs. A first for the UK Parliament.
Baroness Campbell has spinal muscular atrophy, which affects her speech. The Baroness has now created an AI voice that replicates the tone, rhythm, and pitch of her original voice.
Our technology has now been used to restore the voices of more than 11,000 people who have lost their voices through injury or illness, and we’ve committed to help one million people living with voice loss around the world.
Mati Staniszewski retweeted
Our team has been in Singapore this week. Here’s a quick roundup:
- We opened our new Singapore office, with 25 of us now on the ground, working alongside customers.
- Business in South Asia means moving between languages. Our CEO @Mati joined CNBC Squawk Box to talk about building localized AI, and why voice AI innovation is starting in Asia and spreading globally.
- We’re also at the Singapore Grand Prix this weekend as an official partner of Audi Revolut F1. If you’ll be there, get in touch.
The video is from over a year ago!
Since then we’ve done a lot of work on how agents should behave when they meet.
Yesterday we joined the group defining the protocol for agent-to-agent interaction - text, APIs, and more - and soon voice too: nitter.cf/mati/status/2108953272…
What happens when a voice agent calls another voice agent?
Right now, neither knows. We're fixing that: synthetic voice detection is rolling out in ElevenAgents, and we’re joining the Personal Agent Protocol (Poppy) group to bring agent-to-agent handshakes to all our agents.
A growing share of calls to businesses aren’t from humans. They’re AI agents acting on behalf of individuals, other companies, and sometimes bad actors.
To help businesses respond, we’re releasing synthetic voice detection in ElevenAgents, and joining the emerging Personal Agent Protocol working group to define how agents interact.
Mati Staniszewski retweeted
We’re partnering with Banner Health to answer patient calls with AI voice agents, starting with primary care scheduling.
Patients call any time of day or night, and ElevenAgents books, reschedules, or cancels appointments directly in Banner’s electronic medical record. When a patient needs a person, the call transfers to a Banner team member with the necessary context.
Read more: elevenlabs.io/blog/banner-he…
ElevenLabs is officially launching in Singapore 🇸🇬
Our new Southeast Asia hub is open, and we're already working with businesses like Funding Societies and Atome.
I'm here all week. If you're interested in building with us, get in touch!
elevenlabs.io/blog/elevenlab…
Mati Staniszewski retweeted
ElevenLabs is officially on OpenRouter.
You can now call 9 Text to Speech models, with up to 90+ languages, and 2 Speech to Text models with speaker labels and word-level timestamps.
All @ElevenLabs models are 50% off, only on OpenRouter, through October 19, 8am PT.
An agent that builds and improves agents!
Introducing Architect:
- Launches agents by typing
- Improves and root-causes issues through simple conversation
- Surfaces new insights proactively