Moss (YC F25)

Where you run AI matters. Running everything in the cloud isn't always the best option. Latency, cost, and privacy all come into play, especially when you're building AI products for real users. We break down the trade-offs between running AI in the cloud, at the edge, on devices, and in the browser, and what to consider when choosing the right setup. moss.dev/blog/run-ai-where-y…

An AI agent can have the right context and still feel slow. Retrieval gets the information to your agent. Inference determines how quickly it can start responding. With Moss Inference, we're bringing optimized LLM inference and retrieval together on the same host, targeting sub-200ms inference latency. We're opening the private beta to teams pushing the limits of real-time AI. Request access → moss.dev/product/inference

AI infrastructure costs go beyond your cloud bill. Every service adds latency, complexity, and another thing to maintain. We break down the hidden costs of AI infrastructure and what to consider when building for production. moss.dev/blog/the-hidden-cos…

We’ve brought retrieval closer to the agent. Now we’re tackling the next bottleneck: inference. Moss Inference runs alongside retrieval on the same host, delivering sub-200ms inference latency for production AI agents. We’re opening up private beta access for teams building real-time and long-horizon agents. Request access → moss.dev/product/inference

Most agentic apps run retrieval as a separate step before the model sees anything. Moss Inference folds search into the chat call. User query → automatically search Moss index in milliseconds → search results enrich the prompt → model responds Faster time to a response, no tool calls needed, and fewer tokens used. Same OpenAI request shape. Change the base URL and the key, and your existing client works. Follow @usemoss to learn more about our upcoming beta. See the full endpoint details here: docs.moss.dev/docs/api-refer…

Search that stays on the device, across more than one index. Context, without the wait. Our Android SDK is now available. Kotlin, arm64-v8a, minSdk 24. Moss now… → Loads indexes and runs queries on the device, with sessions that save and load from disk → Searches several loaded indexes in one call and returns the global top results → Lets apps answer searches from their own indexes, under signing-certificate or permission policies → Throws typed exceptions for every failure Also in this release, across all Moss SDKs: → Embedding runs in batches of at most 512 padded tokens, down from 8,192, so large document adds need less memory → Session snapshots save to a default directory when you don't pass a path → moss-litelm embeds each document on its own, so its vector matches the vector of its text embedded alone Context, without the wait. Check out all the details from the latest updates docs.moss.dev/docs/changelog

80% of Moss customers use @livekit. 👀 LiveKit handles real-time voice. Moss handles the retrieval. Together, your agent gets the context it needs on every turn, automatically. No tool call. No extra roundtrip. No dead air. Sub-10ms retrieval for voice AI. → moss.dev/integrations/liveki…

Your website is still waiting for someone to answer. It doesn't have to. Meet the new Founding Agent. A Voice AI agent that answers questions, talks to visitors, and books meetings. New portal. More customization. Much easier to manage. Try it live: moss.dev/foundingagent

What if retrieval didn't need to be another network request? Load the index into your application. Query it locally. Get your context back in milliseconds. That's Moss.