AI Developer Cloud. AI infrastructure developers trust. https://nitter.cf/t.co/PWVZocfp6D
Joined March 2022
- Tweets865
- Following18
- Followers9.6K
- Likes856
Pinned Tweet
Someone died at a haunted masquerade ball. Five suspects will answer anything you ask, and at least one of them is lying.
Build "Murder at Hollow Manor" with Qwen3 32B and FLUX.1 Schnell on Runpod Public Endpoints 🎃runpod.io/blog/halloween-mys…
“Mixed precision halves your training memory.”
We did the math and found that it doesn’t.
Here's what we found: runpod.io/articles/guides/fp…
Serverless workers cost about 2.3x more per taken than a Pod.
Anything below that, Serverless wins. More than that? Go with Pods.
We benchmarked both in the article here:
runpod.io/blog/serverless-gp…
Batch Inference is now generally available on Runpod Serverless.
Batch runs on dedicated workers that are separate from your /run traffic, so a large job doesn’t take workers away from interactive requests.
runpod.io/blog/batch-inferen…
A big embedding backfill hits your max workers limit though nobody is waiting on it.
Batch Inference on Serverless takes up to 3 million requests a day on dedicated workers, on your own model.
Limits depend on your account.
runpod.io/blog/batch-inferen…
Join Runpod and @bem_hq for drinks, games and good conversation during MLOps World!
Meet the teams building AI infrastructure, catch a few quick lightning talks, and stay for the raffle.
Monday, November 16, 6 to 8pm at Tapville Social, Austin.
Space is limited, so register early: lu.ma/runpod-bem-austin
Wondering what changed in AI compute this year?
We have the data, and we'll share it with you on Thursday.
Register through the link below; we have a session at 6 am PT & 11 am PT!
resources.runpod.io/where-ai…
We’ll be at Open Data Science Conference (ODSC) West in Burlingame this week.
250+ speakers and 9 tracks covering everything from AI infrastructure to agentic systems.
Come and find us there.
PS: Don't miss Greg Wester's talk on Tuesday at 2:35 PM.
Gemma’s share of Runpod text endpoints:
March: 5.5%
April: 18.2%
July: 12.4%
The release spike was real. So was the pullback. July adoption still stood at more than twice its March level.
runpod.io/reports/fall-2026-…
Community feedback told us to update our PyTorch templates.
The new lineup covers PyTorch 2.6, 2.7, 2.8, 2.9, 2.12, and 2.13. Each version is available with several CUDA versions.
Find the full breakdown here: runpod.io/blog/rebuilding-py…
What does AI compute look like right now?
We used aggregated trends from across the platform to find out.
Next week, we'll take you through all the findings. Register through the link below:
resources.runpod.io/where-ai…
GLM-5.3 is live on our public endpoints.
Built by @Zai_org, it's especially good at code generation and handling multi-step agentic workloads.
Find out how to get started here: runpod.io/blog/getting-start…
Three of our GPU fleets are on track to more than double by December.
So if you've been sizing workloads around what's available rather than what you need, more room is coming.
runpod.io/reports/fall-2026-…
Architectural renders in minutes, not days.
Gendo moved to Runpod Serverless in two days, saved 100+ hours on DevOps, and saw a 5x increase in throughput.
runpod.io/case-studies/gendo…
Cal Hacks 13.0 is taking place this week.
A 36-hour hackathon at one of the best venues of SF: the Palace of Fine Arts.
If you're a student, come build with us!
Register here: calhacks.io/
PyTorch Conference is happening this week in San Jose and we’ll be there.
Come say hi if you’re working on training, inference, or anything PyTorch.
PS: You can register through the link in the comments 👇
events.linuxfoundation.org/p…
If Nix is how you manage your environment, Flash now fits right in.
nix run github:runpod/flash gives you the CLI with everything pinned.
Read more about it here:
runpod.io/blog/flash-nix?utm…
