TileRT (@TileRT_AI) profile picture

TileRT

@TileRT_AI

Tokens, in a blink.⚡️ Ultra-low latency inference. [email protected]

tilert.ai
Joined May 2026
  • Tweets18
  • Following3
  • Followers881
Ultra-High Interactivity on NVIDIA GPUs? TileRT InferenceX Can TileRT software on NVIDIA GPU compete with Cerebras, Groq LPU, SambaNova? Batch Size 1, Disaggregated engine, High throughput prefill engine, High interactivity decode engine newsletter.semianalysis.com/…
Ultra-High Interactivity on NVIDIA GPUs? - TileRT InferenceX

Ultra-High Interactivity on NVIDIA GPUs? - TileRT InferenceX

Can TileRT software on NVIDIA GPU compete with Cerebras, Groq LPU, SambaNova? Batch Size 1, Disaggregated engine, high throughput engine Prefill, high interactivity engine decode

newsletter.semianalysis.com
3
12
5
131
44,917
TileRT retweeted
jietang (@jietang) profile picture
jietang
@jietangMay 22
GLM-5.1-highspeed is coming, 400 tokens per second. Very expensive, but bring a new possibility.
Image from jietang (@jietang)
41
25
12
598
56,715
Load more