Pinned Tweet
Libra by GreenBitAI — a fully offline, local AI Agent OS.
Powerful AI agents running 100% on your device. No cloud. No data leaving your hardware.
See it live at #VivaTech2026 👇 @VivaTech
#LocalAI #AIAgents #OnDeviceAI
1
250
A 113 GB model on a MacBook Pro with 48 GB of unified memory.
In a GreenBitAI benchmark, gbx loaded parts of the model from SSD as needed and generated text at ~11 tokens/s.
See how it works in our #electronica2026 recap.
#GreenBitAI #LocalAI #EdgeAI #electronica2026
“Two fingers.” “Close hand.” “Rock sign.” 🤘 At electronica 2026 in Munich, this robotic hand responded to spoken commands using GreenBitAI’s voice model and inference engine. #electronica2026 #GreenBitAI #Robotics #RoboticHand #EdgeAI #VoiceControl
7
75
Day 1 at #electronica2026: multilingual TTS, a voice-controlled robotic hand and face-to-face exchanges at Giantec’s booth.
GreenBitAI provides model customization and the inference engine for GTA1000’s on-device voice AI.
Thanks to everyone who stopped by!
📅 Nov 10–13 | Hall C6 · Booth 421
1
8
119
Behind the demos: GTA1000 voice AI.
- ASR, language understanding & TTS fully on-chip
- <700 ms response; data stays local
- GreenBitAI 1–4 bit models; full pipeline in a few hundred MB
- ~530 mW typical voice-interaction power
- No internet or subscription fees
web: gruenbit.cn
38
How can large AI models run on devices with limited memory and power?
Meet GreenBitAI at #electronica2026 and explore the GTA1000, featuring fully offline voice AI powered by 1–4 bit model compression.
📅 Nov 10–13 | Hall C6 · Booth 421
#EdgeAI #OnDeviceAI
Fish Audio’s Drama 3 TTS now runs locally on Apple silicon with gbx-lm 🎙️
• 2.6x real time on 64 GB+ Macs, still runs on a 48 GB MacBook
• Zero-shot voice cloning, across languages
• OpenAI-compatible streaming API
huggingface.co/GreenBitAI/Dr…
Built with Fish Audio
78
GreenBitAI retweeted
⚡ Inside DeepInfer
🔹 High-performance kernels & optimized inference engine
🔹 Distributed inference & speculative decoding
🔹 SWA Bounded Replay & structured outputs
Inference code for future DeepSeek models and ongoing optimizations will land here too.
2/4
DeepSeek's new V4.1-Flash-1017, running locally on a Mac.
Our 4-bit build on one M3 Ultra Mac Studio: • ~22 tok/s decode • ~44 tok/s on code with DeepSeek's draft head (1.99×) • ~33 tok/s chat
Why it's worth running locally: DeepSeek reports 77.0 on DeepSWE v1.1 (from 74.2) and 42.3 on Terminal-Bench 4.0 (from 31.2), with shorter outputs.
An agentic coding model that now stays on your own machine.
1
53
It works with Claude Code and Codex out of the box; setup in the model card.
Model: huggingface.co/GreenBitAI/De…
Engine: github.com/GreenBitAI/gbx-lm…
@deepseek_ai
1
39
We ran a 105 GB Qwen model on a 48 GB MacBook Pro: ~11 tok/s decode, 32 GB peak memory, experts streamed from the SSD.
gbx v0.8.0, our local LLM engine for Apple Silicon, is out. 🧵
How it works: • cost-aware adaptive speculative decoding • mixed-precision draft head • elastic expert memory that streams MoE experts from the SSD • fused kernels for MLA, linear attention, Hyper-Connections
One shared layer: Qwen3.5/3.6/3.8, GLM-5.3, DeepSeek-V4.1-Flash.
1
49
Full write-up with methodology: medium.com/@semamediadata/ru…
Download: github.com/GreenBitAI/gbx-lm…
Models: huggingface.co/collections/G…
Which model would you run locally next?
26




















