Wappy (@Wappy_x) header
Wappy (@Wappy_x) profile picture

You're going to like the way you look. I guarantee it Building Vade

Joined March 2020
Am I the only one who thinks it's insane that the UFC is charging $300 for nosebleed tickets to fight night?
88
Finair and Google fucked up yet both fuck me
1
228
Right to the hall of fame
3
233
Incredible timeline iv curated
3
283
Wappy retweeted
“are you free after work?” bro, I’m free during work fuck this shit
61
8,727
263
116,150
1,767,061
I thought I liked almonds, but I just tried some unsalted ones and it turns out I actually just like salt.
70
379
34
12,446
135,488
My Codex is about to reset and I have 3 banked resets... Its going to be a fun weekend
1
4
459
Jensen, here me out Nvidia 2
4
266
Muse really is wonderful
6
416
Is this bullish or bearish for sparks?
$NVDA - *NVIDIA PREPARING TO OUST NVIDIA CEO JENSEN HUANG: WSJ
8
428
Guac City Bitch
8
467
Probably as good as it is going to get tonight! About to boot it up, but I am very happy with how it turned out
Sparks getting a new home #nicerack #rackcity
39
14
7
380
20,141
Sparks getting a new home #nicerack #rackcity
17
7
3
179
19,277
This is what hill climbing GPU kernels looks like GLM 5.3 Flash on Vade. Single chat prose, 2 DGX Sparks, exact FP4, drafting off. Nov 4: no replies at all Nov 5 to today: 0.13 → 1.1 → 2.3 → 5.1 → 10 → 12.7 tok/s All Rust, down to the kernels. No third-party crates. Same answer on 2 or 4 Sparks. Follow the progress Vade.lol/results/
Last night ~5 tok/s >> work overnight >> pushing ~10 tok/s
2
9
736
Last night ~5 tok/s >> work overnight >> pushing ~10 tok/s
Brick by brick, the Vade hill climb on GLM 5.3 Flash continues. Six hours ago Vade was serving FP4 single chat prose on 2 Sparks at about 2.3 tok/s. Tonight it broke 5, still with drafting off. 2.297 → 3.022 → 3.764 → 4.788 → 5.068 The wait for the first token went from 17.5 seconds to 4.5s, and the model loads in 67 seconds, down from 258s. Everything in Vade is written in Rust, even to the GPU kernels, and nothing comes from a third-party crate. Keep track of the hill climb and see the code at vade.lol
1
1
8
1,021
Brick by brick, the Vade hill climb on GLM 5.3 Flash continues. Six hours ago Vade was serving FP4 single chat prose on 2 Sparks at about 2.3 tok/s. Tonight it broke 5, still with drafting off. 2.297 → 3.022 → 3.764 → 4.788 → 5.068 The wait for the first token went from 17.5 seconds to 4.5s, and the model loads in 67 seconds, down from 258s. Everything in Vade is written in Rust, even to the GPU kernels, and nothing comes from a third-party crate. Keep track of the hill climb and see the code at vade.lol
Earlier today GLM just had its first heartbeats on Vade Vade is an inference engine I've been building for the NVIDIA DGX Spark. It's all Rust, with no third-party crates, and it runs on its own GPU kernels. The whole point is that the same request gives you the same answer every time, whether it runs on 1, 2 or 4 Sparks, and whether your chats are processed alone, batched or cached. Two days ago GLM Flash wouldn't even load. Today it runs next to Qwen Flash. Over the day I got FP4 single-chat prose on 2 Sparks from 0.129 to 2.295 tok/s, with drafting off: 0.129 → 0.441 → 0.916 → 1.092 → 1.138 → 1.309 → 1.391 → 2.295 That's still slow, and I know it. But it works, and it's exact. Qwen FP4 on the same 2 Sparks does 37.8 tok/s without drafting, so I know I can improve it a lot with some hill climbing. Install, code and results can be found on vade.lol
4
1
19
1,200
Earlier today GLM just had its first heartbeats on Vade Vade is an inference engine I've been building for the NVIDIA DGX Spark. It's all Rust, with no third-party crates, and it runs on its own GPU kernels. The whole point is that the same request gives you the same answer every time, whether it runs on 1, 2 or 4 Sparks, and whether your chats are processed alone, batched or cached. Two days ago GLM Flash wouldn't even load. Today it runs next to Qwen Flash. Over the day I got FP4 single-chat prose on 2 Sparks from 0.129 to 2.295 tok/s, with drafting off: 0.129 → 0.441 → 0.916 → 1.092 → 1.138 → 1.309 → 1.391 → 2.295 That's still slow, and I know it. But it works, and it's exact. Qwen FP4 on the same 2 Sparks does 37.8 tok/s without drafting, so I know I can improve it a lot with some hill climbing. Install, code and results can be found on vade.lol
3
2
1
23
2,440
I’ve been waiting over a month for this moment
47
6
5
342
9,333
I updated the Vade website with a results section. So you can see every benchmark I run while building this. vade.lol/results/ I'm announcing a soft launch of Vade, a pure Rust inference engine for the DGX Spark. The GitHub is public now and it is Apache 2.0 github.com/wappy-x/Vade I did a fresh install of Vade tonight and ran the same prompts on 1, 2 and 4 Sparks on FP4. I got the same answers on all three setups, word for word throughout the entire conversation. I am calling it a soft launch because I'm still trying to improve the install experience and improve multi spark features and performance. So more changes, features and model support to come!
I will likely be flipping Vade from private to public today. For the most part, Qwen Flash Next at various quants (FP4 & FP8) is working great on 1x, 2x and 4x Spark setups. Vade is an inference engine currently built for the DGX Spark platform. It is written entirely in Rust with no dependencies. Even the GPU kernels are Rust. There is no vLLM or SGLang under it. It was built around one principle: same question, same answer, every single run, on every box. It also ships with a CLI and an agent harness, so you can chat with it and put agents to work right out of the box. Or skip Vade's harness and bring your own. It speaks the OpenAI API, so Claude Code, Codex or your own harness can point straight at it. Coming soon to Vade.lol
1
8
651
At the plant store capturing rares and super rares
3
321