Satvik Garimella (@satvikgari) header
Satvik Garimella (@satvikgari) profile picture

CS @WesternU | just do it Applied Machine Learning Engineer @shopify

Toronto, Ontario
Joined May 2024
Recently @arjunharinath1 and I started building our own version of Nvidia's Blackwell GPU. We built the ALUs and a 4-lane SIMD core in Verilog. Here is a breakdown of how we did it.
15
24
1
183
12,433
Saksham is genuinely one of the hardest working and most talented people l know. Anyone would be lucky to have him.
looking for a winter 2027 internship! i have experience working with compilers and RTL, and more recently i have been exploring LLM inference serving and optimization. would love to join a team working on similar problems this winter! Canadian citizen, open to relocating. DMs open :)
1
6
275
Satvik Garimella retweeted
looking for a winter 2027 internship! i have experience working with compilers and RTL, and more recently i have been exploring LLM inference serving and optimization. would love to join a team working on similar problems this winter! Canadian citizen, open to relocating. DMs open :)
17
11
3
58
4,091
Satvik Garimella retweeted
JUST IN: Nvidia CEO Jensen Huang Can't Keep His Sperm IN His Pants
2
2
11
1,581
Satvik Garimella retweeted
found the mindmap I made with my handwritten notes when I was learning digital logic systems. seen a lot of people trying to break into HDL and Verilog lately, so sharing it here: boolean algebra, combinational circuits, sequential circuits, latches/flip-flops, MUXes, FSMs, and the Verilog code implementation for each. hope this helps!!
14
13
2
215
8,015
First guy to be posted up beside the Golden Gate Bridge with the clash royal baby dragon 💯💯
2
17
538
Satvik Garimella retweeted
i'm hiring a team of grinders who are early in their careers :) > in-person, full time > downtown Toronto > non-technical > $20-30/hr (depending on experience) job will be doing spatial data QA at a stealth robotics startup, led by ex-execs at Cohere, NVIDIA, Apple. pls shoot me a message or help me out by cfbr :)))
346
22
127
921
2,194,442
I’ve always believed u should do something because u enjoy it, regardless of whether ur good at it or not. I used to be absolute trash at basketball, but I still loved playing it, even before I got better. It was the same with DJing for me. I didn’t start because I was good at it, I started because I loved music and wanted to try it. The way I see it, being good at something should never be a prerequisite for enjoying it. If anything, enjoying something is what makes u want to get better at it.
are you good at something because you enjoy it, or do you enjoy it because you're good at it?
10
393
Satvik Garimella retweeted
are you good at something because you enjoy it, or do you enjoy it because you're good at it?
5
1
2
24
2,265
Satvik Garimella retweeted
YOOOOO guys, Snackwell has kernels now :), Last time I said I'd improve shared memory, build an assembler and write vector and matrix programs.Those now run in RTL simulation, along with single head attention. Here's what changed and what I did. 🧵👇
5
5
17
700
YOOOOO guys, Snackwell has kernels now :), Last time I said I'd improve shared memory, build an assembler and write vector and matrix programs.Those now run in RTL simulation, along with single head attention. Here's what changed and what I did. 🧵👇
5
5
17
700
That gave me enough to put together single-head attention. It runs QK^T, scales and masks the scores, applies softmax, then multiplies the weights by V. These are four separate launches, with the simulation runner passing the output memory from one to the next.
1
5
35
Next I'm putting these kernels together into a small transformer block and checking its forward pass. Then I'll add global memory and a runtime so we can load trained weights and run inference on a small model. :)))) Were almost done gang!
5
36
Satvik Garimella retweeted
The lanterns holy trinity 🟩🏮
🤖 Made with AI
1
4
287
The lanterns holy trinity 🟩🏮
🤖 Made with AI
1
4
287
Satvik Garimella retweeted
BREAKING: All-NBA and All-Star center Jalen Duren has agreed to sign a five-year, $200 million fully guaranteed contract to return to the Detroit Pistons, agent Chafie Fields of THE•TEAM tells ESPN. This ends a prolonged restricted free agency dispute between the two sides.
2,504
3,998
4,605
36,505
11,971,597