nvidia-smi says 100% utilisation.
No training job is running.
Welcome to ghost GPU usage — zombie processes holding CUDA contexts, and the teardown code nobody writes.
Debug story: runaker.medium.com/ghost-gpu…
#MLOps #GPU
28
Pre-save my new single "The Stormcrow — A Five Nations Saga" on Spotify: distrokid.com/hyperfollow/ru… (powered by @distrokid)
From Unicorn Hunts to Kaizen: Building the Team I Dreamed Of, by @bjorn9run open.substack.com/pub/runake…
30
I just published The GPU Can Run All Night. You Can’t. medium.com/p/the-gpu-can-run…
24
Muso no Ichi: The Discipline of One Cut, by @bjorn9run open.substack.com/pub/runake…
7
I just published The Sim-to-Real Gap Isn’t About Physics. It’s About Time. medium.com/p/the-sim-to-real…
16
From Simulation Chaos to Real-World Calm: Building Oscillation-Proof Drone AI, by @bjorn9run open.substack.com/pub/runake…
11
The Indifferent Algorithm: When Matching Feels Like Unrequited Love, by @bjorn9run open.substack.com/pub/runake…
9
Why Agentic AI Assistants Require Multiple LLMs to Handle a Single Complex Request, by @bjorn9run open.substack.com/pub/runake…
26
I just published Forging the Digital Mjölnir: A Swedish Text Analysis Saga link.medium.com/pQC68yqNFNb
19
I just published The AI Acceleration Showdown: vLLM vs. TGI in the Race for Efficient LLM Deployment link.medium.com/o35WgiqHXMb #IamIntel
I just published The Hidden Dangers of Free SSL: Why Your Critical Services Might Be a Hacker’s Paradise link.medium.com/5AI7BZn1MMb
21
I just published Unleashing Multimodal AI: Building Scalable Solutions with LlaVA and BridgeTower link.medium.com/dUHrR3VshLb
Dive into our latest article: "Unleashing Multimodal AI: LlaVA & BridgeTower in Action."
1
17
I just published Enhancing Mixtral 8x22B with Vision: An On-Premises Solution for Intel Gaudi link.medium.com/T6GoJO3qHKb
17
I just published Optimizing Mixtral 8x22b for Gaudi 2 link.medium.com/oWQlyn7m6Jb
Let me know if you have ideas for further optimizations.
20
Running Mixtral on Gaudi 2 Server
runaker.medium.com/step-by-s…
24

