Halogen

Run your own @liquidai LFM3-1.7B on the @AIatAMD Strix Halo NPU. Halogen 0.18.21 is out. Your checkpoint or fine-tune, up to ~38 tok/s Full 262k context Long NPU requests no longer stall behind a reply github.com/peonist-ai/haloge…

Halogen 0.18.20 for Strix Halo is out. • 2 requests at once ~20% faster, 3 at once ~9% • JSON schemas now work on requests with images • Strict tools enforced with images too • Clear NPU error on old XRT github.com/peonist-ai/haloge…

Running Qwen3.8-Flash-Next on Strix Halo? Halogen 0.18.19 is out. • ~3% faster with 3 requests at once • No more 64-image cap for screenshot agents • Claude Code auto-compacts long prompts • Tool-call fixes #StrixHalo #LocalLLM #qwen github.com/peonist-ai/haloge…

Halogen 0.18.18 is out. • Claude Code sessions with MCP tools keep their prompt cache • ggml-org's official IQ4_NL GGUF now loads • Short requests start during long prompts • Tool-call args with </tool_call> arrive whole Same outputs, same speed. github.com/peonist-ai/haloge…

Halogen 0.18.17 is out. Agents sharing a prompt no longer swap turns on a full KV pool Claude Code MCP tool search works on /v1/messages Tool-call args with markup arrive intact /v1/models reports image support Same outputs, same speed. github.com/peonist-ai/haloge…