Kyle Whitecross (@kswhitecross) profile picture

PhD in CIIR @manningcics. Studying programmatic context management and long-horizon tasks for LLMs. Former research intern @snowflake.

Joined July 2024
My first PhD paper was accepted to CoLM 2026! We found that reasoning LLMs get lost in their own thoughts 💭 As the chain of thought grows, they get worse at retrieving information from their context, even when the reasoning is correct. Here's how we fixed it 🧵
1
2
13
234
Trained on contexts of at most 10K tokens, the gains keep growing out to 128K: up to +16 (Qwen) and +24 (Llama) on RULER, plus big HELMET gains. With my advisor @Negin_Rahimi . See you in SF! #COLM2026
1
27