Pinned Tweet
LLMs can do complex math—but struggle with sorting numbers? We announce LLMThinkBench to evaluate how LLMs reason (or overthink) with basic math reasoning.
Huge thanks to Dr. Xuan Wang (@xwang174), Dr. Tu Vu (@tuvllms), Dr. Christine Julien (@drcjulien), Aafiya, and Sriram!
Gaurav Srivastava retweeted
Hindsight is a collaboration between @Vectorizeio @washingtonpost and researchers @SanghaniCtrVT (Gaurav Srivastava @xwang174 @profnaren). It is based on this research: arxiv.org/abs/2512.12818
With 91% accuracy, open source Hindsight agentic memory provides 20/20 vision for AI agents stuck on failing RAG
venturebeat.com/ai/with-91-a…
Gaurav Srivastava retweeted
BeyondBench: Contamination-Resistant Evaluation of Reasoning in Language Models
Main proceedings
@ctrlgaurav @aafiya_hussain @zhenyubvt @pitre_priya Meng Lu @xwang174 (all VT) w/Swastik Roy, Morteza Ziyadi @Amazon AGI
arxiv.org/abs/2509.24210
Gaurav Srivastava retweeted
The International Conference on Learning Representations (@iclr_co) has convened in Rio de Janeiro, Brazil, and runs through April 27. A number of @SanghaniCtrVT faculty and students are presenting their research. See 🧵in no particular order.
Gaurav Srivastava retweeted
Building agentic systems using Small Language Models (as opposed to large cloud models) is faster and cheaper.
Here's a library a very promising library that can help you
github.com/ctrl-gaurav/effGe…
Gaurav Srivastava retweeted
Welcome to join our 𝗔𝗖𝗟 𝟮𝟬𝟮𝟱 𝗕𝗶𝗿𝗱𝘀-𝗼𝗳-𝗮-𝗙𝗲𝗮𝘁𝗵𝗲𝗿 (𝗕𝗼𝗙) 𝘀𝗲𝘀𝘀𝗶𝗼𝗻: 𝗕𝗿𝗶𝗱𝗴𝗶𝗻𝗴 𝗛𝘂𝗺𝗮𝗻 𝗦𝘁𝘂𝗱𝘆 𝗮𝗻𝗱 𝗟𝗟𝗠 𝗔𝗴𝗲𝗻𝘁𝘀 𝗳𝗼𝗿 𝗦𝗼𝗰𝗶𝗮𝗹 𝗦𝗶𝗺𝘂𝗹𝗮𝘁𝗶𝗼𝗻!
🌐 Website: lnkd.in/eq5n3vTz
@aclmeeting @priyapitre @ctrlgaurav
🧠 Fully open-source and customizable
👇 Try it:
📦pip install llmthinkbench (pypi.org/project/llmthinkben…)
🔗 github.com/ctrl-gaurav/LLMTh…
🆕 v0.1.5 is live with better error handling, fallback support, and multi-GPU parallelization!
Stay tuned—benchmark results on 50+ LLMs coming soon!





