
Ship AI Today / Core team @0xSMW @SSabev @brunotorious @abielzulio
San Francisco, CA
Joined February 2023
- Tweets52
- Following4
- Followers111
- Likes37
Refreshed LLM Leaderboard with the hardest benchmarks for today's leading models.
klu.ai/llm-leaderboard
Refreshed the @klu_ai LLM leaderboard with a new section for the hardest benchmarks on multi-modal models, including GAIA scores (no tools, scratchpad for thinking).
klu.ai/llm-leaderboard
2
1,634
Today we updated our LLM Leaderboard to include GPT-4o Mini, along with additional benchmark data and visualizations klu.ai/llm-leaderboard
Klu.ai retweeted
time to retire MMLU, HellaSWAG, HumanEval, BBHard, GSM8K, and many other benchmarks.
leading models rank in/near 90th percentile.
GPQA, MMMU, BigCodeBench, GAIA, QUAKE, and others offer better measures for 2024 and beyond.
klu.ai/llm-leaderboard
QUAKE: A new benchmark reveals frontier AI models score only 28% on practical tasks, despite 80%+ on standard evals – here's why it matters...
Finetuning and evaluation made possible with Klu.ai platform. The fastest way to optimize your LLM-powered features.
"We become what we behold. We shape our tools and then our tools shape us."
This Post is from an account that no longer exists. Learn more
Excited to test out further, but early prompts are looking quite nice. Very strong logic when debugging typescript with multiple dependencies.
We’re announcing a new optimised model today! Mistral Large has top-tier reasoning capacities, is multi-lingual by design, has native function calling capacities and a 32k model. The pre-trained model has 81.2% accuracy on MMLU.
Learn more on mistral.ai/news/mistral-larg….
Mistral Large is available on la Plateforme, as well as on Azure, following our commitment to bring frontier AI everywhere. We're eager to see what developers do with Mistral Large!
This week Gemini Pro came out for developers, but was largely overshadowed by Google's demo controversy and the release of Mixtral.
Overall, Gemini Pro is a good alternative to gpt-3.5-turbo – let me show you what we found.
klu.ai/blog/gemini-pro-vs-gp…
Gemini Pro is better at reading comprehension and instruction following than gpt-3.5-turbo in real-world scenarios. It's a good model, just a bit tarnished by the Google vibes. (PS. Correct answer here is D)
1
325
You had me at Supafly.
LW🆇 Day 5 - Build Stage 🏗️ announcement
Fly Postgres, a managed Postgres offering jointly developed by Supabase and @flydotio.
Learn more: supabase.com/blog/postgres-o…














