Fanglin Lu retweeted
How long have you been "planning to understand" how modern LLM inference works?
We just gave you a readable version of SGLang you can finish over the weekend.
Introducing mini-SGLang ⚡
We distilled SGLang from 300K into 5,000 lines. Kept the core design, cut the complexity. Without sacrificing performance — nearly identical to SGLang online.
It is built for engineers, researchers, and students who want to see how inference really works and learn better from code than papers.
⭐ Star us on GitHub: github.com/sgl-project/mini-…
🧵 (1/3)
Fanglin Lu retweeted
A survey of LLMs with a practical guide and evolutionary tree.
Number of LLMs from Meta = 7
Number of open source LLMs from Meta = 7
The architecture nomenclature for LLMs is somewhat confusing and unfortunate.
What's called "encoder only" actually has an encoder and a decoder (just not an auto-regressive decoder).
What's called "encoder-decoder" really means "encoder with auto-regressive decoder"
What's called "decoder only" really means "auto-regressive encoder-decoder"
github.com/Mooler0410/LLMsPr…
Fanglin Lu retweeted
Today developers can start building with our first version of Gemini Pro through Google AI Studio at ai.google.dev.
Developers have a free quota and access to a full range of features including function calling, embeddings, semantic retrieval, custom knowledge grounding, chat functionality and more. It supports 38 languages across 180+ countries. Gemini Ultra is coming early next year. We’re excited to see what you build! blog.google/technology/ai/ge…
Thrilled about the Gemini API launch on Vertex AI today! 🎉 Proud to have contributed to the launch with the amazing team behind it.🚀
cloud.google.com/blog/produc…
#GeminiAPI #VertexAI #GenAi #GoogleDeepmind
80
Fanglin Lu retweeted
Seven of @naval’s favorite books:
There is so much wisdom in this book "The Almanack of Naval Ravikant". I agree on almost every single word in this book. Today I am inspired by this one "Your real resume is just a catalog of all your suffering."
1
Fanglin Lu retweeted
A distillation of what @naval said on Clubhouse last night:
Fantastic workshop at UPenn about consulting. Thank you Zack for the great talk! @oystir @zmarks215 @RudyBellani – at Philadelphia, PA
1
1












