Fanglin Lu (@FanglinLu) header
Fanglin Lu (@FanglinLu) profile picture

Senior Software Engineer @ Google DeepMind

Palo Alto, CA
Joined October 2011
Photo by Fanglin Lu (@FanglinLu)Photo by Fanglin Lu (@FanglinLu)
Fanglin Lu retweeted
How long have you been "planning to understand" how modern LLM inference works? We just gave you a readable version of SGLang you can finish over the weekend. Introducing mini-SGLang ⚡ We distilled SGLang from 300K into 5,000 lines. Kept the core design, cut the complexity. Without sacrificing performance — nearly identical to SGLang online. It is built for engineers, researchers, and students who want to see how inference really works and learn better from code than papers. ⭐ Star us on GitHub: github.com/sgl-project/mini-… 🧵 (1/3)
33
186
47
1,204
243,772
Fanglin Lu retweeted
A survey of LLMs with a practical guide and evolutionary tree. Number of LLMs from Meta = 7 Number of open source LLMs from Meta = 7 The architecture nomenclature for LLMs is somewhat confusing and unfortunate. What's called "encoder only" actually has an encoder and a decoder (just not an auto-regressive decoder). What's called "encoder-decoder" really means "encoder with auto-regressive decoder" What's called "decoder only" really means "auto-regressive encoder-decoder" github.com/Mooler0410/LLMsPr…
75
694
69
2,931
649,706
Today developers can start building with our first version of Gemini Pro through Google AI Studio at ai.google.dev.  Developers have a free quota and access to a full range of features including function calling, embeddings, semantic retrieval, custom knowledge grounding, chat functionality and more. It supports 38 languages across 180+ countries. Gemini Ultra is coming early next year. We’re excited to see what you build! blog.google/technology/ai/ge…
250
1,016
169
5,683
1,495,860
Thrilled about the Gemini API launch on Vertex AI today! 🎉 Proud to have contributed to the launch with the amazing team behind it.🚀 cloud.google.com/blog/produc… #GeminiAPI #VertexAI #GenAi #GoogleDeepmind
80
Seven of @naval’s favorite books:
73
765
8
4,649
What's the best book on entrepreneurship that you read?
1,585
356
65
3,369
There is so much wisdom in this book "The Almanack of Naval Ravikant". I agree on almost every single word in this book. Today I am inspired by this one "Your real resume is just a catalog of all your suffering."
1
A distillation of what @naval said on Clubhouse last night:
254
1,555
208
8,584
Fantastic workshop at UPenn about consulting. Thank you Zack for the great talk! @oystir @zmarks215 @RudyBellani – at Philadelphia, PA
1
1