The video of my keynote talk at this year's @EmbVisionSummit is now published.
Scaling Down is the New Scaling Up
youtu.be/amdqNKnNL-s
1
6
2,640
We just released MobileMoE, first sub-B-active-parameter MoE language model family.
MoE isn't just for 100B+ parameter models on servers. At sub-B scale, sparse expert routing lets you match dense models at 2-4x fewer FLOPs while fitting in mobile DRAM.
arxiv.org/pdf/2605.27358
At Meta Connect today, we announced a set of AI tools that let us create immersive worlds, just from natural language prompts. We created first of its kind foundational GenAI models that enable rapid and high quality content creation.
3
231
Introducing MVDiffusion++. Our recent work presents a neural architecture for 3D object reconstruction that is able to generate dense, high-resolution images conditioned on single or multiple unposed images.
Project: mvdiffusion-plusplus.github.…
Paper: arxiv.org/abs/2402.12712
#GenAI
3
186
Our recent work: Improved Training of Supernet with Alpha-Divergence
AlphaNet outperforms prior-art models including BigNAS, OFA networks, FBNetV3, and AttentiveNAS. We achieve ImageNet top-1 accuracy of 80.0% with only 444 MFLOPs.
arxiv.org/pdf/2102.07954.pdf
Brilliant essay by Ronald Ross (1902 Nobel laureate in medicine) on his work on malaria.
nobelprize.org/uploads/2018/…
#NobelPrize #Nobel
2
ScaleNAS: A one-shot learning method for scale-aware representations. ScaleNAS is the first of its kind one-shot NAS method that considers scale variance for multiple vision recognition tasks (semantic segmentation, human pose estimation)
Paper: arxiv.org/pdf/2011.14584.pdf
2
4
A unified framework that restores high-quality videos in real-time on edge devices. It has 958X fewer MACs as compared to state-of-the-art deformable convolution-based network while delivering similar or better performance.
Paper: arxiv.org/pdf/2012.02228.pdf
6
Thank you @CarnegieMellon and @CMUEngineering for sending these awesome updates to alums few times a year. I always look forward to catching up on all the phenomenal research happening at CMU!
There is a heated debate going on in my house over this stupid soft toy. I firmly believe that "A" is the correct orientation (the green thingy is the nose). My kids are adamant that the orientation has to be "B" (apparently the green thingy is a hat).
What do you think?
8
5
Just noticed my wine collection. Looks like someone is trying to blend in 😊#diversity #inclusion
3
3
Someone held the door for me when I was at Stanford today. We were both heading out so we started chatting. He said his name was Martin Hellman! I gingerly asked him if he was THE Hellman from Diffie-Hellman and he just smiled and nodded. Love these kind of random interactions 😊
8















