Introducing interpolated FID: an variant of reconstruction FID that is highly correlated to diffusion generation FID.
It is well known that VAE rFID is not correlated with diffusion gFID. We propose a simple variant that achieves correlation 0.9!
huggingface.co/papers/2603.0β¦
Shady Abu-Hussein retweeted
DeciMamba, the first context extension method for Mamba, is accepted to #ICLR2025! π
New revision with more long-context results:
arxiv.org/abs/2406.14528
github.com/assafbk/DeciMamba
Special thanks to @ItamarZimerman @ShadyAbh @nadavcohen @amirgloberson @liorwolf @RGiryes !
Shady Abu-Hussein retweeted
I am happy to share that LiveXiv accepted to ICLR 2025 π₯³
Introducing LiveXiv, a new, challenging and maintainable scientific multi-modal live dataset
Paper: arxiv.org/abs/2410.10783
Github: github.com/NimrodShabtay/Livβ¦
Dataset: huggingface.co/datasets/Liveβ¦
Shady Abu-Hussein retweeted
Introducing LiveXiv, a new, challenging and maintainable scientific multi-modal live dataset
Paper: arxiv.org/abs/2410.10783
Github: github.com/NimrodShabtay/Livβ¦
Dataset: huggingface.co/datasets/Liveβ¦
Shady Abu-Hussein retweeted
Excited to announce that our paper on efficient diffusion models has been accepted to NeurIPS! Huge kudos to @ShadyAbh for the incredible work. Developing carefully the math and implementing it to achieve strong results took a lot of effort, and it great to see it pay off!
(1/6) π New Paper! π
Is it possible to sample images from a diffusion model using less than one step?
Answer: Yes! β‘οΈ We present UDPM, a novel approach to image generation that outperforms existing models in efficiency and quality. ππ
arxiv.org/abs/2305.16269
Shady Abu-Hussein retweeted
Code is now available:
github.com/assafbk/DeciMamba
(1/6) π New Paper! π
Is it possible to sample images from a diffusion model using less than one step?
Answer: Yes! β‘οΈ We present UDPM, a novel approach to image generation that outperforms existing models in efficiency and quality. ππ
arxiv.org/abs/2305.16269
(5/6)
* UDPM has an interpretable and interpolable latent space, making it superior to traditional DDPMs in various applications. ππ
* UDPM has smaller latent variables, hence one may modify the noise maps of each step and study its effect on the generated image:
1
3
201
(6/6)
* Check out our code and explore UDPM for your projects: github.com/shadyabh/UDPM/ π»π
* Read the full paper here: arxiv.org/abs/2305.16269 ππ¬
#AI #MachineLearning #ImageGeneration #Research #DeepLearning #DiffusionModels #FastGeneration
4
222
Shady Abu-Hussein retweeted
New Work! π
What prevents Mamba from extrapolating to sequences that are significantly longer than those it was trained on?
Furthermore, can Mamba solve long-range NLP tasks using short-range training only?
π§΅π§΅π§΅
Shady Abu-Hussein retweeted
UDPM: Upsampling Diffusion Probabilistic Models. arxiv.org/abs/2305.16269
Shady Abu-Hussein retweeted
I like the idea behind "Upsampling Diffusion Probabilistic Models" (arxiv.org/pdf/2305.16269.pdf).
Instead using a fixed sized noised sample, use a smaller sized sample for noiser timesteps














