Daisuke OBA (@dai0NLP) profile picture

Postdoc at @sciencetokyo_en | NLP/ML, Generative models, diffusion LMs, LLM test-time scaling | Ph.D., UTokyo

Joined October 2022
Photo by Daisuke OBA (@dai0NLP)Photo by Daisuke OBA (@dai0NLP)Photo by Daisuke OBA (@dai0NLP)Photo by Daisuke OBA (@dai0NLP)Photo by Daisuke OBA (@dai0NLP)Photo by Daisuke OBA (@dai0NLP)Photo by Daisuke OBA (@dai0NLP)Photo by Daisuke OBA (@dai0NLP)Photo by Daisuke OBA (@dai0NLP)Photo by Daisuke OBA (@dai0NLP)
Two papers accepted to #ICLR2026 🇧🇷 (1 first, 1 second author) Huge thanks to my co-authors and collaborators! @Bollegala @MasahiroKaneko_ @chokkanorg @junpeikomiyama @stillpedant More details soon!
1
8
1
52
7,359
Daisuke OBA retweeted
Giving a talk on Diffusion augmented LLMs (Uno) @askalphaxiv Some new results include: > A newer version of Uno which beats DFlash2 > Scaling to 400B scale > Speeding up RL post-training 📅 Friday Nov 13 ⏲️ 10-11am PT Zoom: luma.com/fli4wjlr
Making LLM inference up to 3x faster using discrete diffusion without sacrificing accuracy? Come join us for this AI4Science talk: Unlocking Lossless Speedups in LLMs via Discrete Diffusion. In this session, the author Subham Sahoo will introduce Uno, a new approach from IFM that combines autoregressive and diffusion modeling to accelerate LLM inference. While parallel generation methods often sacrifice accuracy for speed, Uno uses lightweight diffusion adapters to generate multiple tokens in parallel, then relies on the original model to verify them, preserving its output distribution without requiring a separate draft model. So not only is it 3x faster, it also outperforms top speculative decoding methods, with speedups even works at large batch sizes. If you're working or interested in LLM inferencing, this is the talk to check out. :microscope: AI4Science on alphaXiv :calendar_spiral: Friday November 13th 2026 · 10 AM PT :microphone2: Featuring Subham Sahoo :speech_balloon: Casual Talk + Open Discussion Check out the paper here: alphaxiv.org/abs/2609.04010 Sign up for the talk here: luma.com/fli4wjlr
2
16
2
48
4,541
Thanks for everyone who attended and engaged with us at the Diffusion Language Model Tutorial yesterday at @aaclmeeting Both @dai0NLP and I had a wonderful time explaining what has been done so far in DLM research and what the NLP community can contributed to in the future. The slides are available at dllm-aacl.github.io/ in case you missed the talk. #diffusionmodels #NLProc
1
2
41
2,118
Daisuke OBA retweeted
Langaku、日本e-learning大賞でまさかのダブル受賞🎉 めでたい!
/ 🏆 2026年度 日本e-Learning大賞 受賞!🏆 \ なんと #Langaku が『大賞』を受賞しました🎉 さらに! 『日本電子出版協会会長賞』も受賞! 嬉しいダブル受賞です✨ いつも温かい応援ありがとうございます! これからも楽しい学習体験をお届けします📚 #eラーニング大賞 #eラーニングアワード
2
6
50
1,844
Daisuke OBA retweeted
Rakuten Technology Excellence Awards 2026を岡崎研、横田研、産総研が受賞することになりました! 日本語LLM「Swallow」など、私たちの取り組みを評価していただき大変光栄です。一緒に取り組んできた皆さんに感謝します。引き続き、日本のオープンLLMの研究開発を盛り上げていきたいと思います!
15
108
6,135
Replying to @aaclmeeting
@aaclmeeting is coming to an end but we saved the best for the last! Please drop by our tutorial on Diffusion Language Models from 14:00 at Muhe Hall B. The opportunities are immense for the NLP community to contribute to this growing field. Multilinguality, multimodality, interpretability, diversity, safety evals are all pretty much open topics in DLMs and we promise to explain everything that you need to know to get started. slides and reading list at dllm-aacl.github.io/ #diffusionmodels
1
12
611
Daisuke OBA retweeted
🤔 Do LLMs struggle with word senses, or just make overly fine-grained distinctions? I will present our paper “WiC is Not WSD” at #AACL2026! 📅 Nov 8 | Semantics and Linguistic Structure 📍 Room 5 📄 arxiv.org/abs/2609.20593 Hope to see you there!
2
13
832
Daisuke OBA retweeted
Discrete LLM Tutorial at AACL 2026 🔥
I’ll be giving a tutorial on diffusion language models at AACL-IJCNLP 2026 on Nov. 10 w/ @Bollegala 🔗 dllm-aacl.github.io/ (Slides coming soon!) #aacl2026 @aaclmeeting 💭Grateful for the opportunity to organize my perspective on this fast-moving field and share it with the NLP community. This will be my first tutorial, so it’s a bit of a personal challenge for me as well. Looking forward to the discussions :)
3
13
58
4,191
I’ll be giving a tutorial on diffusion language models at AACL-IJCNLP 2026 on Nov. 10 w/ @Bollegala 🔗 dllm-aacl.github.io/ (Slides coming soon!) #aacl2026 @aaclmeeting 💭Grateful for the opportunity to organize my perspective on this fast-moving field and share it with the NLP community. This will be my first tutorial, so it’s a bit of a personal challenge for me as well. Looking forward to the discussions :)
14
1
64
6,383
✈️ Off to Zhuhai for #AACL2026! 🚨 We are hiring! I’m looking for NLP talent at all levels: 🏛️ @LivUniCS (PhD students to Full Prof in AI) 📦 Amazon (Applied Scientists) My DMs are open—let's catch up on roles or research! Catch our work this week 👇 🗓️ Nov 7 | 10:30am (Interpretability) Oral: Decoupling Internal Representational Changes & Causal Importance in Fine-Tuned LLMs 🔗 aclanthology.org/2026.aacl-l… w/ @prochetasen @li_lingfang Subham Das 🗓️ Nov 8 | 10:30am (Semantics) Oral: WiC is not WSD: A Study on LLMs & Lexical Ambiguity Resolution 🔗 aclanthology.org/2026.aacl-l… w/ @jodieyzhou Kiamehr Rezaee @tpilehvar @CamachoCollados 🗓️ Nov 10 | 2:00pm Tutorial: Diffusion Language Models 🔗 dllm-aacl.github.io/ w/ @dai0NLP See you there! @aaclmeeting #aacl2026 #LiverpoolNLP @AmazonScience
4
4
31
1,894
Daisuke OBA retweeted
Drifting Models are one-step generators. Can we give them an iterative refinement mechanism for text generation? We propose ReLaDrift: a Drifting Model drafts from noise, then recurrently refines its own draft in latent space. It works on Sudoku and GSM8K! w/ @dai0NLP @chokkanorg
1
1
2
121
Daisuke OBA retweeted
Which DLM is least biased? Depends on how you sample. We systematically show that sampling configs like remasking strategy can easily shift the bias scores of DLMs, reshuffling their ranking, even after debiasing. 📄 arxiv.org/abs/2610.27584 w/ @dai0NLP @Bollegala @chokkanorg
3
7
1
28
2,302
Daisuke OBA retweeted
1/4 Today, we’re releasing Mercury 3. Mercury 3 is by far our most powerful model and the most intelligent diffusion LLM ever released. It outperforms GPT-6 Luna and Haiku 5.5 on quality while running at 1000+ tok/sec.
🤖 Made with AI
291
455
230
5,263
489,833
🎉 Accepted at #NeurIPS2026 Main Track! We propose DiSPO, a credit-assignment method for RL in diffusion language models. Huge thanks to my co-authors @frt03_ @chokkanorg. Looking forward to sharing more soon!
2
67
2,457
Daisuke OBA retweeted
1st paper w/@MasahiroKaneko_ @dai0NLP @Bollegala @chokkanorg We study social bias in response-conditioned multi-turn LLM interactions, where follow-up user queries adapt to the evolving dialogue which can vary in length. [1/2]
1
2
4
301
Thrilled to announce that we have two papers and a tutorial accepted to AACL-IJCNLP. 🎉 1. Decoupling Internal Representational Changes and Causal Importance in Fine-Tuned Large Language Models (with Lingfang Li, Procheta Sen, and Shubham Das) We investigated how fine-tuning fundamentally alters internal representation (like attention patterns and layer-wise activations) inside LLMs and discovered that components most causally important to a task's performance are actually concentrated within specific layers. Interestingly, the distribution of these causally important components is largely uncorrelated with the layers undergoing the most substantial representational changes during fine-tuning. If you are interested in how fine-tuning affects a model internally LLMs please get in touch. P 2, WiC is Not WSD: A Study on LLMs and Lexical Ambiguity Resolution (with @jodieyzhou , Kiamehr Rezaee, Mohammad Taher Pilehvar, and @CamachoCollados ) We explored why Word-in-Context (WiC) tasks remain so challenging for LLMs compared to traditional Word Sense Disambiguation (WSD). The difficulty isn't just about comparing two contextual uses of a word, but rather the lack of an explicit sense inventory that specifies the required level of semantic granularity. Providing candidate senses—similar to what is done in traditional WSD—improves WiC performance across all settings by helping models make more consistent judgments. Our human evaluation showed that many apparent LLM errors aren't simple failures of lexical understanding. Instead, LLMs tend to "overthink" and apply overly fine-grained sense distinctions compared to human annotators. 3. I will be giving a tutorial on Diffusion Language Models with @dai0NLP at AACL as well Preprints for both papers will be available soon. Congratulations to my collaborators/students #aacl26 #NLProc #LiverpoolNLP
4
1
1
19
3,226
Excited to give an invited talk at the @AIChemyHub "Transferable Opportunities for AI in Materials Chemistry" workshop in Liverpool on Sept 8! 🧬🗣️ Language and chemistry have striking parallels: words/grammar shape a sentence just like atoms/bonds shape a material. Because of this, NLP tools like Transformers and GNNs are unlocking new possibilities in materials science. I’ll be presenting "Mapping the Landscape of Foundation Models for Material Representation and Discovery," sharing how our latest #LiverpoolNLP research on mapping sentence encoders can be used to map material spaces and discover novel materials. 📅 Event info: aichemy.ac.uk/event/transfer… 📖 Read about our encoder mapping work: blog.danushka.net/posts/2026… #AI #NLP #MaterialScience #MachineLearning
2
7
628
Daisuke OBA retweeted
今年の #NeurIPS で世界モデル🌎️とロボティクス🤖に関するワークショップを開催します! 締切は8/29 AOEです。Short paperとLong paperのどちらも受け付けているので、是非投稿をご検討ください
📣 Announcing the Workshop on Robot Learning with World Models at NeurIPS 2026! 📋 We’re calling for lpapers and demo/networking proposals. ⏰ Deadline: Aug 29, 2026 AoE 🌐 Website: robowm-ws.github.io
4
32
4,294
We have two papers accepted to EMNLP 2026🎊 - Cross-Lingual Representation Alignment by Token-Level Optimal Transport in a Language-Agnostic Space (main) Taisei Yamamoto, Ryoma Kumon, Danushka Bollegala, Hitomi Yanaka @verypluming - DyMT-ESB: Dynamic Multi-Turn Evaluation of Social Bias in User-LLM Interactions (Findings) Rem Hida, Masahiro Kaneko, Daisuke Oba, Danushka Bollegala, Naoaki Okazaki @rem_h4_ @MasahiroKaneko_ @dai0NLP Congrats to all my collaborators! #LiverpoolNLP
5
36
1,682
Our paper has been accepted to Findings of #EMNLP2026. This work brings bias evaluation of LLMs into more realistic settings. Led by @rem_h4_ , with @MasahiroKaneko_, @Bollegala , and @chokkanorg. Details coming soon.
1
6
61
2,227
Daisuke OBA retweeted
Two long papers accepted to #EMNLP2026: a first-authored paper on fairness (Findings) and a co-authored paper on machine translation (Main Conference). More info soon!
1
6
25
1,574