Research Fellow in AI @Sapienza_Engineering
Joined December 2016
- Tweets49
- Following281
- Followers146
- Likes539
It was great working with you Peter!
LLMs aren't humans, so why evaluate RAG with human-centric metrics?
Traditional IR metrics fail to predict RAG performance because:
❌They assume sequential reading
❌They ignore that some docs actively distract LLMs
Meet UDCG: a new metric w/ 36% ⬆️ corr. to actual performance✅
Retrieval evaluation needs to evolve for the LLM era. UDCG is a step toward metrics that align with machine consumers, not human browsing patterns.
📄 Full paper: arxiv.org/abs/2510.21440
💻 Code & data: github.com/GiovanniTRA/UDCG
(8/n)
Huge thanks to my amazing co-authors for making this work possible! 🙏 @FlorinCuconasu @SimoneFilice @Yoellem @fabreetseo
(n/n)
🚀Huge congratulations to Florin! 🏆 If reading the research paper isn't your thing, no worries—you can listen to the generated podcast instead, and it's actually pretty good. Quoting from it, "It's going to sound crazy!
shorturl.at/NlVGc
Well done to our 'Best Poster Award' winners! One of our winners is @FlorinCuconasu with "The Power of Noise: Redefining Retrieval for RAG Systems". Congrats!! #M2LSummerSchool
Giovanni Trappolini retweeted
#ECIR2025 call for Tutorials: ecir2025.eu/call-for-tutoria…. Tutorial proposals submission: Nov. 08, 2024. Notification: Dec. 16, 2024.
Almost ready for the second keynote here at the IR-RAG workshop!
Finish up your lunch and come to the presidential ballroom for Dr. Zhang presentation! @yuhaozhangx
"Seldom is a glance at the statistics enough to understand the meaning of the figures" 🤔
Fromm had clearly RAG in mind when uttering these words! ✍️
Read our paper to find out more about BaseVsInstruct for RAG! 🚩
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
🚨 If you, or someone you know, are looking for a PhD you should definitely check this out! 🤌
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
📢 Check out the refined version of “The Power of Noise: Redefining Retrieval for RAG Systems”! accepted @SIGIR2024.
A huge thank you to the reviewers and the research community for your invaluable feedback—it has significantly improved the paper. (1/n)
Huge shout-out to the amazing @FlorinCuconasu and the team @_FedeSiciliano_ @SimoneFilice @caesar_one_ @Yoellem @ntonellotto @fabreetseo