NLP group @UMNComputerSci @dongyeopkang @AlexanderSpangh
Joined June 2021
- Tweets38
- Following33
- Followers86
- Likes22
We warmly welcome you, @AlexanderSpangh ! Excited to have you join our community.
Minnesota NLP retweeted
🚨 New paper! 🚨
Legal work isn’t a checklist. It’s full of ambiguity, changing goals, and evolving info.
So why is legal AI mostly built for static tasks like clause selection or doc search?
💡 We argue: model the process, not just the product.
ArXiv : arxiv.org/abs/2504.18942
Minnesota NLP retweeted
🚨 New Paper Alert! 🚨
How can we align language models without drowning in prompt engineering or falling into reward hacking traps?
We introduce Meta Policy Optimization (MPO)—a new reinforcement learning framework that evolves its own reward model rubrics through meta-level reflection. Inspired by metacognition and evaluative thinking, MPO trains models to think about how they evaluate, not just what they generate.
🔥 Why it matters:
✔️ Boosts stability and robustness in RLAIF
✔️ Reduces human labor in prompt crafting
✔️ Generalizes across tasks: essays, summarization, ethical and mathematical reasoning
Check it out: huggingface.co/papers/2504.2…
Big thanks to co-authors @chanwoopark20 (MIT), @_vipulraheja (Grammarly), and @dongyeopkang (UMN)!
#AI #LLMs #ReinforcementLearning #MetaLearning #NLP #Alignment #RLHF #RLAIF #EvaluativeThinking #PromptEngineering
Minnesota NLP retweeted
A New Paper Alert ! 🎉🚨
How do researchers write their papers?
Introducing 𝐒𝐜𝐡𝐨𝐥𝐚𝐖𝐫𝐢𝐭𝐞: the first-of-its-kind keystroke dataset of an 𝐞𝐧𝐝-𝐭𝐨-𝐞𝐧𝐝 𝐬𝐜𝐡𝐨𝐥𝐚𝐫𝐥𝐲 𝐰𝐫𝐢𝐭𝐢𝐧𝐠 𝐩𝐫𝐨𝐜𝐞𝐬𝐬, with thorough annotations of 15 cognitive writing intentions.
Minnesota NLP retweeted
Two exciting projects will be presented at #EMNLP2024
(1) @shirley_ah_ 's diversity extraction from LLMs
(2) Karin de Langis's multi-style/reward control in RLHF.
Shirley & Karin (& alumni @Ruyuan_Wan @MinnesotaNlp ) are amazingly fun to talk to! Below are links to papers:
Minnesota NLP retweeted
Arriving at Miami for #EMNLP2024 🏝️Happy to catch up with old friends and meet new ones 😄✨ Also do check out my work tomorrow & @customnlp4u workshop on Saturday! 👋🏻
📍Poster Session B (Riverfront Hall)
📅 Tue, Nov 12
⏰ 2pm
Workshop:
📍Merrick 1
📅 Sat, Nov 16
⏰ 9am-5pm
LLMs are exposed to so many different people’s writings and opinions during training, but how much diversity can we actually extract back given subjective topics? 🧐
Use Criteria-Based Diversity Prompting to extract diverse perspectives! 😉
Paper 📄: arxiv.org/pdf/2311.09799.pdf
Minnesota NLP retweeted
How can we produce generations that are well-balanced in irony, formality, and positivity? Or between negativity and formality? In our recent #EMNLP2024 work, we observe style control as a reinforcement learning problem and introduce a new reward-shaping formulation via dynamic weighting with discriminator gradient magnitudes.
Minnesota NLP retweeted
Won't be at #ACL2024, but check out the following work from @MinnesotaNlp , including topics on 🧵
- video alignment with AI feedback
- human-vs-machine text detection using discourse motifs
- benchmarking cognitive biases in LLM-as-judge
- multi-modal, multi-hop reasoning
Minnesota NLP retweeted
Just finished my oral presentation at #IC2S2 in Philly :)
We propose motif and image modalities as an initial step towards human-friendly encodings of graph data and our methods can be extended to multiple social systems!
#NLP #multimodality #NLProc #CSS
Minnesota NLP retweeted
Had a lot of fun presenting our paper on LLM modalities for graph reasoning at #NAACL2024 today! 🇲🇽
Please PM me if you'd like to collaborate on future directions of this exciting work! :)
Paper link : aclanthology.org/2024.findin…
#nlpproc #llms #graphs
Minnesota NLP retweeted
Thank you to @dongyeopkang @snchancellor and all of @MinnesotaNlp and @UMNComputerSci for hosting me today for my talk. It was a pleasure meeting everyone!
Minnesota NLP retweeted
Check out our work in the poster session 2 today at #MSLD2024!
And the talk tomorrow at 2pm!
LLMs are exposed to so many different people’s writings and opinions during training, but how much diversity can we actually extract back given subjective topics? 🧐
Use Criteria-Based Diversity Prompting to extract diverse perspectives! 😉
Paper 📄: arxiv.org/pdf/2311.09799.pdf
Minnesota NLP retweeted
Instructions may compose of subtasks: the output from a subtask becomes the input for the next subtask, or called as “chain-of-instructions” (CoI)⛓️
CoI-tuned LLMs perform better on complex tasks & downstream tasks of multilingual summarization!
📎: arxiv.org/pdf/2402.11532.pdf
Minnesota NLP retweeted
We're #UMNProud of @dongyeopkang for developing an AI-based text editing system to assist with complex writing tasks!
Read more here: z.umn.edu/DKAIEditing
ALT Picture of Dongyeop Kang.
Minnesota NLP retweeted
"Paraphrasing attacks" can compromise the effectiveness of AI content detectors. 🙀 Can hierarchical structures in texts help build a more robust detector? Our research reveals a resounding💡YES!💡Delighted to share our work on merging discourse frameworks with graph analysis.
Minnesota NLP retweeted
🤖Excited to share @MinnesotaNlp Labs latest work on Data Efficient Instruction Tuning: "SelectLLM: Can LLMs Select Important Instructions to Annotate?". Leveraging LLMs to select high quality instructions. Arxiv: arxiv.org/abs/2401.16553 #LLM #NLP #AI #ArtificialIntelligence
Check out our work on investigating artifacts in LLM-generated data! 🧐
We also provide suggestions to mitigate these issues for safer usage of LLM for generating data🙂
🚀Excited to share MinnesotaNLP's FIRST lab-wide paper (15+ team) on artifacts present in LLM-generated data! We explore the diverse world of LLM-generated text content and its impact on the artificial data ecosystem. #NLProc #syntheticdata #LLM
ArXiV: arxiv.org/abs/2401.14698
Consider submitting your work to #In2Writing workshop! ✍🏻📑📝
The amazing #In2Writing workshop will be again at #CHI2024! This year we have an very intriguing theme:
🔥Dark Sides: Envisioning, Understanding, and Preventing Harmful Effects of Writing Assistants🔥
Take a look at our website!
in2writing.glitch.me/
Minnesota NLP retweeted
My first undergraduate, Ryan Ko @im_koogusry, received an honorable mention in CRA URA. He co-authored multiple interesting papers, including CoEdit, Cobbler, Writing-Decoding, Meta-crafting, etc. ⚠️ Currently, he is applying for CS PhD programs on RLHF, LLM alignment, etc!! ⚠️
