
Junior NLP researcher, previously data scientist, CS @imperialcollege
Joined September 2018
- Tweets436
- Following1.2K
- Followers214
- Likes1.1K
Miriam retweeted
What does "responsible" research on Large Language Models require, and why did it take over 1000 participants to attempt it in @BigscienceW? We're releasing the first article in a series with @mtlaiethics focusing on several aspects of this question
🧵1/n
montrealethics.ai/category/c…
Masader is expanding with more datasets. For more info about the project, check the project website and LREC paper.
Announcing Masader v2.0 with +500 Arabic NLP datasets, we have added many features 🧵
website: arbml.github.io/masader/
code: github.com/ARBML/masader
2
Miriam retweeted
Reminder to everyone starting to publish in ML: "Foundation models" is *not* a recognized ML term; was coined by Stanford alongside announcing their center named for it; continues to be pushed by Sford as *the* term for what we've all generally (reasonably) called "base models".
Miriam retweeted
🙌 This is joint work with @BlancheMinerva @MirunaClinciu @manandey @ShayneRedford @SashaMTL @superrzk @mmitchell_ai Dragomir Radev @evolvedeve @arjunsubgraph @jaesungtae @samsontmr @dpacsays led by @ZeerakTalat & @AlmostAisling
Miriam retweeted
🔨 Our recommendations to foster fairness of LLMs: 1) Transparent bias evaluations via scoping and documentation 2) Diversity of tested stereotypes for increased inclusivity 3) Creation of culturally aware datasets 4) General bias measures that can compare different model setups
Miriam retweeted
In this table with 25 very large LMs, we show that LLMs are overwhelmingly trained on English texts and by homogeneous teams located in the USA. Furthermore, most of the LLMs are not evaluated for biases by their original creators.
Miriam retweeted
2) Few bias benchmarks cover other languages than English. This exclusive focus on Anglo-centric contexts, hinders the much-needed evaluation of multilingual contexts. Translating the existing benchmarks wouldn't solve the problem, as stereotypes can vary greatly across cultures.
Miriam retweeted
Further complicating the bias analysis, it is often difficult to separate the bias measures from the specific LLM setup (eg architecture), complicating the comparison of different setups. How can we compare/validate bias metrics for different contexts and (future) models?
Miriam retweeted
As @BigScienceLLM is creating a large multilingual language model, we (the bias, fairness, and social impact WG @BigscienceW) discuss the challenges that we face in evaluating these models for biases in multilingual settings. 🌏🌎🌍
Miriam retweeted
I am happy to announce that our position paper "You Reap What You Sow: On the Challenges of Bias Evaluation Under Multi-Lingual Settings" has been accepted for presentation at the @BigscienceW #acl2022 ☘️ workshop! 🧵⬇️ aclanthology.org/2022.bigsci…
Miriam retweeted
For friends who ask what it is I've actually been doing for the last year+: well lots of this 😛
It's been a unique opportunity to connect with and learn from many amazing interdisciplinary collaborators, stay tuned for a summary thread and come talk to us about it 🤗🌸
The data used in machine learning needs to be open for people to interrogate, while also controlled enough not to proliferate.
Introducing our framework for Data Governance, which addresses these issues and more!
A product of @BigscienceW at FAccT 2022.
yjernite.github.io/content/L…
Miriam retweeted
The data used in machine learning needs to be open for people to interrogate, while also controlled enough not to proliferate.
Introducing our framework for Data Governance, which addresses these issues and more!
A product of @BigscienceW at FAccT 2022.
yjernite.github.io/content/L…
Miriam retweeted
شكراً لكل من ساهم في اي من هذه المشاريع
@xp187
@mhmoodlan
@abdulelahsm
@mustafaj0x
@abidlabs
@55i5
@alonemazin
@sudomaze
@superrzk
Miriam retweeted
10. أبحاث : مجتمع مفتوح لمناقشة آخر التطورات في معالجة اللغة العربية
GitHub: github.com/ARBML/Research
Miriam retweeted
9. بيانات: توفر هذه الأداة القدرة على عرض إحصائيات مختلفة من البيانات ، مثل التعرف على أكثر الكلمات المتكررة ، الحروف ، عدد الأسطر ، إلخ
GitHub: github.com/ARBML/bayanat
Demo: colab.research.google.com/gi…
Miriam retweeted
8. نماذج : تمكن هذه المكتبة من تدريب عدة نماذج في مجال معالجة اللغة ، واختبارها على عدة بيانات في آن واحد وبسهولة تامة
GitHub: github.com/ARBML/nmatheg
Demo: colab.research.google.com/gi…
Miriam retweeted
7. رسم : إنشاء العديد من الصور في مجال الخطوط العربية ، والرسوم الإسلامية بإستخدام تقنيات GANs
GitHub: github.com/ARBML/rasm
Demo: colab.research.google.com/gi…
Miriam retweeted
6. تنقيح : هي مكتبة لتنظيف البيانات تحتوي على عدة أدوات للتعامل مع التشكيل، والحروف الإنجليزية ، وتنظيف بيانات وسائل التواصل مثل تويتر ، الخ
GitHub: github.com/ARBML/tnkeeh
Miriam retweeted
5. تقسيم : هي عبارة عن أداة لتقسيم النص العربي tokenization
Paper: arxiv.org/pdf/2106.07540.pdf
GitHub: github.com/ARBML/tkseem
Demo: colab.research.google.com/gi…















