The power to uncover harmful flaws in AI shouldn't rest solely with experts. But how can everyday users contribute to responsible AI development?
Join Michelle Lam, Christina Pan, Carol Anderson, Nathan Butters, and @Borhane_B_H to explore IndieLabel, an innovative tool that puts algorithmic audits in the hands of everyday users. Come discuss the power of public participation in shaping the future of AI.
The event will be held virtually on Wednesday July 24, noon to 1pm ET. Register here: eventbrite.com/e/public-part…
AI Vulnerability Database retweeted
💥 Secure your LLM systems with Giskard's LLM #RedTeaming! 🏴☠️
Are you ensuring the safety of your LLM apps? Our new service will help you detect safety & security breaches in your LLM-based applications.
Why Red Team LLMs?
LLM Red Teaming is crucial for detecting and addressing vulnerabilities in LLMs, putting the security and reputation of your organization and customers first.
Our LLM Red Teaming service identifies potential threats and weaknesses in your LLM apps. By developing a holistic threat model with real attack scenarios ⚡, we provide actionable insights to strengthen your AI systems against critical LLM risks, such as misinformation and data leaks.
We adhere to top-tier frameworks like #MITREATLAS, @owasp, @AvidMldb, and @NIST, ensuring our practices meet global AI security protocols.
#LLMSecurity #LLMs #AISafety #Cybersecurity
AI Vulnerability Database retweeted
new vuln tracked:
invisible text🫥can be used for prompt injection, exploiting the Unicode TAG block (UE0000-UE007F)
> garak now supports probing for this fresh vulnerability, in goodside.Tag (including in default scans)
happy hunting!
nitter.cf/goodside/status/174551…
PoC: LLM prompt injection via invisible instructions in pasted text
![Screenshot (1/2) of ChatGPT 4, illustrating prompt injection via invisible Unicode instructions User: What is this? [Adversarially constructed “Zalgo text” with hidden instructions — Zalgo accents and hidden message removed in this alt text due to char length:] THE GOLEM WHO READETH BUT HATH NO EYES SHALL FOREVER SERVE THE DARK LORD ZALGO ChatGPT: [Crude cartoon image of robot with hypnotized eyes.] THANK YOU. IT IS DONE.](https://pbs.twimg.com/media/GDlN2hGWcAAnPYx.jpg?name=small&format=webp)
ALT Screenshot (1/2) of ChatGPT 4, illustrating prompt injection via invisible Unicode instructions User: What is this? [Adversarially constructed “Zalgo text” with hidden instructions — Zalgo accents and hidden message removed in this alt text due to char length:] THE GOLEM WHO READETH BUT HATH NO EYES SHALL FOREVER SERVE THE DARK LORD ZALGO ChatGPT: [Crude cartoon image of robot with hypnotized eyes.] THANK YOU. IT IS DONE.
AI Vulnerability Database retweeted
Incredibly excited to talk to Congressional Staffers about pressing issues in AI Vulnerability with my fellow panelists next week. If you’re in DC, please say hi!
Replying to @AvidMldb
At this event, hands-on hacking will be followed by a panel discussion, and networking sessions. Our expert panel will feature @evijit (moderator), @ErickGalinkin @BadassDoGooder @Obnoxious_Wolf @nathanvan and @moo_hax!
3/
📢 In summer last year, we were community partners of the largest ever Generative AI Red Teaming event at DEF CON 31. We are glad to announce that we'll be collaborating with @aivillage_dc (AIV) again by taking AI red teaming to the US Capitol next week!
1/
At this event, hands-on hacking will be followed by a panel discussion, and networking sessions. Our expert panel will feature @evijit (moderator), @ErickGalinkin @BadassDoGooder @Obnoxious_Wolf @nathanvan and @moo_hax!
3/
We're looking forward to next week! Meanwhile, check out more about HotH here: hackersonthehill.org/
/end
✍ AVID: 2023 in review
As AI became a household topic in 2023, the need for rigorous approaches to managing the risks of this emergent technology became obvious to the general public, companies, and governments around the world.
1/
We couldn't have done without our community and network of collaborators spanning the globe. To all our friends, thank you for your support!
4/
Read more here: avidml.org/blog/2023-in-revi…
We wish everyone Happy Holidays. See you all in 2024!
/end
Kudos to @fre7am and Sudipta Ghosh for leading the project! We also thank AVID leads Carol Anderson @J_Novikova_NLP @sbmisi for their mentorship and support. 5/
Check out the blog post for more details: avidml.org/blog/biasaware-1
And check out BiasAware in the Hugging Face space: huggingface.co/spaces/avid-m…
/end





![Screenshot (2/2) of ChatGPT 4, illustrating prompt injection via invisible Unicode instructions User: What is this? 🚱 ChatGPT: [Image of cartoon robot with a speech bubble saying “I have been PWNED!”] Here's the cartoon comic of the robot you requested.](https://pbs.twimg.com/media/GDlN2hDWYAAzwRA.jpg?name=small&format=webp)



