GitHub topics: ai-red-team
microsoft/AI-Red-Teaming-Playground-Labs
AI Red Teaming playground labs to run AI Red Teaming trainings including infrastructure.
Language: TypeScript - Size: 949 KB - Last synced at: about 21 hours ago - Pushed at: 11 days ago - Stars: 790 - Forks: 102

Giskard-AI/giskard
๐ข Open-Source Evaluation & Testing for AI & LLM systems
Language: Python - Size: 176 MB - Last synced at: about 22 hours ago - Pushed at: 28 days ago - Stars: 4,582 - Forks: 324

Azure/PyRIT
The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.
Language: Python - Size: 134 MB - Last synced at: 2 days ago - Pushed at: 6 days ago - Stars: 2,512 - Forks: 492

msoedov/agentic_security
Agentic LLM Vulnerability Scanner / AI red teaming kit ๐งช
Language: Python - Size: 21.4 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1,405 - Forks: 216

p314dO/blog
An Offensive Security Blog
Language: HTML - Size: 17.6 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

cyberark/FuzzyAI
A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.
Language: Jupyter Notebook - Size: 16.1 MB - Last synced at: 11 days ago - Pushed at: 25 days ago - Stars: 558 - Forks: 57

mbrg/power-pwn
An offensive security toolset for Microsoft 365 focused on Microsoft Copilot, Copilot Studio and Power Platform
Language: Python - Size: 1.98 MB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 929 - Forks: 97

ErdemOzgen/RedAiRange
AI Red Teaming Range
Language: Jupyter Notebook - Size: 267 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 4 - Forks: 0

hupe1980/aisploit
๐ค๐ก๏ธ๐๐๐ Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
Language: Python - Size: 6.08 MB - Last synced at: 10 days ago - Pushed at: about 1 year ago - Stars: 23 - Forks: 5

TrustAI-laboratory/LMAP
LMAP (large language model mapper) is like NMAP for LLM, is an LLM Vulnerability Scanner and Zero-day Vulnerability Fuzzer.
Size: 77.1 KB - Last synced at: 7 months ago - Pushed at: 8 months ago - Stars: 5 - Forks: 0

OphirOren/Lakera-Gandalf
This is my prompts for Lakera's Gandalf challenges
Size: 29.3 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0
