An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: ai-security

firstsnowcg/SwarmPentest

SwarmPentest: World's first open-source multi-agent automated penetration testing framework(LLM-support)

Language: Python - Size: 22.5 KB - Last synced at: about 17 hours ago - Pushed at: about 18 hours ago - Stars: 1 - Forks: 0

stacklok/toolhive

Run and manage MCP servers easily and securely

Language: Go - Size: 3.89 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 358 - Forks: 27

fiddlecube/compliant-llm

Build Secure and Compliant AI agents and MCP Servers

Language: Python - Size: 12.1 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 126 - Forks: 3

GH05TCREW/GHOSTCREW

All-in-one offensive security toolbox with AI agent and MCP architecture. Integrates tools like Nmap, Metasploit, FFUF, SQLMap. Enables pentesting, bug bounty hunting, threat hunting. RAG-based responses with local knowledge base support.

Language: Python - Size: 93.8 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 11 - Forks: 1

garnet-org/jibril-balag

A collection of Jibril’s public releases. Each update is a gentle echo of guidance, shared for all who journey together.

Language: Shell - Size: 7.81 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

Giskard-AI/giskard

🐢 Open-Source Evaluation & Testing for AI & LLM systems

Language: Python - Size: 176 MB - Last synced at: 3 days ago - Pushed at: 23 days ago - Stars: 4,559 - Forks: 323

THUYimingLi/backdoor-learning-resources

A list of backdoor learning resources

Size: 1.07 MB - Last synced at: 3 days ago - Pushed at: 10 months ago - Stars: 1,107 - Forks: 176

citizenjosh/ai-security-training-lab

Hands-on lessons for attacking and defending AI systems, starting with the OWASP Top 10 for LLM Applications.

Language: Python - Size: 54.7 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

The-Art-of-Hacking/h4cker

This repository is primarily maintained by Omar Santos (@santosomar) and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), artificial intelligence security, vulnerability research, exploit development, reverse engineering, and more.

Language: Jupyter Notebook - Size: 104 MB - Last synced at: 4 days ago - Pushed at: 28 days ago - Stars: 21,054 - Forks: 3,909

splx-ai/agentic-radar

A security scanner for your LLM agentic workflows

Language: Python - Size: 17.2 MB - Last synced at: 4 days ago - Pushed at: 10 days ago - Stars: 515 - Forks: 55

cyproxio/mcp-for-security

MCP for Security: A collection of Model Context Protocol servers for popular security tools like SQLMap, FFUF, NMAP, Masscan and more. Integrate security testing and penetration testing into AI workflows.

Language: TypeScript - Size: 262 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 124 - Forks: 19

wearetyomsmnv/AI-LLM-ML_security_study_map

Do you want to learn AI Security but don't know where to start ? Take a look at this map.

Size: 28.6 MB - Last synced at: 3 days ago - Pushed at: about 1 year ago - Stars: 23 - Forks: 2

utkusen/promptmap

a prompt injection scanner for custom LLM applications

Language: Python - Size: 239 KB - Last synced at: 2 days ago - Pushed at: 3 months ago - Stars: 785 - Forks: 80

lloydpa18/VerifyVision-Pro

VerifyVision-Pro是一个全面的图像伪造篡改检测解决方案,利用深度学习(deep learning)和计算机视觉技术(cv)精确识别各类图像篡改,包括deepfake、AI生成内容、拼接操作和复制-移动篡改。基于PyTorch实现,集成了从数据处理、模型训练到部署的完整工作流程。

Language: Python - Size: 476 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

meilisa2323/llm_ctf

A Capture The Flag-style challenge focused on exploiting the vulnerabilities of Large Language Models (LLMs).

Language: HTML - Size: 13.7 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

vibeSafe/vibeSafe-cli-js

Secure your code in seconds. VibeSafe is an AI-native DevSecOps CLI tool that detects vulnerabilities, secrets, insecure configs, and hallucinated dependencies before they ship.

Language: TypeScript - Size: 137 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

LLAMATOR-Core/llamator

Framework for testing vulnerabilities of large language models (LLM).

Language: Python - Size: 4.21 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 110 - Forks: 9

AarambhTech/exam-cheating-detection

AI-powered online exam proctoring system that detects suspicious activities using computer vision. Tracks eye movements, face presence, multiple faces, and talking during exams with real-time alerts and dashboard.

Language: Python - Size: 10.7 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

slowcoder360/vibesafe

Secure your code in seconds. VibeSafe is an AI-native DevSecOps CLI tool that detects vulnerabilities, secrets, insecure configs, and hallucinated dependencies before they ship.

Language: TypeScript - Size: 153 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 3 - Forks: 1

carmelyne/dokugent-cli

Document-first CLI for building agent workflows in Markdown.

Language: JavaScript - Size: 7.82 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 6 - Forks: 0

viraj7066/Deepfake-Detection-System

A deep learning-powered system for detecting deepfake videos using a ResNeXt + LSTM hybrid model with a Django web interface for real-time predictions.

Language: Jupyter Notebook - Size: 72.9 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

efij/AARF-Agentic-AI-Request-Forgery

Agentic AI Request Forgery (AARF) – New vulnerability class exploiting planner ➝ memory ➝ plugin chaining in MCP Server, MAS, LangChain, and A2A agents. Red Team playbooks, threat models, OWASP Top 10 proposal.

Size: 291 KB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 0 - Forks: 0

lintsinghua/VerifyVision-Pro

VerifyVision-Pro是一个完整的图像真伪鉴别解决方案,能够检测各类图像篡改和伪造,包括DeepFake、拼接、复制-移动和AI生成图像。本项目实现了从数据处理、模型训练到网页应用的全流程部署,支持多种深度学习架构,适合研究和实际应用场景。

Language: Python - Size: 0 Bytes - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 1 - Forks: 0

0x6f677548/copilot-instructions-unicode-injection

Proof of Concept (PoC) demonstrating prompt injection vulnerability in AI code assistants (like Copilot) using hidden Unicode characters within instruction files (copilot-instructions.md). Highlights risks of using untrusted instruction templates. For educational/research purposes only.

Size: 1.48 MB - Last synced at: 4 days ago - Pushed at: 14 days ago - Stars: 1 - Forks: 0

GuardionAI/guardion

Lightning-fast AI Firewall, integrated with leading agent frameworks

Language: Python - Size: 183 KB - Last synced at: 8 days ago - Pushed at: 16 days ago - Stars: 1 - Forks: 0

Repello-AI/whistleblower

Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and folks who want to know what's going on inside the LLM-based app they use daily

Language: Python - Size: 48.8 KB - Last synced at: 16 days ago - Pushed at: 10 months ago - Stars: 119 - Forks: 10

SAP/STARS

AI agent whose purpose is to conduct vulnerability tests on LLMs from SAP AI Core or from local deployments, or models from HuggingFace. The goal of this project is to identify and correct any potential security vulnerabilities.

Language: Python - Size: 2.51 MB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 24 - Forks: 1

AmadeusITGroup/GASPAR

GenAI-powered System for Privacy incident Analysis and Recovery

Language: Python - Size: 148 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 1 - Forks: 0

Mookpets/Adversarial-Robust-Phishing-Detector

Adversarially robust phishing email detection using DistilBERT, adversarial training, and a real-time Gradio interface. Built for cybersecurity and AI defense.

Language: Jupyter Notebook - Size: 7.81 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 1 - Forks: 0

jiep/offensive-ai-compilation

A curated list of useful resources that cover Offensive AI.

Language: HTML - Size: 17.8 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 1,213 - Forks: 127

dapurv5/awesome-red-teaming-llms

Repository accompanying the paper https://arxiv.org/abs/2407.14937

Size: 14.9 MB - Last synced at: 25 days ago - Pushed at: 29 days ago - Stars: 24 - Forks: 2

neomatrixcode/kernel-adversarial-ai

Código y demos para generar exploits de kernel vulnerables y defensas en tiempo real con IA.

Language: Python - Size: 9.77 KB - Last synced at: 5 days ago - Pushed at: 26 days ago - Stars: 0 - Forks: 0

phantasmlabs/phantasm

Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

Language: Svelte - Size: 782 KB - Last synced at: 27 days ago - Pushed at: 6 months ago - Stars: 165 - Forks: 5

rushout09/llm-security-startups

An awesome and comprehensive list of LLM Securtiy Startups.

Size: 16.6 KB - Last synced at: 16 days ago - Pushed at: 7 months ago - Stars: 8 - Forks: 0

mitre-atlas/atlas-data

ATLAS tactics, techniques, and case studies data

Language: Python - Size: 1.06 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 63 - Forks: 14

henchiyb/breaker-ai

Breaker AI - Security check for your LLM prompts

Language: TypeScript - Size: 196 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 4 - Forks: 1

dwain-barnes/PurPaaS-LLM

PurPaaS is an innovative open-source security testing platform that implements purple teaming (combined red and blue team approaches) to evaluate local LLM models through Ollama. By orchestrating autonomous agents, PurPaaS provides comprehensive security assessment of locally deployed AI models.

Language: Python - Size: 311 KB - Last synced at: 19 days ago - Pushed at: 7 months ago - Stars: 4 - Forks: 0

RHEcosystemAppEng/sast-ai-orchestrator

Controller for SAST-AI-Workflows. This project schedules, monitors, and serves workflow info to REST clients 🧠📡

Language: Java - Size: 24.4 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

modzy/sdk-python

Python library for Modzy Machine Learning Operations (MLOps) Platform

Language: Python - Size: 1.36 MB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 25 - Forks: 3

listendev/jibril-releases

Jibril: A performant and low impact Linux runtime security tool agent.

Language: Shell - Size: 1.67 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 12 - Forks: 1

frunamimon/ai-system-prompt

FULL v0, Cursor, Manus, Same.dev & Lovable System Prompts & AI Models.

Size: 77.1 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

Safetorun/PromptDefender

A prompt defence is a multi-layer defence that can be used to protect your applications against prompt injection attacks.

Language: Go - Size: 6.55 MB - Last synced at: 11 days ago - Pushed at: 7 months ago - Stars: 16 - Forks: 0

neonxploit/Dragon-Glitch---NeonXploit-Audit-v1.0-

Red-team audit on deepseek AI by lala aka NeonXploit (operation dragon Glitch)

Size: 2.28 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

GrizonRussell/SOC-Security-Log-Analyzer

SOC Security Log Analyzer: AI-powered threat detection for security professionals.

Language: Python - Size: 12.7 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

minher1/shadow-agents

Simulates adversarial AI threats using agentic behavior for cybersecurity red teaming.

Language: Python - Size: 4.88 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

lechmazur/deception

Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claude, GPT-4, Gemini, Llama, etc.) with standardized evaluation metrics.

Size: 36.1 KB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 26 - Forks: 2

PrittoRuban/deephish_detetion

AI-powered tool to detect phishing links, deepfake videos, fake images, and synthetic audio for safer browsing and content verification.

Language: JavaScript - Size: 4.59 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Hacking-Notes/VulnScan

Performing website vulnerability scanning using OpenAI technologie

Language: Python - Size: 952 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 64 - Forks: 5

iam-niranjan/SOC-Security-Log-Analyzer

SOC Security Log Analyzer: AI-powered threat detection for security professionals.

Language: Python - Size: 12.7 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

dewitt4/ai-model-security-monitor

Security monitoring tool that helps protect AI models from common attacks.

Language: Python - Size: 31.3 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 3 - Forks: 1

kereva-dev/kereva-scanner

Code scanner to check for issues in prompts and LLM calls

Language: Python - Size: 7.12 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 29 - Forks: 2

LetterLiGo/SafeGen_CCS2024

[CCS'24] SafeGen: Mitigating Unsafe Content Generation in Text-to-Image Models

Language: Python - Size: 2.65 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 129 - Forks: 19

ShiChen28/HP-MIA

A PyTorch implementation of "HP-MIA: A novel membership inference attack scheme for high membership prediction precision"

Language: Python - Size: 450 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

brabentil/AegisX

AegisX enhances financial transaction security using AI-driven threat detection and blockchain for tamper-proof records. It identifies anomalies in real time, preventing fraud and unauthorized access while ensuring transparency. Designed for fintechs and banks, AegisX provides a multi-layered defense against evolving cyber threats.

Size: 1.95 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

dewitt4/ai-security-alerts

Security monitoring system that logs suspicious activities and alerts your security team, allowing you to make informed decisions about escalating genuine threats.

Language: Python - Size: 8.79 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 4 - Forks: 1

roshanrateria/PhishGuardian

A Next-Generation Phishing Simulation & Awareness Platform

Language: Python - Size: 37.1 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

ZhengyuZhao/AI-Security-and-Privacy-Events

A curated list of academic events on AI Security & Privacy

Size: 118 KB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 147 - Forks: 16

cdot65/airs-postman-collection

Postman collection for Palo Alto Networks AI Runtime Security

Size: 27.3 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

4xyy/Mobile-Penetration-Testing-Tool

AI-Powered Mobile Application Penetration Testing Tool

Language: Python - Size: 3.77 MB - Last synced at: about 2 months ago - Pushed at: 8 months ago - Stars: 3 - Forks: 0

tsmotlp/AI-Security-Research

A curated collection of the latest academic research papers and developments in AI Security. This repository aims to provide a comprehensive source for researchers and enthusiasts to stay updated on AI Security trends and findings. Contributions welcome!

Size: 1010 KB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 18 - Forks: 3

jassics/awesome-genai-security

Curated list of links, references, books videos, tutorials (Free or Paid), Exploit, CTFs, Hacking Practices etc. which are related to GenAI and LLM Security

Size: 2.93 KB - Last synced at: 19 days ago - Pushed at: 5 months ago - Stars: 4 - Forks: 1

ErdemOzgen/RedAiRange

AI Red Teaming Range

Language: Jupyter Notebook - Size: 267 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 4 - Forks: 0

jay-johnson/train-ai-with-django-swagger-jwt

Train AI (Keras + Tensorflow) to defend apps with Django REST Framework + Celery + Swagger + JWT - deploys to Kubernetes and OpenShift Container Platform

Language: Python - Size: 2.7 MB - Last synced at: 11 days ago - Pushed at: over 6 years ago - Stars: 70 - Forks: 23

agentoverlay/awesome-multi-agent-security

awesome list of multi-agent security resources

Size: 27.3 KB - Last synced at: 13 days ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

alpernae/AIHTTPAnalyzer

AIHTTPAnalyzer revolutionizes web application security testing by bringing artificial intelligence capabilities to Burp Suite. This innovative extension harnesses the power of AI to automate vulnerability detection, provide intelligent analysis, and assist security professionals in identifying complex security issues.

Language: Java - Size: 20.5 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 21 - Forks: 9

ansh-info/chatgpt-package-hallucination

How AI-generated package hallucinations can lead to supply chain attacks, exploiting developers into installing malicious Python packages. For educational purposes only.

Language: Python - Size: 0 Bytes - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

VictoKu1/qr_analyzer

Cross-platform Flutter app for capturing or selecting images, detecting QR codes, and analyzing them with OpenAI. Reveals QR contents (URL, Wi-Fi, etc.) and potential security risks in a user-friendly interface. Perfect for quick, secure QR scanning.

Language: C++ - Size: 290 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

EzgiKorkmaz/AI-Safety

AAAI 2025 Tutorial on Machine Learning Safety

Size: 4.88 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

normster/llm_rules

RuLES: a benchmark for evaluating rule-following in language models

Language: Python - Size: 2.94 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 216 - Forks: 15

dewitt4/LLMGuardian

Comprehensive LLM AI Model protection | Protect your production GenAI LLM applications | cybersecurity toolset aligned to addressing OWASP vulnerabilities in Large Language Models - https://genai.owasp.org/llm-top-10/

Language: Python - Size: 286 KB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 2 - Forks: 3

SEC-CAFE/handbook

安全手册,企业安全实践、攻防与安全研究知识库

Language: CSS - Size: 94.8 MB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 34 - Forks: 4

AI-Security-Research-Group/.github

Size: 10.7 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

AdirD/prompt-security-node

🚀 Unofficial Node.js SDK for Prompt Security's Protection API.

Language: TypeScript - Size: 394 KB - Last synced at: 11 days ago - Pushed at: 7 months ago - Stars: 6 - Forks: 0

gxy110/GRAMSSAT

Code of the paper GRAMSSAT: An Efficient Label Inference Attack against Two-party Split Learning based on Gradient Matching and Semi-supervised Learning.

Language: Python - Size: 58.6 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

basicScandal/fsociety-ai

AI Testing Suite

Language: TypeScript - Size: 56.6 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

CyberAlbSecOP/MINOTAUR_Impossible_GPT_Security_Challenge

MINOTAUR: The STRONGEST Secure Prompt EVER! Prompt Security Challenge, Impossible GPT Security, Prompts Cybersecurity, Prompting Vulnerabilities, FlowGPT, Secure Prompting, Secure LLMs, Prompt Hacker, Cutting-edge Ai Security, Unbreakable GPT Agent, Anti GPT Leak, System Prompt Security.

Size: 23.4 KB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 10 - Forks: 2

sourceduty/Hack_Simulator

🏴‍☠️ Simulate the experience of hacking different software and systems.

Size: 13.7 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

HKU-TASR/Imperio

[IJCAI 2024] Imperio is an LLM-powered backdoor attack. It allows the adversary to issue language-guided instructions to control the victim model's prediction for arbitrary targets.

Language: Python - Size: 779 KB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 42 - Forks: 4

jay-johnson/antinex-core

Network exploit detection using highly accurate pre-trained deep neural networks with Celery + Keras + Tensorflow + Redis

Language: Jupyter Notebook - Size: 380 KB - Last synced at: 11 days ago - Pushed at: over 6 years ago - Stars: 21 - Forks: 2

metehan777/openai-internal-feedback-system

A sophisticated feedback management system focused on AI safety and alignment discussions for any AI's leadership team.

Language: Python - Size: 1.09 MB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

AI-Security-Research-Group/contexi

Contexi let you interact with entire codebase or data with context using a local LLM on your system.

Language: Python - Size: 63.5 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

wssun/TiSE-CodeLM-Security

This repository provide the studies on the security of language models for code (CodeLMs).

Language: Python - Size: 267 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 28 - Forks: 0

CyberAlbSecOP/Awesome_CyberSec_Bible

Cyber-Security Bible! Theory and Tools, Kali Linux, Penetration Testing, Bug Bounty, CTFs, Malware Analysis, Cryptography, Secure Programming, Web App Security, Cloud Security, Devsecops, Ethical Hacking, Social Engineering, Privacy, Incident Response, Threat Assestment, Personal Security, Ai Security, Android Security, Iot Security, Standards.

Size: 287 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 39 - Forks: 8

moonwatcher-ai/moonwatcher

Evaluation & testing framework for computer vision models

Language: Python - Size: 14.4 MB - Last synced at: 7 days ago - Pushed at: 11 months ago - Stars: 16 - Forks: 2

sourceduty/Security_Simulator

👮 Simulate various public and private security scenarios.

Size: 6.84 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

jay-johnson/antinex-datasets

Datasets for training deep neural networks to defend software applications

Language: Python - Size: 3.88 MB - Last synced at: 11 days ago - Pushed at: almost 7 years ago - Stars: 8 - Forks: 0

OphirOren/Lakera-Gandalf

This is my prompts for Lakera's Gandalf challenges

Size: 29.3 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

Jai0212/secure-auth-ai

An npm package for advanced sign-in security, including AI-based risk assessment, anomaly detection, real-time PostgreSQL database, automated user management and MFA. Compatible with React, Vue, and Angular

Language: Python - Size: 587 KB - Last synced at: 24 days ago - Pushed at: 10 months ago - Stars: 0 - Forks: 1

reds-lab/Meta-Sift

The official implementation of USENIX Security'23 paper "Meta-Sift" -- Ten minutes or less to find a 1000-size or larger clean subset on poisoned dataset.

Language: Python - Size: 3.62 MB - Last synced at: 11 months ago - Pushed at: about 2 years ago - Stars: 15 - Forks: 4

reds-lab/Narcissus

The official implementation of the CCS'23 paper, Narcissus clean-label backdoor attack -- only takes THREE images to poison a face recognition dataset in a clean-label way and achieves a 99.89% attack success rate.

Language: Python - Size: 143 KB - Last synced at: 11 months ago - Pushed at: about 2 years ago - Stars: 96 - Forks: 10

modzy/sdk-go

The Golang library for Modzy Machine Learning Operations (MLOps) Platform

Language: Go - Size: 13.3 MB - Last synced at: 11 months ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 1

AiShieldsOrg/AiShieldsWeb

AiShields is an open-source Artificial Intelligence Data Input and Output Sanitizer

Language: Python - Size: 3.55 MB - Last synced at: 2 months ago - Pushed at: 12 months ago - Stars: 3 - Forks: 4

sachink1729/AI-Assistant-Clinics-Medical-Data-Qdrant-Dspy-Groq

Building Private Healthcare AI Assistant for Clinics Using Qdrant Hybrid Cloud, DSPy and Groq - Llama3

Language: Jupyter Notebook - Size: 2.91 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

AashiqRamachandran/app-catcher

Discover and inventory the SaaS applications used across your organization by intelligently analyzing incoming Gmail emails, providing valuable insights into your SaaS landscape.

Language: Python - Size: 23.4 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 1

AashiqRamachandran/my-precious-pii

GPT 2 model trained on fake PII to study PII leakage from large language models

Language: HTML - Size: 1.3 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1

ivycheck/ivycheck-python-sdk

Python SDK for IvyCheck

Language: Jupyter Notebook - Size: 22.5 KB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

ai-risk-armour/Vulnerable-AI-Chatbot

An intentionally vulnerable AI chatbot to learn and practice AI Security.

Language: HTML - Size: 1.94 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

AIPwn/awesome-ai-pwn

Size: 8.79 KB - Last synced at: 18 days ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

alpernae/GeminiHacker-CLI

GeminiHacker is a Python script designed to harness the power of a generative AI model for security research, bug bounty hunting, and vulnerability scanning. This README.md file provides detailed instructions on how to install, configure, and use the script effectively.

Language: Python - Size: 12.7 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

AnthenaMatrix/Prompt-Injection-Testing-Tool

The Prompt Injection Testing Tool is a Python script designed to assess the security of your AI system's prompt handling against a predefined list of user prompts commonly used for injection attacks. This tool utilizes the OpenAI GPT-3.5 model to generate responses to system-user prompt pairs and outputs the results to a CSV file for analysis.

Language: Python - Size: 7.81 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 10 - Forks: 1

Related Keywords
ai-security 123 ai 37 llm-security 24 llm 22 security 21 machine-learning 16 cybersecurity 16 artificial-intelligence 13 prompt-injection 13 deep-learning 13 security-tools 10 ai-safety 10 adversarial-attacks 8 ai-security-tool 8 python 8 openai 7 chatgpt 7 red-teaming 7 backdoor-attacks 7 prompt-engineering 7 generative-ai 6 mlops 6 devsecops 6 adversarial-machine-learning 6 security-research 6 tensorflow 6 ethical-hacking 6 keras 5 deep-neural-networks 5 explainable-ai 5 anti-nex 5 computer-vision 5 penetration-testing 5 docker 5 mcp 5 pytorch 4 pentesting 4 machine-learning-security 4 owasp 4 ai-agents 4 cyber-security 4 red-team-tools 4 api-client 4 drift-detection 4 deepfake-detection 4 genai 4 kubernetes 4 microservices 4 production-machine-learning 4 machine-learning-operations 4 agentic-ai 4 security-testing 3 gemini-api 3 hacking 3 gpt 3 vulnerability 3 claude 3 gemini-ai 3 model-serving 3 rest-api 3 cli 3 incident-response 3 ai-red-teaming 3 data-privacy 3 rag 3 red-team 3 genai-security 3 open-source-security 3 npm-package 3 ai-assistant 3 application-security 3 vulnerability-scanners 3 research 3 ai-red-team 3 adversarial-defense 3 phishing-detection 3 nlp 3 adversarial-examples 3 mcp-security 3 responsible-ai 3 trustworthy-ai 3 backdoor-defense 3 aisecurity 3 serving 2 llm-testing 2 human-in-the-loop 2 multi-agent-systems 2 copilot 2 prompt-injection-llm-security 2 awesome 2 reinforcement-learning 2 open-source 2 owasp-top-10 2 prompt 2 ai-privacy 2 data-poisoning 2 llmsecurity 2 api-security 2 security-tool 2 celery 2