Topic: "prompt-testing"
promptfoo/promptfoo
Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
Language: TypeScript - Size: 285 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 8,334 - Forks: 691
msoedov/agentic_security
Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪
Language: Python - Size: 21.5 MB - Last synced at: 5 days ago - Pushed at: 19 days ago - Stars: 1,658 - Forks: 256
babelcloud/LLM-RGB
LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
Language: TypeScript - Size: 4.97 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 161 - Forks: 14
prompt-foundry/typescript-sdk
The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.
Language: TypeScript - Size: 20.9 MB - Last synced at: 26 days ago - Pushed at: 12 months ago - Stars: 6 - Forks: 1
yukinagae/genkitx-promptfoo
Community Plugin for Genkit to use Promptfoo
Language: TypeScript - Size: 553 KB - Last synced at: 14 days ago - Pushed at: 8 months ago - Stars: 4 - Forks: 0
calibrtr/llm-prompt-test
LLM Prompt Test helps you test Large Language Models (LLMs) prompts to ensure they consistently meet your expectations.
Language: TypeScript - Size: 209 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0
jhd3197/Prompture
Prompture is an API-first library for requesting structured JSON output from LLMs (or any structure), validating it against a schema, and running comparative tests between models.
Language: Python - Size: 42 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 0
radoslaw-sz/maia
A pytest-based framework for testing multi AI agents systems. It provides a flexible and extensible platform for complex multi-agent simulations. Supports many integrations like LiteLLM, CrewAI, LangChain etc.
Language: Python - Size: 1.9 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 1 - Forks: 0
yukinagae/promptfoo-sample
Sample project demonstrates how to use Promptfoo, a test framework for evaluating the output of generative AI models
Size: 334 KB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0
snowz123/team-agents
🐙 Team Agents unifica 82 especialistas en IA para resolver desafíos con chat inteligente, analista de requisitos y subida de documentos. Plataforma futurista y modular.
Language: Python - Size: 126 KB - Last synced at: about 13 hours ago - Pushed at: about 15 hours ago - Stars: 0 - Forks: 0
Sigmakib2/openai-prompt-testing-playground
A dynamic and interactive playground for testing and refining prompts with OpenAI's language models. Includes customizable inputs for prompts, advanced model settings, and live response streaming for seamless experimentation.
Language: HTML - Size: 7.81 KB - Last synced at: 6 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0
yukinagae/genkit-promptfoo-sample
Sample implementation demonstrating how to use Firebase Genkit with Promptfoo
Language: TypeScript - Size: 2.3 MB - Last synced at: 30 days ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
abdullahkhalid00/prompt-db
A collection of prompts that I use on a day-to-day basis for work and leisure.
Size: 4.88 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 1
