An open API service providing repository metadata for many open source software ecosystems.

Topic: "prompt-testing"

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Language: TypeScript - Size: 361 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 6,506 - Forks: 527

msoedov/agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

Language: Python - Size: 21.2 MB - Last synced at: 5 days ago - Pushed at: 14 days ago - Stars: 1,350 - Forks: 211

babelcloud/LLM-RGB

LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.

Language: TypeScript - Size: 3.96 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 157 - Forks: 14

prompt-foundry/typescript-sdk

The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

Language: TypeScript - Size: 20.9 MB - Last synced at: 10 days ago - Pushed at: 8 months ago - Stars: 6 - Forks: 1

yukinagae/genkitx-promptfoo

Community Plugin for Genkit to use Promptfoo

Language: TypeScript - Size: 553 KB - Last synced at: 26 days ago - Pushed at: 4 months ago - Stars: 3 - Forks: 0

calibrtr/llm-prompt-test

LLM Prompt Test helps you test Large Language Models (LLMs) prompts to ensure they consistently meet your expectations.

Language: TypeScript - Size: 209 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 3 - Forks: 0

yukinagae/promptfoo-sample

Sample project demonstrates how to use Promptfoo, a test framework for evaluating the output of generative AI models

Size: 334 KB - Last synced at: 26 days ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

Sigmakib2/openai-prompt-testing-playground

A dynamic and interactive playground for testing and refining prompts with OpenAI's language models. Includes customizable inputs for prompts, advanced model settings, and live response streaming for seamless experimentation.

Language: HTML - Size: 7.81 KB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

yukinagae/genkit-promptfoo-sample

Sample implementation demonstrating how to use Firebase Genkit with Promptfoo

Language: TypeScript - Size: 2.3 MB - Last synced at: 26 days ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

abdullahkhalid00/prompt-db

A collection of prompts that I use on a day-to-day basis for work and leisure.

Size: 4.88 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 1