Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / promptfoo / promptfoo
Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/promptfoo%2Fpromptfoo
Stars: 2,981
Forks: 194
Open Issues: 63
License: mit
Language: TypeScript
Repo Size: 14.5 MB
Dependencies:
1,315
Created: about 1 year ago
Updated: about 17 hours ago
Last pushed: about 17 hours ago
Last synced: about 16 hours ago
Topics: ci, ci-cd, cicd, evaluation, evaluation-framework, llm, llm-eval, llm-evaluation, llm-evaluation-framework, llmops, prompt-engineering, prompt-testing, prompts, rag, testing
Funding links: https://github.com/sponsors/typpo
Files
Dependencies
- @types/js-yaml ^4.0.5 development
- @types/prismjs ^1.26.0 development
- prisma ^5.2.0 development
- @emotion/react ^11.11.1
- @emotion/styled ^11.11.0
- @mui/icons-material ^5.14.3
- @mui/material ^5.14.4
- @prisma/client ^5.2.0
- @tanstack/react-table ^8.9.3
- @types/diff ^5.0.3
- @types/node 20.4.10
- @types/react 18.2.20
- @types/react-dom 18.2.7
- @types/react-syntax-highlighter ^15.5.7
- @types/uuid ^9.0.2
- chart.js ^4.3.3
- debounce ^1.2.1
- diff ^5.1.0
- eslint 8.47.0
- eslint-config-next 13.4.13
- js-yaml ^4.1.0
- next 13.4.13
- opener ^1.5.2
- prismjs ^1.29.0
- react 18.2.0
- react-dnd ^16.0.1
- react-dnd-html5-backend ^16.0.1
- react-dom 18.2.0
- react-error-boundary ^4.0.11
- react-simple-code-editor ^0.13.1
- react-syntax-highlighter ^15.5.0
- socket.io ^4.7.2
- socket.io-client ^4.7.2
- tiny-invariant ^1.3.1
- typescript 5.1.6
- uuid ^9.0.0
- zustand ^4.4.1
- PyYAML ==6.0
- SQLAlchemy ==2.0.18
- aiohttp ==3.8.5
- aiosignal ==1.3.1
- async-timeout ==4.0.2
- attrs ==23.1.0
- certifi ==2023.5.7
- charset-normalizer ==3.1.0
- dataclasses-json ==0.5.9
- frozenlist ==1.3.3
- greenlet ==2.0.2
- idna ==3.4
- langchain ==0.0.228
- langchainplus-sdk ==0.0.20
- marshmallow ==3.19.0
- marshmallow-enum ==1.5.1
- multidict ==6.0.4
- mypy-extensions ==1.0.0
- numexpr ==2.8.4
- numpy ==1.25.0
- openai ==0.27.8
- openapi-schema-pydantic ==1.2.4
- packaging ==23.1
- pydantic ==1.10.11
- requests ==2.31.0
- tenacity ==8.2.2
- tqdm ==4.65.0
- typing-inspect ==0.9.0
- typing_extensions ==4.7.1
- urllib3 ==2.0.3
- yarl ==1.9.2
- node 16-alpine build
- actions/checkout v3 composite
- actions/setup-node v3 composite
- bahmutov/npm-install v1 composite
- @types/jest ^29.5.1 development
- jest ^29.5.0 development
- ts-jest ^29.1.0 development
- typescript ^5.0.4 development
- @types/async ^3.2.20 development
- @types/cache-manager ^4.0.2 development
- @types/cache-manager-fs-hash ^0.0.1 development
- @types/cli-progress ^3.11.0 development
- @types/cors ^2.8.13 development
- @types/debounce ^1.2.1 development
- @types/express ^4.17.17 development
- @types/glob ^8.1.0 development
- @types/jest ^29.5.1 development
- @types/js-yaml ^4.0.5 development
- @types/node-fetch ^2.6.4 development
- @types/nunjucks ^3.2.2 development
- @types/opener ^1.4.0 development
- @types/semver ^7.5.0 development
- babel-jest ^29.5.0 development
- jest ^29.5.0 development
- jest-watch-typeahead ^2.2.2 development
- prettier ^2.8.8 development
- ts-jest ^29.1.0 development
- ts-node ^10.9.1 development
- typescript ^5.0.4 development
- @anthropic-ai/sdk ^0.5.2
- @apidevtools/json-schema-ref-parser ^10.1.0
- async ^3.2.4
- cache-manager ^4.1.0
- cache-manager-fs-hash ^1.0.0
- chalk ^4.1.2
- cli-progress ^3.12.0
- cli-table3 ^0.6.3
- commander ^10.0.1
- cors ^2.8.5
- csv-parse ^5.3.8
- csv-stringify ^6.3.2
- debounce ^1.2.1
- express ^4.18.2
- glob ^10.2.6
- js-yaml ^4.1.0
- node-fetch ^2.6.7
- nunjucks ^3.2.4
- opener ^1.5.2
- replicate ^0.12.3
- rouge ^1.0.3
- semver ^7.5.3
- socket.io ^4.6.1
- tiny-invariant ^1.3.1
- winston ^3.8.2