An open API service providing repository metadata for many open source software ecosystems.

Topic: "ai-benchmark"

microsoft/WindowsAgentArena

Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.

Language: Python - Size: 191 MB - Last synced at: about 9 hours ago - Pushed at: 8 days ago - Stars: 689 - Forks: 67

TheAgentCompany/TheAgentCompany

An agent benchmark with tasks in a simulated software company.

Language: Python - Size: 6.58 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 279 - Forks: 34

kaykycampos/gta-benchmark

GTA (Guess The Algorithm) Benchmark - A tool for testing AI reasoning capabilities

Size: 1.95 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 8 - Forks: 0

playsaurus-inc/play-bench

PlayBench is a platform that evaluates AI models by having them compete in various games and creative tasks. Unlike traditional benchmarks that focus on text generation quality or factual knowledge, PlayBench tests models on skills like strategic thinking, pattern recognition, and creative problem-solving.

Language: Blade - Size: 901 KB - Last synced at: about 9 hours ago - Pushed at: about 9 hours ago - Stars: 1 - Forks: 0

petmal/MindTrial

MindTrial: Evaluate and compare AI language models (LLMs) on text-based tasks with optional file/image attachments. Supports multiple providers (OpenAI, Google, Anthropic, DeepSeek), custom tasks in YAML, and HTML/CSV reports.

Language: Go - Size: 143 KB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 0 - Forks: 0