An open API service providing repository metadata for many open source software ecosystems.

GitHub / CodeEval-Pro / CodeEval-Pro

Official repo for "HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation Task"

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CodeEval-Pro%2FCodeEval-Pro
PURL: pkg:github/CodeEval-Pro/CodeEval-Pro

Stars: 26
Forks: 2
Open issues: 0

License: None
Language: Python
Size: 4.1 MB
Dependencies parsed at: Pending

Created at: 6 months ago
Updated at: 2 months ago
Pushed at: 2 months ago
Last synced at: 2 months ago

Topics: code-generation, llm, llm-evaluation, llm-evaluation-toolkit, llm-reasoning, llm4code

    Loading...