GitHub / codefuse-ai / codefuse-devops-eval
Industrial-first evaluation benchmark for LLMs in the DevOps/AIOps domain.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codefuse-ai%2Fcodefuse-devops-eval
PURL: pkg:github/codefuse-ai/codefuse-devops-eval
Stars: 631
Forks: 44
Open issues: 9
License: other
Language: Python
Size: 10.1 MB
Dependencies parsed at:
24
Created at: over 1 year ago
Updated at: about 1 month ago
Pushed at: 11 months ago
Last synced at: 25 days ago
Commit Stats
Commits: 108
Authors: 8
Mean commits per author: 13.5
Development Distribution Score: 0.259
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/codefuse-ai/codefuse-devops-eval
- accelerate >=0.21.0
- datasets >=2.12.0
- deepspeed >=0.9.3
- einops *
- fastapi ==0.95.1
- gradio >=3.36.0
- jieba *
- jsonlines *
- loguru *
- matplotlib *
- nltk *
- peft >=0.4.0
- pydantic ==1.10.11
- rouge-chinese *
- scipy *
- sentencepiece *
- sse-starlette *
- tiktoken *
- torch >=2.0.1
- transformers ==4.32.0
- transformers_stream_generator ==0.0.4
- trl >=0.5.0
- uvicorn *
- xformers *