Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / huggingface / optimum-habana

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/huggingface%2Foptimum-habana

Stars: 102
Forks: 107
Open Issues: 58

License: apache-2.0
Language: Python
Repo Size: 5.35 MB
Dependencies: 158

Created: over 2 years ago
Updated: about 2 months ago
Last pushed: about 2 months ago
Last synced: about 2 months ago

Commit Stats

Commits: 198
Authors: 12
Mean commits per author: 16.5
Development Distribution Score: 0.141
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/huggingface/optimum-habana

Topics: bert, fine-tuning, habana, hpu, transformers

Files

Readme

Dependencies

examples/language-modeling/requirements.txt pypi

datasets >=1.8.0
protobuf *
sentencepiece *
sklearn *
torch >=1.3

examples/question-answering/requirements.txt pypi

datasets >=1.8.0
torch >=1.3.0
transformers >=4.18.0

examples/summarization/requirements.txt pypi

datasets >=1.8.0
nltk *
protobuf *
py7zr *
rouge-score *
sentencepiece *
torch >=1.3

examples/text-classification/requirements.txt pypi

datasets >=1.8.0
protobuf *
scikit-learn *
scipy *
sentencepiece *
torch >=1.3

examples/translation/requirements.txt pypi

datasets >=1.8.0
protobuf *
py7zr *
sacrebleu >=1.4.12
sentencepiece *
torch >=1.3

.github/workflows/build_pr_documentation.yml actions

actions/checkout v2 composite
peter-evans/create-or-update-comment v1 composite
peter-evans/find-comment v2 composite
thollander/actions-comment-pull-request v1 composite

.github/workflows/check_code_quality.yml actions

actions/checkout v2 composite
actions/setup-python v2 composite

.github/workflows/fast_tests.yml actions

actions/checkout v2 composite
aws-actions/configure-aws-credentials v1 composite
philschmid/philschmid-ec2-github-runner main composite

.github/workflows/slow_tests.yml actions

actions/checkout v2 composite
aws-actions/configure-aws-credentials v1 composite
philschmid/philschmid-ec2-github-runner main composite

docs/Dockerfile docker

vault.habana.ai/gaudi-docker/1.7.1/ubuntu20.04/habanalabs/pytorch-installer-1.13.0 latest build

examples/multi-node-training/Dockerfile docker

vault.habana.ai/gaudi-docker/1.7.1/ubuntu20.04/habanalabs/pytorch-installer-1.13.0 latest build

examples/audio-classification/requirements.txt pypi

datasets >=1.14.0
evaluate *
librosa *

examples/image-classification/requirements.txt pypi

datasets >=2.4.0
evaluate *
scikit-learn *
torch >=1.5.0
torchvision >=0.6.0

examples/speech-recognition/requirements.txt pypi

datasets >=1.18.0
evaluate *
jiwer *
librosa *

.github/workflows/delete_doc_comment.yml actions

.github/workflows/delete_doc_comment_trigger.yml actions

.github/workflows/upload_pr_documentation.yml actions

text-generation-inference/Dockerfile docker

base latest build
chef latest build
lukemathwalker/cargo-chef latest-rust-1.70 build
python 3.9 build
vault.habana.ai/gaudi-docker/1.11.0/ubuntu22.04/habanalabs/pytorch-installer-2.0.1 latest build

examples/contrastive-image-text/requirements.txt pypi

datasets >=1.8.0

examples/text-generation/requirements.txt pypi

datasets *
peft *

pyproject.toml pypi

setup.py pypi

text-generation-inference/server/pyproject.toml pypi

grpc-interceptor ^0.15.0
grpcio ^1.51.1
grpcio-reflection *
grpcio-status *
hf-transfer ^0.1.2
huggingface-hub ^0.16.4
loguru ^0.6.0
opentelemetry-api ^1.15.0
opentelemetry-exporter-otlp ^1.15.0
opentelemetry-instrumentation-grpc ^0.36b0
optimum *
optimum-habana 1.7.2
peft ^0.4.0
protobuf ^3.20.3
python >=3.9,<3.13
safetensors 0.3.2
sentencepiece ^0.1.97
tokenizers ^0.13.3
transformers ^4.32.1
typer ^0.6.1

text-generation-inference/server/requirements.txt pypi

accelerate ==0.22.0
aiohttp ==3.8.5
aiosignal ==1.3.1
async-timeout ==4.0.3
attrs ==23.1.0
backoff ==2.2.1
certifi ==2023.7.22
charset-normalizer ==3.2.0
click ==8.1.7
colorama ==0.4.6
coloredlogs ==15.0.1
datasets ==2.14.4
deprecated ==1.2.14
diffusers ==0.20.1
dill ==0.3.7
filelock ==3.12.3
frozenlist ==1.4.0
fsspec ==2023.6.0
googleapis-common-protos ==1.60.0
grpc-interceptor ==0.15.3
grpcio ==1.57.0
grpcio-reflection ==1.48.2
grpcio-status ==1.48.2
hf-transfer ==0.1.3
huggingface-hub ==0.16.4
humanfriendly ==10.0
idna ==3.4
importlib-metadata ==6.8.0
jinja2 ==3.1.2
loguru ==0.6.0
markupsafe ==2.1.3
mpmath ==1.3.0
multidict ==6.0.4
multiprocess ==0.70.15
networkx ==3.1
numpy ==1.25.2
opentelemetry-api ==1.15.0
opentelemetry-exporter-otlp ==1.15.0
opentelemetry-exporter-otlp-proto-grpc ==1.15.0
opentelemetry-exporter-otlp-proto-http ==1.15.0
opentelemetry-instrumentation ==0.36b0
opentelemetry-instrumentation-grpc ==0.36b0
opentelemetry-proto ==1.15.0
opentelemetry-sdk ==1.15.0
opentelemetry-semantic-conventions ==0.36b0
optimum ==1.12.0
optimum-habana ==1.7.2
packaging ==23.1
pandas ==2.0.3
peft ==0.4.0
pillow ==10.0.0
protobuf ==3.20.3
psutil ==5.9.5
pyarrow ==13.0.0
pyreadline3 ==3.4.1
python-dateutil ==2.8.2
pytz ==2023.3
pyyaml ==6.0.1
regex ==2023.8.8
requests ==2.31.0
safetensors ==0.3.2
sentencepiece ==0.1.99
setuptools ==68.1.2
six ==1.16.0
sympy ==1.12
tokenizers ==0.13.3
tqdm ==4.66.1
transformers ==4.32.1
typer ==0.6.1
typing-extensions ==4.7.1
tzdata ==2023.3
urllib3 ==2.0.4
win32-setctime ==1.1.0
wrapt ==1.15.0
xxhash ==3.3.0
yarl ==1.9.2
zipp ==3.16.2