Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / OpenGVLab / OmniQuant
[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OpenGVLab%2FOmniQuant
Stars: 546
Forks: 43
Open Issues: 24
License: mit
Language: Python
Repo Size: 8.17 MB
Dependencies:
26
Created: 9 months ago
Updated: about 2 months ago
Last pushed: 2 months ago
Last synced: about 2 months ago
Topics: large-language-models, llm, quantization
Files
Loading...
Readme
Loading...
Dependencies
pyproject.toml
pypi
- accelerate *
- attributedict *
- datasets >=2.0.0
- einops *
- jsonlines *
- numexpr *
- omegaconf >=2.2
- openai >=0.6.4
- peft >=0.2.0
- protobuf *
- pybind11 >=2.6.2
- pycountry *
- pytablewriter *
- rouge-score >=0.0.4
- sacrebleu ==1.5.0
- scikit-learn >=0.24.1
- sentencepiece *
- sqlitedict *
- texttable *
- tokenizers >=0.12.1
- toml *
- torch >=2.0.0
- torchvision *
- tqdm-multiprocess *
- transformers >=4.31.0
- zstandard *