Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / SqueezeAILab / SqueezeLLM
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SqueezeAILab%2FSqueezeLLM
Stars: 569
Forks: 35
Open Issues: 10
License: mit
Language: Python
Repo Size: 1.5 MB
Dependencies:
6
Created: 12 months ago
Updated: about 1 month ago
Last pushed: about 1 month ago
Last synced: about 1 month ago
Topics: efficient-inference, large-language-models, llama, llm, localllm, model-compression, natural-language-processing, post-training-quantization, quantization, small-models, text-generation, transformer
Files
Dependencies
- accelerate *
- datasets *
- sentencepiece *
- tokenizers >=0.12.1
- torch *
- transformers ==4.29.0