GitHub / ModelTC / LightCompress
[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ModelTC%2FLightCompress
PURL: pkg:github/ModelTC/LightCompress
Stars: 514
Forks: 60
Open issues: 32
License: apache-2.0
Language: Python
Size: 30.1 MB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: 5 days ago
Pushed at: 5 days ago
Last synced at: 5 days ago
Topics: awq, benchmark, deepseek-r1, deepseek-v3, deployment, evaluation, internlm2, large-language-models, llm, lvlm, mixtral, post-training-quantization, pruning, quantization, smoothquant, token-reduction, tool, vllm, wan