Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / Ki6an / fastT5
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ki6an%2FfastT5
Stars: 541
Forks: 68
Open Issues: 24
License: apache-2.0
Language: Python
Repo Size: 277 KB
Dependencies:
7
Created: about 3 years ago
Updated: about 1 month ago
Last pushed: about 1 year ago
Last synced: 26 days ago
Topics: deep-learning, fast, fastt5, inference, inference-speed, nlp, onnx, onnxruntime, python, pytorch, quantization, quantized-onnx-models, question-answering, t5, transformer, translation
Files
Dependencies
- onnx *
- onnxruntime ==1.10.0
- progress >=1.5
- psutil *
- sentencepiece *
- torch >=1.7.0,
- transformers >4.6.1