Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / tomaarsen / attention_sinks
Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tomaarsen%2Fattention_sinks
Stars: 635
Forks: 42
Open Issues: 19
License: apache-2.0
Language: Python
Repo Size: 8.66 MB
Dependencies:
3
Created: 8 months ago
Updated: 28 days ago
Last pushed: about 1 month ago
Last synced: 26 days ago
Commit Stats
Commits: 85
Authors: 5
Mean commits per author: 17.0
Development Distribution Score: 0.082
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/tomaarsen/attention_sinks
Topics: llm, llms, nlp, python, transformers
Files
Dependencies
- tokenizers >=0.14,<0.15
- torch *
- transformers ==4.34.0