Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / kyegomez / LongNet
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FLongNet
Stars: 651
Forks: 62
Open Issues: 4
License: apache-2.0
Language: Python
Repo Size: 40.3 MB
Dependencies:
25
Created: 11 months ago
Updated: 29 days ago
Last pushed: 5 months ago
Last synced: 28 days ago
Commit Stats
Commits: 141
Authors: 1
Mean commits per author: 141.0
Development Distribution Score: 0.0
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/kyegomez/LongNet
Topics: artificial-intelligence, attention, attention-is-all-you-need, attention-mechanisms, chatgpt, context-length, gpt3, gpt4, machine-learning, transformer
Funding links: https://github.com/sponsors/kyegomez
Files
Dependencies
- actions/checkout v3 composite
- actions/setup-python v3 composite
- pypa/gh-action-pypi-publish 27b31702a0e7fc50959f5ad993c78deac1bdfc29 composite
- accelerate *
- beartype *
- bitsandbytes *
- dataclasses *
- einops *
- fairscale *
- python ^3.6
- timm *
- torch *
- torchscale *
- transformers *
- accelerate *
- beartype *
- bitsandbytes *
- einops *
- fairscale *
- ninja *
- packaging *
- pthflops *
- timm *
- torch *
- transformers *