GitHub topics: retnet
ednialzavlare/MixKABRN
This is the repo for the MixKABRN Neural Network (Mixture of Kolmogorov-Arnold Bit Retentive Networks), and an attempt at first adapting it for training on text, and later adjust it for other modalities.
Language: Python - Size: 85.9 KB - Last synced at: 3 months ago - Pushed at: 12 months ago - Stars: 4 - Forks: 0
JosefAlbers/Phi-3-Vision-MLX
Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
Language: Jupyter Notebook - Size: 5.95 MB - Last synced at: 6 months ago - Pushed at: 8 months ago - Stars: 227 - Forks: 16
smallscientist1/attention_autotuner
an autotuner for the flash version of attention and retnet
Language: C++ - Size: 454 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 3 - Forks: 0
jiaowoguanren0615/RetNet_ViT-RMT-
Language: Python - Size: 88.9 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 25 - Forks: 2
Faptimus420/RetNet-keras-core Fork of Jamie-Stirling/RetNet
An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"
Language: Python - Size: 45.9 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0
