An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: long-range-arena

lucidrains/Mega-pytorch

Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena

Language: Python - Size: 34.2 MB - Last synced at: 6 days ago - Pushed at: almost 2 years ago - Stars: 203 - Forks: 11

hazdzz/paramixer

The PyTorch implementation of Paramixer.

Language: Python - Size: 19.5 KB - Last synced at: 2 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

FutureComputing4AI/Hrrformer

Hrrformer: A Neuro-symbolic Self-attention Model (ICML23)

Language: Python - Size: 126 KB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 52 - Forks: 6

FutureComputing4AI/HGConv

HGConv: Holographic Global Convolutional Networks

Language: Python - Size: 120 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 1

iboud0/LRA-Image-Classification-on-Sequences-of-Pixels

Benchmarking sequence-based models on CIFAR-10 for the LRA benchmark. Implemented and evaluated models like TrellisNet, LipschitzRNN, PiT, Nyströmformer, and FNet for image classification

Language: Jupyter Notebook - Size: 192 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

OSU-STARLAB/LeaPformer

[ICML 2024] Official implementation of "LeaPformer: Enabling Linear Transformers for Autoregressive and Simultaneous Tasks via Learned Proportions."

Language: Python - Size: 20.1 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 9 - Forks: 1

lucaslingle/e-lra

Streamlined variant of Long-Range Arena with pinned dependencies, automated data downloads, and deterministic shuffling.

Language: Python - Size: 186 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0