GitHub topics: fast-weight-programmers
kazuki-irie/hybrid-memory
Official repository for the paper "Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers"
Language: Python - Size: 610 KB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 3 - Forks: 0

IDSIA/automated-cl
Official repository for the paper "Automating Continual Learning"
Language: Python - Size: 1.05 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 14 - Forks: 3

IDSIA/neuraldiffeq-fwp
Official repository for the paper "Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules" (NeurIPS 2022)
Language: Python - Size: 140 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 22 - Forks: 4

IDSIA/lmtool-fwp
PyTorch Language Modeling Toolkit for Fast Weight Programmers
Language: Python - Size: 184 KB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 17 - Forks: 4

IDSIA/modern-srwm
Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep RL Workshop) and "Accelerating Neural Self-Improvement via Bootstrapping" (ICLR 2023 Workshop)
Language: Python - Size: 18.3 MB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 170 - Forks: 17

kazuki-irie/kv-memory-brain
Official Code Repository for the paper "Key-value memory in the brain"
Language: Jupyter Notebook - Size: 725 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 20 - Forks: 2

IDSIA/recurrent-fwp
Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
Language: Python - Size: 5.61 MB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 48 - Forks: 5

IDSIA/fwp-formal-lang
Official repository for the paper "Practical Computational Power of Linear Transformers and Their Recurrent and Self-Referential Extensions" (EMNLP 2023)
Language: Cuda - Size: 44.9 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 5 - Forks: 1

kazuki-irie/dct-fast-weights
PyTorch implementation of DCT fast weight RNNs
Language: Python - Size: 11.7 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 4 - Forks: 0

IDSIA/fpainter
Official repository for the paper "Images as Weight Matrices: Sequential Image Generation Through Synaptic Learning Rules" (ICLR 2023)
Language: Python - Size: 320 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 12 - Forks: 3
