RobertCsordas/transformer_generalization

The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We significantly improve the systematic generalization of transformer models on a variety of datasets using simple tricks and careful considerations.

Language: Python - Size: 85 KB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 66 - Forks: 13

RobertCsordas/ndr

The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".

Language: Python - Size: 129 KB - Last synced at: 6 months ago - Pushed at: over 3 years ago - Stars: 32 - Forks: 7

ShiningLab/Systematic-Generalization-via-Meaningful-Learning

This repository is for the paper Revisit Systematic Generalization via Meaningful Learning in Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP.

Language: Python - Size: 40.6 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 6 - Forks: 0

liqing-ustc/HINT

Official implementation of ICLR 2023 paper "A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and Semantics"

Language: Jupyter Notebook - Size: 351 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 0

Hritikbansal/MultivariateTimeSeries_Generalization

Language: Jupyter Notebook - Size: 50.7 MB - Last synced at: 12 months ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

raillab/specialization_of_neural_modules

Code repository for reproducing the experiments from the paper: "On the Specialization of Neural Modules"

Language: Python - Size: 1010 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 1