long-context-transformers | Topic

Topic: "long-context-transformers"

lucidrains/block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch

Language: Python - Size: 34.2 MB - Last synced at: 1 day ago - Pushed at: 9 months ago - Stars: 217 - Forks: 20

HKUNLP/STRING

[ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"

Language: Python - Size: 21.6 MB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 72 - Forks: 3

MileBench/MileBench

This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"

Language: Python - Size: 3.52 MB - Last synced at: 3 months ago - Pushed at: 10 months ago - Stars: 29 - Forks: 1

4AI/RAN

RAN: Recurrent Attention Networks for Long-text Modeling | Findings of ACL23

Language: Python - Size: 556 KB - Last synced at: 26 days ago - Pushed at: almost 2 years ago - Stars: 22 - Forks: 3

arnavdantuluri/long-context-transformers

A repository to get train transformers to access longer context for causal language models, most of these methods are still in testing. Try them out if you'd like but please lmk your results so we don't duplicate work :)

Language: Python - Size: 188 KB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 2

Related Topics

long-context-attention 3 attention-mechanisms 2 deep-learning 2 long-context-modeling 1 machine-learning 1 multimodal 1 multimodal-large-language-models 1 multimodality 1 natural-language-processing 1 visual-question-answering 1 acl 1 acl2023 1 long-context 1 long-document-modeling 1 recurrent-attention-networks 1 recurrent-networks 1 position-encoding 1 llms 1 llm 1 large-multimodal-models 1 large-language-models 1 foundation-models 1 evaluation 1 deep-neural-networks 1 computer-vision 1 benchmark 1 recurrence 1 memory 1 artificial-intelligence 1 finetuning 1

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Repos