Topic: "efficient-transformers"
swz30/Restormer
[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.
Language: Python - Size: 1.52 MB - Last synced at: 16 days ago - Pushed at: 10 months ago - Stars: 2,051 - Forks: 260
SysCV/transfiner
Mask Transfiner for High-Quality Instance Segmentation, CVPR 2022
Language: Python - Size: 56.5 MB - Last synced at: 30 days ago - Pushed at: over 2 years ago - Stars: 540 - Forks: 62
lucidrains/FLASH-pytorch
Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
Language: Python - Size: 34.2 MB - Last synced at: 14 days ago - Pushed at: over 1 year ago - Stars: 363 - Forks: 25
NVIDIA/transformer-ls
Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
Language: Python - Size: 124 KB - Last synced at: 29 days ago - Pushed at: about 3 years ago - Stars: 225 - Forks: 33
feixue94/imp-release
[CVPR 2023] IMP: iterative matching and pose estimation with transformer-based recurrent module
Language: Python - Size: 9.62 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 128 - Forks: 11
xmindflow/DAEFormer
[MICCAI 2023] DAE-Former: Dual Attention-guided Efficient Transformer for Medical Image Segmentation
Language: Python - Size: 207 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 116 - Forks: 14
VITA-Group/SViTE
[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang
Language: Python - Size: 615 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 89 - Forks: 12
ziplab/EcoFormer
[NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
Language: Python - Size: 786 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 71 - Forks: 1
szq0214/SReT
Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"
Language: Python - Size: 557 KB - Last synced at: 3 months ago - Pushed at: almost 3 years ago - Stars: 64 - Forks: 11
VITA-Group/UVC
[ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Liu, Zhangyang Wang
Language: Python - Size: 7.81 MB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 52 - Forks: 3
MarkusSagen/Master-Thesis-Multilingual-Longformer
Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models could inherit these properties by making it an Efficient Transformer (s.a. the Longformer architecture).
Language: Jupyter Notebook - Size: 10.4 MB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 26 - Forks: 8
MCG-NJU/EVAD
[ICCV 2023] Efficient Video Action Detection with Token Dropout and Context Refinement
Language: Python - Size: 532 KB - Last synced at: 12 months ago - Pushed at: over 1 year ago - Stars: 20 - Forks: 3
keshavbhandari/Electra-With-Compositional-Embeddings
A custom Tensorflow implementation of Google's Electra NLP model with compositional embeddings using complementary partitions
Language: Jupyter Notebook - Size: 128 MB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 10 - Forks: 3
Lemon-cmd/energy-transformer-torch
Official Implementation of Energy Transformer in PyTorch for Mask Image Reconstruction
Language: Python - Size: 22.2 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 9 - Forks: 1
shsarv/ChatBot
This is the source code of article how to create a chatbot in python . i.e A chatbot using the Reformer, also known as the efficient Transformer, to generate dialogues between two bots.
Language: Jupyter Notebook - Size: 16 MB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 8 - Forks: 1
HySonLab/SAMSA
SAMSA: Efficient Transformer for Many Data Modalities
Language: Python - Size: 2.5 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 3 - Forks: 0
yubin1219/MetaSeg
MetaFormer-Based Global Contexts-Aware Network for Efficient Semantic Segmentation (Accepted by WACV 2024)
Size: 14.6 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 2 - Forks: 1
MAGICS-LAB/NonparametricHopfield
Nonparametric Modern Hopfield Models
Language: Jupyter Notebook - Size: 167 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0
lim142857/Sparsifiner
Official Codebase for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"
Language: Python - Size: 46.9 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0
brandnewchoppa/gau-tensorflow
Gated Attention Unit (TensorFlow implementation)
Language: Python - Size: 479 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
USTCLLM/LISA
Pytorch implementation of LISA (Linear-Time Self Attention with Codeword Histogram for Efficient Recommendation. WWW 2021)
Language: Python - Size: 9.2 MB - Last synced at: 6 months ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
