Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: position-embedding

erogol/BlaGPT

Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible experimentation and exploration.

Language: Python - Size: 780 KB - Last synced at: 6 days ago - Pushed at: 18 days ago - Stars: 24 - Forks: 3

naver-ai/rope-vit

[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"

Language: Python - Size: 1.06 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 271 - Forks: 7

yhlleo/MJP

An official Pytorch implementation of "Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformers", CVPR 2023.

Language: Python - Size: 7.34 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 40 - Forks: 9

CyberZHG/torch-position-embedding 📦

Position embedding in PyTorch

Language: Python - Size: 8.79 KB - Last synced at: 2 days ago - Pushed at: almost 5 years ago - Stars: 16 - Forks: 1

lartpang/RotaryPositionEmbedding

Language: Jupyter Notebook - Size: 59.6 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

Haochen-Wang409/DropPos

[NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions

Language: Python - Size: 968 KB - Last synced at: 11 months ago - Pushed at: 12 months ago - Stars: 56 - Forks: 3

cosmaadrian/time-enriched-multimodal-depression-detection

Official source code for the paper: "It’s Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformers"

Language: Python - Size: 579 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 32 - Forks: 1

KanishkNavale/heimdall

A comprehensive code for AI & Robotics.

Language: Python - Size: 104 MB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

akanyaani/embedding-visualizer

Word and Position Embedding visualization of all pre-trained transformer models like BERT

Language: Jupyter Notebook - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 0

Related Keywords
position-embedding 9 vision-transformer 3 deep-learning 2 transformer 2 embeddings 2 pytorch 2 mvit 1 multihead-self-attention 1 manifold-optimization 1 keypointnet 1 inverse-kinematics 1 furthest-point-sampling 1 dense-object-nets 1 transformer-architecture 1 multimodal-learning 1 depression-detection 1 self-supervised-learning 1 pydantic 1 python3 1 pytorch-implementation 1 pytorch-lightning 1 robotics 1 transfomers 1 transformer-encoder 1 visual-transformer 1 bert-embeddings 1 embedding-visualization 1 tensorboard-visualizations 1 word-embeddings 1 attention-mechanisms 1 gpt 1 gpt-2 1 hymba 1 large-language-models 1 llm 1 llm-training 1 machine-learning 1 transformers 1 eccv2024 1 rotary-position-embedding 1 self-attention 1 gradient-attack 1 privacy-protection 1 rope 1 ade20k 1 coco 1 computer-vision 1 detection 1 image-classification 1 imagenet 1 neurips-2023 1 segmentation 1