lucidrains/rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

Language: Python - Size: 103 KB - Last synced: 7 days ago - Pushed: 9 days ago - Stars: 440 - Forks: 35

AryaAftab/rotary-embedding-tensorflow

Implementation of Rotary Embeddings, from the Roformer paper, in Tensorflow

Language: Python - Size: 6.84 KB - Last synced: 24 days ago - Pushed: over 2 years ago - Stars: 10 - Forks: 2

yiqun-wang/PET-NeuS

PET-NeuS: Positional Encoding Tri-Planes for Neural Surfaces (CVPR 2023)

Language: Python - Size: 3.41 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 249 - Forks: 5

willGuimont/learnable_fourier_positional_encoding

Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding

Language: Python - Size: 3.91 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 34 - Forks: 9

JHLew/Learnable-Fourier-Features

Unofficial pytorch implementation of the paper "Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding", NeurIPS 2021.

Language: Python - Size: 5.86 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 10 - Forks: 0

HySonLab/Multires-Graph-Transformer

Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Long-Range and Hierarchical Structures

Language: Python - Size: 7.22 MB - Last synced: 26 days ago - Pushed: 8 months ago - Stars: 12 - Forks: 3

konstantinosKokos/unitaryPE

Algebraic Positional Encodings

Language: Python - Size: 81.1 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 2 - Forks: 0

vijaydwivedi75/gnn-lspe

Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022

Language: Python - Size: 267 KB - Last synced: about 2 months ago - Pushed: over 2 years ago - Stars: 221 - Forks: 32

Khsaadi/built_basic_transformer

This repo contains a basic transformer implementation

Language: Jupyter Notebook - Size: 4.88 KB - Last synced: about 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0

VITA-Group/Ms-PoE

"Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang.

Language: Python - Size: 7.53 MB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 13 - Forks: 0

liaoyanqing666/transformer_pytorch

完整的原版transformer程序，complete origin transformer program

Language: Python - Size: 11.7 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 1 - Forks: 0

PKU-ML/LaplacianCanonization

Official code for NeurIPS 2023 paper "Laplacian Canonization: A Minimalist Approach to Sign and Basis Invariant Spectral Embedding".

Language: Python - Size: 88.9 KB - Last synced: 26 days ago - Pushed: 5 months ago - Stars: 5 - Forks: 1

ziplab/FASeg

[CVPR 2023] This is the official PyTorch implementation for "Dynamic Focus-aware Positional Queries for Semantic Segmentation".

Language: Python - Size: 426 KB - Last synced: about 2 months ago - Pushed: over 1 year ago - Stars: 54 - Forks: 2

osiriszjq/RobustPPE

Robust Point Cloud Processing through Positional Embedding

Language: HTML - Size: 37 MB - Last synced: 4 months ago - Pushed: 9 months ago - Stars: 7 - Forks: 0

dcarpintero/transformer101

Annotated vanilla implementation in PyTorch of the Transformer model introduced in 'Attention Is All You Need'

Language: Jupyter Notebook - Size: 215 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 1 - Forks: 0

peluche/self-attention

Comparison of positional encoding schemes in transformer

Language: Jupyter Notebook - Size: 27.5 MB - Last synced: about 2 months ago - Pushed: 6 months ago - Stars: 0 - Forks: 0

universome/inr-gan

[CVPR 2021] Adversarial Generation of Continuous Images

Language: Python - Size: 1.5 MB - Last synced: 7 months ago - Pushed: over 2 years ago - Stars: 228 - Forks: 23

GeorgeMLP/laplacian-canonization

Official code for NeurIPS 2023 paper "Laplacian Canonization: A Minimalist Approach to Sign and Basis Invariant Spectral Embedding".

Language: Python - Size: 88.9 KB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 1 - Forks: 0

GeorgeMLP/basis-invariance-synthetic-experiment

Basis invariance synthetic experiment in Appendix D of NeurIPS 2023 paper "Laplacian Canonization: A Minimalist Approach to Sign and Basis Invariant Spectral Embedding".

Language: Python - Size: 5.86 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

tanjeffreyz/attention-is-all-you-need

PyTorch implementation of "Attention Is All You Need" by Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin

Language: Python - Size: 770 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0

SpydazWebAI-NLP/BasicPositionalEncoderDecoder2023

The Positional Encoder Decoder is a Visual Basic .NET class that provides functionality for encoding and decoding tokens and sentences using positional embeddings. It allows you to convert between string tokens and their corresponding embeddings, and vice versa.

Language: Visual Basic .NET - Size: 25.4 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 1

SpydazWebAI-NLP/BasicCorpus2023

A Basic Corpus Object , Giving Positional Encoding / Decoding . ,A Fully Loaded Corpus = Corpus > Document > Sentences > Clauses > Words

Language: Visual Basic .NET - Size: 2.63 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 1 - Forks: 1

TillBeemelmanns/learnable_fourier_positional_encoding

Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding - Tensorflow

Language: Jupyter Notebook - Size: 22.5 KB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 1 - Forks: 0

osiriszjq/complex_encoding

Trading Positional Complexity vs Deepness in Coordinate Networks

Language: Jupyter Notebook - Size: 47.6 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 28 - Forks: 0

bkhanal-11/transformers

The implementation of transformer as presented in the paper "Attention is all you need" from scratch.

Language: Python - Size: 291 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 3 - Forks: 0

tate8/translator

Transformer translator website with multithreaded web server in Rust

Language: Rust - Size: 19.5 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

mpalaourg/PGL-SUM Fork of e-apostolidis/PGL-SUM

A PyTorch Implementation of PGL-SUM from "Combining Global and Local Attention with Positional Encoding for Video Summarization", Proc. IEEE ISM 2021

Language: Python - Size: 89.6 MB - Last synced: 11 months ago - Pushed: almost 2 years ago - Stars: 2 - Forks: 1

antonio-f/PositionalEncoding

Positional encoding example

Language: Python - Size: 1.95 KB - Last synced: over 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

JudePark96/positional-encoding

Language: Python - Size: 0 Bytes - Last synced: over 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0