Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: relative-positional-representation

gazelle93/Transformer-Various-Positional-Encoding

This project aims to implement the Transformer Encoder blocks using various Positional Encoding methods.

Language: Python - Size: 29.3 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 24 - Forks: 2

gazelle93/Attention-Various-Positional-Encoding

This project aims to implement the Scaled-Dot-Product Attention layer and the Multi-Head Attention layer using various Positional Encoding methods.

Language: Python - Size: 82 KB - Last synced at: 2 months ago - Pushed at: about 3 years ago - Stars: 5 - Forks: 0

asigalov61/Morpheus

[DEPRECIATED] Symbolic MIDI Music AI implementation

Language: Python - Size: 178 MB - Last synced at: about 1 year ago - Pushed at: about 3 years ago - Stars: 17 - Forks: 3

Related Keywords
relative-positional-representation 3 wordembeddings 2 t5 2 spacy 2 relative-positional-encoding 2 pytorch 2 nltk 2 nlp 2 natural-language-processing 2 gensim 2 multi-instrumental 1 multiple-embedding 1 music 1 music-ai 1 music-ai-architectures 1 music-clip 1 music-composition 1 music-generation 1 music-player 1 pytorch-implementation 1 relative-global-attention 1 rpr-rga 1 midi 1 language-music-pretraining 1 inpainting 1 drums 1 continuation 1 artificial-intelligence 1 accompaniment 1 scaled-dot-product 1 multi-head-attention 1 attention-mechanism 1 transformer-encoder 1 transformer 1