Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

Topic: "multi-query-attention"

knotgrass/attention

several types of attention modules written in PyTorch

Language: Python - Size: 142 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 27 - Forks: 9

Related Topics
attention 1 attention-mechanism 1 grouped-query-attention 1 multi-head-attention 1 pytorch 1 scale-dot-product-attention 1 softmax-layer 1 transformer 1 transformers 1