GitHub / msmrexe / pytorch-transformer-from-scratch
A complete implementation of the "Attention Is All You Need" Transformer model from scratch using PyTorch. This project focuses on building and training a Transformer for neural machine translation (English-to-Italian) on the OpusBooks dataset.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/msmrexe%2Fpytorch-transformer-from-scratch
PURL: pkg:github/msmrexe/pytorch-transformer-from-scratch
Stars: 1
Forks: 0
Open issues: 0
License: mit
Language: Python
Size: 37.1 KB
Dependencies parsed at: Pending
Created at: 12 days ago
Updated at: 12 days ago
Pushed at: 12 days ago
Last synced at: 12 days ago
Topics: attention, attention-is-all-you-need, attention-mechanism, course-project, cross-attention, encoder-decoder, huggingface, machine-learning, masked-attention, neural-machine-translation, positional-encoding, pytorch, seq2seq, transformer, transformer-from-scratch, university-project