Topic: "transformer-architecture"
flavioschenker/functaformer
FunctaFormer is a novel, domain-agnostic super-resolution method that leverages Implicit Neural Representations (INRs) to upscale diverse data types, including images, audio, videos, 3D shapes, manifold data, and LiDAR scans.
Language: Python - Size: 37.1 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

mahshid1378/SwinTransformerPytorch
Implementation of the Swin Transformer in PyTorch. and use Article: arxiv.org/pdf/2103.14030.pdf
Language: Python - Size: 185 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

MuzzammilShah/GPT-TransformerModel-1
A step-by-step implementation of a GPT-style language model on a combined harry potter novels dataset, inspired by Andrej Karpathy’s lecture.
Language: Jupyter Notebook - Size: 6.56 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

odarasimi/ml-architectures
architectures in code
Language: Python - Size: 9.77 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

rubenpjove/tabularT-OS-fingerprinting
This repository employs two different architectures of Tabular Transformer models for Operating System fingerprinting from three different datasets.
Language: Jupyter Notebook - Size: 3.98 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

phrugsa-limbunlom/transformer-machine-translation
Transformer architecture for machine translation from English to Thai.
Language: Python - Size: 8.79 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

skl0726/FIFO-TransFuser-Backbone
FIFO + TransFuser backbone (segmentation) multimodal model for image + radar heat map
Language: Python - Size: 0 Bytes - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

abdussahid26/Transformer-Architecture-from-Scratch-with-PyTorch
This is an implementation of the Transformer architecture from scratch, based on "Attention Is All You Need."
Language: Python - Size: 188 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

mahesmeh001/Transformer-with-Self-Attention
Creating transformer (encoder/decoder) from scratch. Also experimented with alibi encodings as opposed to positional
Language: Python - Size: 818 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

brucedkyle/machinelearningdays
The website files
Language: CSS - Size: 582 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

sagnikc395/transformer
My implementation of the "Attention Is All You Need" paper, introducing the Transformer Architecture.
Language: Python - Size: 274 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Pavansomisetty21/Attention-is-All-You-Need-The-Transformer-architecture
In this we explore detailed architecture of Transformer
Language: Jupyter Notebook - Size: 109 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

SudarshanaSRao/CSCI-499_LMs-in-NLP_USC
USC graduate level Language Models in NLP course
Language: Jupyter Notebook - Size: 559 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

SudarshanaSRao/CSCI-499_final_project
LLMs fine-tuned to generate FAQs based on a website's content
Language: Jupyter Notebook - Size: 1.05 MB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1

joseph-nagel/attention-mechanism
An introduction to attention mechanisms and the vision transformer
Language: Python - Size: 102 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1

mytechnotalent/RE-GPT
Drawing inspiration from Andrej Karpathy’s iconic lecture, "Let’s Build GPT: From Scratch, in Code, Spelled Out", this project takes you on an immersive journey into the inner workings of GPT. Step-by-step, we’ll construct a GPT model from the ground up, demystifying its architecture and bringing its mechanics to life through hands-on coding.
Language: Jupyter Notebook - Size: 1.59 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

amha-kindu/terguami
Terguami is a FastAPI application powered by a custom transformer model built with PyTorch. It provides fast and accurate English-to-Amharic translations, with features like Docker support and interactive OpenAPI documentation, making it a scalable and easy-to-deploy solution for machine translation.
Language: Python - Size: 577 KB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Flavio-Mangione/Nvidia-Analysis
This project involves analyzing the relationship between Nvidia and AI technologies. The notebook covers data pre-processing steps, including importing necessary libraries and loading data. Further analysis and insights into Nvidia's impact on AI and related trends are provided.
Language: Jupyter Notebook - Size: 5.45 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

eralmual/TransformersByADummy
Small implementation of the Attention is all you need transformer on Pytorch
Language: Jupyter Notebook - Size: 37.1 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

dnshkmr7/EP3105-deep-learning-photonics
A project completed as a part of my thesis for my major. Transformer-Based Prediction of Supercontinuum Generation Dynamics. The dataset is taken from https://zenodo.org/records/6241344
Language: Python - Size: 0 Bytes - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

one-2/catalyst
Modern language modelling, from scratch, in C++.
Language: C++ - Size: 67.4 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

IMobinI/Nasal-Bone-Fracture-Classification
Nasal Bone Fracture X-ray Dataset for Medical Imaging and AI Research
Language: Jupyter Notebook - Size: 153 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

rhitajyotim411/Image-Caption-Generation-in-Bengali Fork of Imperial79/flutter_img_cap
A Transformer model for generating Bengali captions from images, integrated with a Flask API and Flutter app for easy usage.
Language: Jupyter Notebook - Size: 37.4 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

razamehar/Sentiment-Analysis-using-Deep-Learning---Machine-Learning
Sentiment analysis on the IMDB dataset using Bag of Words models (Unigram, Bigram, Trigram, Bigram with TF-IDF) and Sequence to Sequence models (one-hot vectors, word embeddings, pretrained embeddings like GloVe, and transformers with positional embeddings).
Language: Jupyter Notebook - Size: 282 KB - Last synced at: 2 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

AbhayPancholi/Transformer_Summarizer
This project is focused on making use of the transformer as a summarizer while using the two form of attention mechanism. All the code for the transformer is implemented from scratch in order to understand the in-depth working of each component.
Language: Jupyter Notebook - Size: 8.63 MB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

marius-florea/nn-zero-to-hero
Neural Networks: Zero to Hero
Language: Roff - Size: 2.05 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

Rajarshi1001/NMT_challenge
This repository is related to the NMT challenge conducted in the CS779A course
Language: Jupyter Notebook - Size: 2.51 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

amityadav1/GPT2
Reproducing GPT2 - Model, Optimizations, training and inference
Language: Jupyter Notebook - Size: 1.1 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

Dark565/code-attention
Importance score calculation for lines of text
Language: Python - Size: 56.6 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

Blacksujit/Fake-News-Detection
This repository contains a machine learning model built to detect fake news articles. The project leverages natural language processing techniques and a supervised learning approach to classify news articles as either real or fake based on their content.
Language: Jupyter Notebook - Size: 205 MB - Last synced at: about 2 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

fritzprix/toyGPT
toyGPT - A Hands-On Project in Building a Basic GPT Model
Language: Jupyter Notebook - Size: 7.91 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

IParraMartin/attention-mechanisms
Educational code for understanding attention mechanisms. You will build a good intuition to K, Q, and V, key in modern Transformer architectures.
Language: Python - Size: 88.9 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

saaadiqh/NLP-Learning_Analytics
Developing Natural Language Processing tools to enhance Learning Analytics. Creating an automated dashboard that diagnoses strengths and weaknesses from educational data.
Language: Python - Size: 3.07 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

sushantkumar23/nano-gpt
Simple character level Transformer
Language: Jupyter Notebook - Size: 467 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

Blakley/Fluency
A desktop application to assist in learning languages. Uses a deep learning model to generate translations.
Language: Jupyter Notebook - Size: 13.3 MB - Last synced at: about 2 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

lloydaxeph/multi_head_attention_transformer
Simple implementation of the paper "Attention Is All You Need" - https://arxiv.org/abs/1706.03762.
Language: Python - Size: 7.81 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

jeroenvansweeveldt/Predicting_superhero_creators-machine_learning_exam_2023
Data and code for the machine learning exam assignment of MA Digital Text Analysis (2023).
Language: Jupyter Notebook - Size: 8 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

mikecvet/annotated-transformer
A highly-annotated custom Transformer model implementation
Language: Python - Size: 33.2 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

ashhass/Transformer_Implementation
transformer implementation from scratch for next character prediction
Language: Python - Size: 462 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

RohitBhandare/MultiTask-BERT-Sentiment-Translation-NMT
Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

lostflux/transfusion 📦
A tiny version of GPT, built with PyTorch and trained on Shakespeare
Language: Python - Size: 841 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

lxaw/shijin
A small language model trained on famous literary works in Japanese.
Language: Python - Size: 150 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

mimireyburn/MLX_Models
MLX Institute | Models and experiments: Handwritten Transformer Architecture in PyTorch | CNN Autoencoder with PCA
Language: Python - Size: 166 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

prajnan93/optical-flow-msthesis
Systematic Study of Optical Flow models
Language: Python - Size: 30.8 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

mokeddembillel/My-GPT
A character-level decoder Transformer that generates Shakespeare's like text.
Language: Python - Size: 429 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

LorenzoCastiglia/Deep-Learning-for-Time-Series-Forecasting
Deep Learning project about the design and training of a model for Time-Series prediction
Language: Jupyter Notebook - Size: 462 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

weezymatt/388-NLP
Collection of assignments for CS388 to write different NLP tasks mostly from scratch.
Language: Python - Size: 430 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

tessoir/transformer-builder
This package provides builder-like API to create really flexible transformers using PyTorch
Language: Python - Size: 145 KB - Last synced at: 30 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Oriolac/attention-mechanisms
Implementations and resources related to Attention Mechanisms in Natural Language Processing (NLP)
Language: Jupyter Notebook - Size: 12.9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

HealthyData-Hub/Predicting-Sentiment-Based-on-Drug-Product-User-Reviews-for-Informed-Decision-Making-Part-2
Review sentiment based on drug user reviews text/ dataset, using a supervised binary text classifier, which will classify user reviews as positive or negative
Language: Jupyter Notebook - Size: 2.77 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Hariama/stegolm
Steganographic method for hiding text in transformer-based Language Models
Language: Jupyter Notebook - Size: 873 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

devanshu3/Movie_Recommendation_System
Recommends movie based on description.
Language: Jupyter Notebook - Size: 9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

theFutureGuy/Translation-LLM-model
English to French Translator with Transformer model
Language: Jupyter Notebook - Size: 10.3 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Naveenpandey27/Document_Summarization_using_Transformer
This code demonstrates how to automatically generate concise summaries from a given text using advanced natural language processing techniques. By utilizing the powerful "transformers" library, it employs a pre-trained model to break down input text and distill its essential points into succinct summaries.
Language: Python - Size: 2.93 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

rid17pawar/Sentiment-Analysis-Model-Experiments
Experiments in the field of Sentiment Analysis using ML Algorithms namely Logistic Regression, Naive Bayes along with tfidf, one hot encoding, bag of words vectorization. Different MLP and RNN models viz. LSTM, GRU, Bidirectional LSTM. Lastly, state of the art BERT model
Language: Jupyter Notebook - Size: 1.8 MB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 1

00ber/WASSA-2023-Empathy-Prediction
Repository for our submission for the WASSA 2023 Shared Task on Empathy Detection and Emotion Classification and Personality Detection in Interactions
Language: Jupyter Notebook - Size: 2.62 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

sleepingcat4/Introduction-JAX
A barebone introduction & practice of JAX
Language: Jupyter Notebook - Size: 12.8 MB - Last synced at: 2 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

nataliakzm/Transformer_model
Investigation into Transformer self-attention building blocks, and the effects of pretraining.
Language: Python - Size: 61.5 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

alcazar90/gpt-sentiment
Language: Jupyter Notebook - Size: 6.47 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

P-stha12/Transfomer
Transformer implementation in tensorflow
Language: Jupyter Notebook - Size: 18.6 KB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

whoami-Lory271/NN-project-memorizing-transformers
Our version of Memorizing Transformers for NN project
Language: Jupyter Notebook - Size: 2.88 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

srinath2022/visual-counting-project
Counting currency from video using RepNet as a base model.
Language: Jupyter Notebook - Size: 19.5 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

SergioMG97/Finetuning-mT5-and-DistilGPT2-for-paraphrasing-tasks
Language: Jupyter Notebook - Size: 11.8 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 2

lolofo/stage_4_gm
The objective here is to study the plausibility of attention mechanisms in automatic language processing on an NLI (natural naguage inference) task, in transformers (BERT) architecture
Language: Jupyter Notebook - Size: 21.8 MB - Last synced at: 10 months ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

Kojk-AI/spobet
Pose-based word-level sign language recognition with BERT-styled transformer in Keras
Language: Python - Size: 34.2 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

nathanmwhite/yowlumne_wield
Repository for Yowlumne data and scripts for WIELD
Language: Jupyter Notebook - Size: 7.4 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

LadaOndris/BERT-transformer
Implementation of BERT for text classification
Language: Python - Size: 281 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

Rawan19/HMNet Fork of microsoft/HMNet
Official Implementation of "A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining""
Language: Python - Size: 7.86 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

chulhongsung/Set-transformer
Set-transformer
Language: Python - Size: 2.93 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

AttentiveNader/multitask-dnn-implemenation
replicating the MT-DNN paper
Language: Jupyter Notebook - Size: 20.5 KB - Last synced at: 12 months ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

keshavbhandari/Deep-Learning-Projects
Includes my deep learning concepts and scripts
Language: Python - Size: 19.9 MB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

Julius-Syvis/PyTorch-Transformer-Studies
Vaswani Paper analysis for personal Transformer studies
Language: Jupyter Notebook - Size: 51.8 KB - Last synced at: 1 day ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

bhattg/Transformer-scratch 📦
implementation of transformer network from scratch
Language: Python - Size: 6.84 KB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

jaisenbe58r/NLP-Transformer_Translator
Implementación Transformers, adaptación del curso: "Procesamiento del Lenguaje Natural Moderno en Python. (Juan Gabriel Gomila)
Language: Jupyter Notebook - Size: 113 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 1

TheRockXu/transformer_chabot
A question answering bot based on the transformer architecture.
Language: Python - Size: 508 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0
