An open API service providing repository metadata for many open source software ecosystems.

Topic: "transformer-architecture"

flavioschenker/functaformer

FunctaFormer is a novel, domain-agnostic super-resolution method that leverages Implicit Neural Representations (INRs) to upscale diverse data types, including images, audio, videos, 3D shapes, manifold data, and LiDAR scans.

Language: Python - Size: 37.1 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

mahshid1378/SwinTransformerPytorch

Implementation of the Swin Transformer in PyTorch. and use Article: arxiv.org/pdf/2103.14030.pdf

Language: Python - Size: 185 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

MuzzammilShah/GPT-TransformerModel-1

A step-by-step implementation of a GPT-style language model on a combined harry potter novels dataset, inspired by Andrej Karpathy’s lecture.

Language: Jupyter Notebook - Size: 6.56 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

odarasimi/ml-architectures

architectures in code

Language: Python - Size: 9.77 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

rubenpjove/tabularT-OS-fingerprinting

This repository employs two different architectures of Tabular Transformer models for Operating System fingerprinting from three different datasets.

Language: Jupyter Notebook - Size: 3.98 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

phrugsa-limbunlom/transformer-machine-translation

Transformer architecture for machine translation from English to Thai.

Language: Python - Size: 8.79 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

skl0726/FIFO-TransFuser-Backbone

FIFO + TransFuser backbone (segmentation) multimodal model for image + radar heat map

Language: Python - Size: 0 Bytes - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

abdussahid26/Transformer-Architecture-from-Scratch-with-PyTorch

This is an implementation of the Transformer architecture from scratch, based on "Attention Is All You Need."

Language: Python - Size: 188 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

mahesmeh001/Transformer-with-Self-Attention

Creating transformer (encoder/decoder) from scratch. Also experimented with alibi encodings as opposed to positional

Language: Python - Size: 818 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

brucedkyle/machinelearningdays

The website files

Language: CSS - Size: 582 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

sagnikc395/transformer

My implementation of the "Attention Is All You Need" paper, introducing the Transformer Architecture.

Language: Python - Size: 274 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Pavansomisetty21/Attention-is-All-You-Need-The-Transformer-architecture

In this we explore detailed architecture of Transformer

Language: Jupyter Notebook - Size: 109 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

SudarshanaSRao/CSCI-499_LMs-in-NLP_USC

USC graduate level Language Models in NLP course

Language: Jupyter Notebook - Size: 559 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

SudarshanaSRao/CSCI-499_final_project

LLMs fine-tuned to generate FAQs based on a website's content

Language: Jupyter Notebook - Size: 1.05 MB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1

joseph-nagel/attention-mechanism

An introduction to attention mechanisms and the vision transformer

Language: Python - Size: 102 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1

mytechnotalent/RE-GPT

Drawing inspiration from Andrej Karpathy’s iconic lecture, "Let’s Build GPT: From Scratch, in Code, Spelled Out", this project takes you on an immersive journey into the inner workings of GPT. Step-by-step, we’ll construct a GPT model from the ground up, demystifying its architecture and bringing its mechanics to life through hands-on coding.

Language: Jupyter Notebook - Size: 1.59 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

amha-kindu/terguami

Terguami is a FastAPI application powered by a custom transformer model built with PyTorch. It provides fast and accurate English-to-Amharic translations, with features like Docker support and interactive OpenAPI documentation, making it a scalable and easy-to-deploy solution for machine translation.

Language: Python - Size: 577 KB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Flavio-Mangione/Nvidia-Analysis

This project involves analyzing the relationship between Nvidia and AI technologies. The notebook covers data pre-processing steps, including importing necessary libraries and loading data. Further analysis and insights into Nvidia's impact on AI and related trends are provided.

Language: Jupyter Notebook - Size: 5.45 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

eralmual/TransformersByADummy

Small implementation of the Attention is all you need transformer on Pytorch

Language: Jupyter Notebook - Size: 37.1 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

dnshkmr7/EP3105-deep-learning-photonics

A project completed as a part of my thesis for my major. Transformer-Based Prediction of Supercontinuum Generation Dynamics. The dataset is taken from https://zenodo.org/records/6241344

Language: Python - Size: 0 Bytes - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

one-2/catalyst

Modern language modelling, from scratch, in C++.

Language: C++ - Size: 67.4 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

IMobinI/Nasal-Bone-Fracture-Classification

Nasal Bone Fracture X-ray Dataset for Medical Imaging and AI Research

Language: Jupyter Notebook - Size: 153 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

rhitajyotim411/Image-Caption-Generation-in-Bengali Fork of Imperial79/flutter_img_cap

A Transformer model for generating Bengali captions from images, integrated with a Flask API and Flutter app for easy usage.

Language: Jupyter Notebook - Size: 37.4 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

razamehar/Sentiment-Analysis-using-Deep-Learning---Machine-Learning

Sentiment analysis on the IMDB dataset using Bag of Words models (Unigram, Bigram, Trigram, Bigram with TF-IDF) and Sequence to Sequence models (one-hot vectors, word embeddings, pretrained embeddings like GloVe, and transformers with positional embeddings).

Language: Jupyter Notebook - Size: 282 KB - Last synced at: 2 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

AbhayPancholi/Transformer_Summarizer

This project is focused on making use of the transformer as a summarizer while using the two form of attention mechanism. All the code for the transformer is implemented from scratch in order to understand the in-depth working of each component.

Language: Jupyter Notebook - Size: 8.63 MB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

marius-florea/nn-zero-to-hero

Neural Networks: Zero to Hero

Language: Roff - Size: 2.05 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

Rajarshi1001/NMT_challenge

This repository is related to the NMT challenge conducted in the CS779A course

Language: Jupyter Notebook - Size: 2.51 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

amityadav1/GPT2

Reproducing GPT2 - Model, Optimizations, training and inference

Language: Jupyter Notebook - Size: 1.1 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

Dark565/code-attention

Importance score calculation for lines of text

Language: Python - Size: 56.6 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

Blacksujit/Fake-News-Detection

This repository contains a machine learning model built to detect fake news articles. The project leverages natural language processing techniques and a supervised learning approach to classify news articles as either real or fake based on their content.

Language: Jupyter Notebook - Size: 205 MB - Last synced at: about 2 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

fritzprix/toyGPT

toyGPT - A Hands-On Project in Building a Basic GPT Model

Language: Jupyter Notebook - Size: 7.91 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

IParraMartin/attention-mechanisms

Educational code for understanding attention mechanisms. You will build a good intuition to K, Q, and V, key in modern Transformer architectures.

Language: Python - Size: 88.9 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

saaadiqh/NLP-Learning_Analytics

Developing Natural Language Processing tools to enhance Learning Analytics. Creating an automated dashboard that diagnoses strengths and weaknesses from educational data.

Language: Python - Size: 3.07 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

sushantkumar23/nano-gpt

Simple character level Transformer

Language: Jupyter Notebook - Size: 467 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

Blakley/Fluency

A desktop application to assist in learning languages. Uses a deep learning model to generate translations.

Language: Jupyter Notebook - Size: 13.3 MB - Last synced at: about 2 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

lloydaxeph/multi_head_attention_transformer

Simple implementation of the paper "Attention Is All You Need" - https://arxiv.org/abs/1706.03762.

Language: Python - Size: 7.81 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

jeroenvansweeveldt/Predicting_superhero_creators-machine_learning_exam_2023

Data and code for the machine learning exam assignment of MA Digital Text Analysis (2023).

Language: Jupyter Notebook - Size: 8 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

mikecvet/annotated-transformer

A highly-annotated custom Transformer model implementation

Language: Python - Size: 33.2 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

ashhass/Transformer_Implementation

transformer implementation from scratch for next character prediction

Language: Python - Size: 462 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

RohitBhandare/MultiTask-BERT-Sentiment-Translation-NMT

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

lostflux/transfusion 📦

A tiny version of GPT, built with PyTorch and trained on Shakespeare

Language: Python - Size: 841 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

lxaw/shijin

A small language model trained on famous literary works in Japanese.

Language: Python - Size: 150 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

mimireyburn/MLX_Models

MLX Institute | Models and experiments: Handwritten Transformer Architecture in PyTorch | CNN Autoencoder with PCA

Language: Python - Size: 166 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

prajnan93/optical-flow-msthesis

Systematic Study of Optical Flow models

Language: Python - Size: 30.8 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

mokeddembillel/My-GPT

A character-level decoder Transformer that generates Shakespeare's like text.

Language: Python - Size: 429 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

LorenzoCastiglia/Deep-Learning-for-Time-Series-Forecasting

Deep Learning project about the design and training of a model for Time-Series prediction

Language: Jupyter Notebook - Size: 462 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

weezymatt/388-NLP

Collection of assignments for CS388 to write different NLP tasks mostly from scratch.

Language: Python - Size: 430 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

tessoir/transformer-builder

This package provides builder-like API to create really flexible transformers using PyTorch

Language: Python - Size: 145 KB - Last synced at: 30 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Oriolac/attention-mechanisms

Implementations and resources related to Attention Mechanisms in Natural Language Processing (NLP)

Language: Jupyter Notebook - Size: 12.9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

HealthyData-Hub/Predicting-Sentiment-Based-on-Drug-Product-User-Reviews-for-Informed-Decision-Making-Part-2

Review sentiment based on drug user reviews text/ dataset, using a supervised binary text classifier, which will classify user reviews as positive or negative

Language: Jupyter Notebook - Size: 2.77 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Hariama/stegolm

Steganographic method for hiding text in transformer-based Language Models

Language: Jupyter Notebook - Size: 873 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

devanshu3/Movie_Recommendation_System

Recommends movie based on description.

Language: Jupyter Notebook - Size: 9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

theFutureGuy/Translation-LLM-model

English to French Translator with Transformer model

Language: Jupyter Notebook - Size: 10.3 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Naveenpandey27/Document_Summarization_using_Transformer

This code demonstrates how to automatically generate concise summaries from a given text using advanced natural language processing techniques. By utilizing the powerful "transformers" library, it employs a pre-trained model to break down input text and distill its essential points into succinct summaries.

Language: Python - Size: 2.93 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

rid17pawar/Sentiment-Analysis-Model-Experiments

Experiments in the field of Sentiment Analysis using ML Algorithms namely Logistic Regression, Naive Bayes along with tfidf, one hot encoding, bag of words vectorization. Different MLP and RNN models viz. LSTM, GRU, Bidirectional LSTM. Lastly, state of the art BERT model

Language: Jupyter Notebook - Size: 1.8 MB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 1

00ber/WASSA-2023-Empathy-Prediction

Repository for our submission for the WASSA 2023 Shared Task on Empathy Detection and Emotion Classification and Personality Detection in Interactions

Language: Jupyter Notebook - Size: 2.62 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

sleepingcat4/Introduction-JAX

A barebone introduction & practice of JAX

Language: Jupyter Notebook - Size: 12.8 MB - Last synced at: 2 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

nataliakzm/Transformer_model

Investigation into Transformer self-attention building blocks, and the effects of pretraining.

Language: Python - Size: 61.5 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

alcazar90/gpt-sentiment

Language: Jupyter Notebook - Size: 6.47 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

P-stha12/Transfomer

Transformer implementation in tensorflow

Language: Jupyter Notebook - Size: 18.6 KB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

whoami-Lory271/NN-project-memorizing-transformers

Our version of Memorizing Transformers for NN project

Language: Jupyter Notebook - Size: 2.88 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

srinath2022/visual-counting-project

Counting currency from video using RepNet as a base model.

Language: Jupyter Notebook - Size: 19.5 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

SergioMG97/Finetuning-mT5-and-DistilGPT2-for-paraphrasing-tasks

Language: Jupyter Notebook - Size: 11.8 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 2

lolofo/stage_4_gm

The objective here is to study the plausibility of attention mechanisms in automatic language processing on an NLI (natural naguage inference) task, in transformers (BERT) architecture

Language: Jupyter Notebook - Size: 21.8 MB - Last synced at: 10 months ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

Kojk-AI/spobet

Pose-based word-level sign language recognition with BERT-styled transformer in Keras

Language: Python - Size: 34.2 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

nathanmwhite/yowlumne_wield

Repository for Yowlumne data and scripts for WIELD

Language: Jupyter Notebook - Size: 7.4 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

LadaOndris/BERT-transformer

Implementation of BERT for text classification

Language: Python - Size: 281 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

Rawan19/HMNet Fork of microsoft/HMNet

Official Implementation of "A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining""

Language: Python - Size: 7.86 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

chulhongsung/Set-transformer

Set-transformer

Language: Python - Size: 2.93 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

AttentiveNader/multitask-dnn-implemenation

replicating the MT-DNN paper

Language: Jupyter Notebook - Size: 20.5 KB - Last synced at: 12 months ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

keshavbhandari/Deep-Learning-Projects

Includes my deep learning concepts and scripts

Language: Python - Size: 19.9 MB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

Julius-Syvis/PyTorch-Transformer-Studies

Vaswani Paper analysis for personal Transformer studies

Language: Jupyter Notebook - Size: 51.8 KB - Last synced at: 1 day ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

bhattg/Transformer-scratch 📦

implementation of transformer network from scratch

Language: Python - Size: 6.84 KB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

jaisenbe58r/NLP-Transformer_Translator

Implementación Transformers, adaptación del curso: "Procesamiento del Lenguaje Natural Moderno en Python. (Juan Gabriel Gomila)

Language: Jupyter Notebook - Size: 113 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 1

TheRockXu/transformer_chabot

A question answering bot based on the transformer architecture.

Language: Python - Size: 508 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

Related Topics
deep-learning 69 transformer 60 pytorch 58 machine-learning 51 nlp 47 attention-mechanism 36 transformers 33 natural-language-processing 30 python 28 transformer-models 28 tensorflow 22 artificial-intelligence 22 llm 18 computer-vision 18 ai 18 nlp-machine-learning 15 vision-transformer 14 neural-network 13 self-attention 13 gpt 13 attention-is-all-you-need 12 language-model 12 large-language-models 9 deep-neural-networks 9 keras 9 python3 9 lstm 9 transformer-encoder 9 numpy 8 ml 8 tensorflow2 8 bert 8 attention-model 8 generative-model 7 fine-tuning 7 pytorch-implementation 7 machine-translation 7 neural-networks 7 pandas 6 seq2seq 6 llms 6 transformer-pytorch 6 transformers-models 6 huggingface 6 bert-model 6 question-answering 5 gpt-2 5 generative-ai 5 lstm-neural-networks 5 neural-machine-translation 5 rnn 5 classification 5 attention 5 vit 5 deeplearning 5 translation 5 text-classification 4 huggingface-transformers 4 encoder-decoder-architecture 4 reinforcement-learning 4 sentiment-analysis 4 transfer-learning 4 chatbot 4 multimodal 4 word-embeddings 4 encoder-decoder 4 machine-learning-algorithms 4 openai 4 time-series 4 transformer-tensorflow2 3 multi-head-attention 3 cnn 3 language-modeling 3 research-project 3 bag-of-words 3 llm-training 3 object-detection 3 seq2seq-model 3 gpt-4 3 text-summarization 3 graph-neural-networks 3 time-series-forecasting 3 self-supervised-learning 3 distilbert 3 data-science 3 continual-learning 3 web-interface 3 chatgpt 3 image-classification 3 multimodal-deep-learning 3 data-visualization 3 roberta 3 sequence-to-sequence-models 3 keras-tensorflow 3 albert 3 llama 3 glove-embeddings 3 resnet 3 fastapi 3 nlg 3