Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub topics: transformer-encoder
ImMohammadHosseini/MKP-RL
:sparkles: Solve multi_dimensional multiple knapsack problem using state_of_the_art Reinforcement Learning Algorithms and transformers
Language: Python - Size: 5.41 MB - Last synced: 30 days ago - Pushed: 30 days ago - Stars: 8 - Forks: 1
microsoft/DeBERTa
The implementation of DeBERTa
Language: Python - Size: 237 KB - Last synced: 27 days ago - Pushed: 8 months ago - Stars: 1,852 - Forks: 209
Shikhar-S/EvolvedTransformer
Contains pytorch implementation of Transformer and EvolvedTransformer architectures. WIP
Language: Jupyter Notebook - Size: 22.2 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 8 - Forks: 4
lilianweng/transformer-tensorflow
Implementation of Transformer Model in Tensorflow
Language: Python - Size: 22.6 MB - Last synced: about 1 month ago - Pushed: about 1 year ago - Stars: 427 - Forks: 84
microsoft/CASPR
CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.
Language: Python - Size: 2.47 MB - Last synced: 25 days ago - Pushed: over 1 year ago - Stars: 36 - Forks: 3
zhongkaifu/Seq2SeqSharp
Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.
Language: C# - Size: 427 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 188 - Forks: 38
utahnlp/therapist-observer
Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"
Language: Python - Size: 283 KB - Last synced: 26 days ago - Pushed: almost 2 years ago - Stars: 12 - Forks: 5
helpmefindaname/transformer-smaller-training-vocab
Temporary remove unused tokens during training to save ram and speed.
Language: Python - Size: 1.49 MB - Last synced: 29 days ago - Pushed: about 2 months ago - Stars: 20 - Forks: 2
wgcban/ChangeFormer
[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection
Language: Python - Size: 13.8 MB - Last synced: 2 months ago - Pushed: 4 months ago - Stars: 375 - Forks: 52
declare-lab/MIME
This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.
Language: Python - Size: 25.2 MB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 42 - Forks: 13
JayaswalVivek/Transformer_Encoder_Based_Regression
Transformer-encoder for performing a NLP task
Language: Jupyter Notebook - Size: 46.9 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0
LLeon360/Google-Decimeter-Challenge-23
Use Transformers to predict Time-Series smartphone positioning from GNSS data.
Language: Jupyter Notebook - Size: 21.5 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 1
VITA-Group/TransGAN
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
Language: Python - Size: 139 MB - Last synced: 3 months ago - Pushed: over 1 year ago - Stars: 1,608 - Forks: 199
young-zonglin/yangzl-deep-text-matching
Text matching using several deep models.
Language: Python - Size: 86.9 KB - Last synced: 3 months ago - Pushed: over 5 years ago - Stars: 1 - Forks: 1
brightmart/bert_language_understanding
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
Language: Python - Size: 16 MB - Last synced: 3 months ago - Pushed: over 5 years ago - Stars: 959 - Forks: 212
kyegomez/ShallowFF
Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"
Language: Python - Size: 36.2 MB - Last synced: 29 days ago - Pushed: 29 days ago - Stars: 6 - Forks: 0
blaze7451/Project-Haruki-Murakami2
Haruki Murakami style text generation project using transformers.
Language: Jupyter Notebook - Size: 1.9 MB - Last synced: 4 months ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0
KanishkNavale/heimdall
A comprehensive code for AI & Robotics.
Language: Python - Size: 104 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 0
zhenyuanlu/PainAttnNet
Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals
Language: Python - Size: 1.83 MB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 7 - Forks: 1
Curtis-Wu/Equivariant-Graph-Transformer
A deep neural network with hybrid architecture (EGNN + Transformer) for molecular properties prediction.
Language: Jupyter Notebook - Size: 41.6 MB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 3 - Forks: 0
Platanus-hy/sememes_codriven_text_matching
Co-Driven Recognition of Semantic Consistency via the Fusion of Transformer and HowNet Sememes Knowledge
Language: Python - Size: 9.81 MB - Last synced: 8 months ago - Pushed: over 1 year ago - Stars: 3 - Forks: 0
maurotangari/deeplearning
Deep Learning project October 2023
Language: Jupyter Notebook - Size: 10.3 MB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0
biovino1/VecAligns
Using the similarity between embedded protein sequences to align them
Language: Python - Size: 132 MB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0
lucylow/En_francais_si_vous_plait-
French English Machine Translation. Natural language processing (NLP) transformer model from "Attention Is All You Need"
Language: Python - Size: 5.56 MB - Last synced: about 1 month ago - Pushed: over 4 years ago - Stars: 6 - Forks: 1
thomasdurkin/Classification-of-Cancer-Discussion-Posts
A comparative study of deep learning models to correctly identify the cancer a patient has, as a means to creating a more streamlined process when making a post on the Cancer Survivors Network website.,
Language: Jupyter Notebook - Size: 33.7 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0
lordzuko/Transformer-Stance-Detection
This is a transformer based implementation for Stance Detection with Bidirectional Conditional Encoding
Language: Python - Size: 65.9 MB - Last synced: 9 months ago - Pushed: about 1 year ago - Stars: 3 - Forks: 1
Shuvro-d/Projects
Projects based on self learning purpose.
Language: Jupyter Notebook - Size: 4.78 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0
bh1995/AF-classification
The repo is for the Heart Disease classification project using Transformer Encoders in PyTorch.
Language: Python - Size: 23.4 KB - Last synced: 10 months ago - Pushed: almost 3 years ago - Stars: 26 - Forks: 8
matchild/DeepBrownianMotion
A deep learning classification tool for anomalous diffusion trajectories.
Language: Jupyter Notebook - Size: 4.03 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 1 - Forks: 0
liacov/homework3_transformer
Repository for Homework 3 - Neural Networks and Deep Learning course @ UniPD. Second version. Transformer for text generation.
Language: Jupyter Notebook - Size: 314 MB - Last synced: 10 months ago - Pushed: over 3 years ago - Stars: 1 - Forks: 1
amitkumarj441/bCapsule
When BERT meets Capsule
Language: Python - Size: 4.84 MB - Last synced: 10 months ago - Pushed: almost 5 years ago - Stars: 1 - Forks: 0
jackaduma/SecBERT
pretrained BERT model for cyber security text, learned CyberSecurity Knowledge
Language: Python - Size: 490 KB - Last synced: 10 months ago - Pushed: about 1 year ago - Stars: 81 - Forks: 17
keshavbhandari/Predicting-Customer-Return
Objective: Predicting whether the customer will return or not in the next month. Techniques used: XGBoost, logistic regression, attention based LSTM neural network, self attention based transformer neural network
Language: Python - Size: 18.6 KB - Last synced: 10 months ago - Pushed: over 3 years ago - Stars: 2 - Forks: 0
larngroup/TAG-DTA
TAG-DTA: Binding Region-Guided Strategy to Predict Drug-Target Affinity Using Transformers
Language: Python - Size: 466 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0
StefanHeng/Zeroshot-Text-Classification
Exploring fast & accurate zero-shot text classification
Language: Python - Size: 3.68 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0
Vidhiwar/multimodule-ecg-classification
Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification
Language: Jupyter Notebook - Size: 1.5 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 43 - Forks: 14
cslab-hub/LocalTSMHAInterpretability
Visualization method of MHA which was trained on time series data, to improve human interpretation
Language: TypeScript - Size: 68.2 MB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 0 - Forks: 0
cslab-hub/GlobalTimeSeriesCoherenceMatrices
Code for the Paper Constructing Global Coherence Representations:Identifying Interpretability and Coherences ofTransformer Attention in Time Series Data. It is about creating coherence matrices which represent the attention from each symbol to each other symbol.
Language: TypeScript - Size: 114 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 1 - Forks: 0
zarzouram/aics-project 📦
Language: TeX - Size: 14.6 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0
Samleo8/SCARF Fork of jchibane/srf
Stereo Cross-Attention Radiance Fields (SCARF) - Modification of SRF with cross-attention (transformer) mechanism
Language: Python - Size: 347 MB - Last synced: 4 months ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0
nikhilroxtomar/Vision-Transformer-ViT-in-TensorFlow
Vision Transformer Implementation in TensorFlow
Language: Python - Size: 693 KB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 3 - Forks: 2
OumaimaHourrane/TopicTransformer
A Pytorch implementation of TopicTransformer for language modeling (the original paper is under journal review and coming soon)
Language: Python - Size: 9.77 KB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 1 - Forks: 0
chaithrakc/news-summarization
Generating short length description of news articles
Language: Jupyter Notebook - Size: 64.2 MB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 1
jaketae/realformer
PyTorch implementation of RealFormer: Transformer Likes Residual Attention
Language: Python - Size: 7.81 KB - Last synced: over 1 year ago - Pushed: about 3 years ago - Stars: 8 - Forks: 4
jiangnanboy/knowledge-automatic-tagging
题目知识点预测标注。Question knowledge point prediction.
Language: Jupyter Notebook - Size: 7.74 MB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 11 - Forks: 4
hoangtuanvu/conformer_ocr
Transformer OCR is a Optical Character Recognition tookit built for researchers working on both OCR for both Vietnamese and English. This project only focused on variants of vanilla Transformer (Conformer) and Feature Extraction (CNN-based approach).
Language: Python - Size: 164 KB - Last synced: over 1 year ago - Pushed: over 2 years ago - Stars: 6 - Forks: 4
samrat-halder/personality-detection-with-BERT-RoBERT
Detection of MBTI-type personality with NLP and Deep Learning
Language: Python - Size: 850 KB - Last synced: over 1 year ago - Pushed: about 4 years ago - Stars: 4 - Forks: 1
ApurbaSengupta/Lyrics-Generation-using-BERT
Generating English Rock lyrics using BERT
Language: Jupyter Notebook - Size: 35.2 MB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 17 - Forks: 2
OumaimaHourrane/Bert_LDA_Combo
Topic modeling using BERT and LDA combination.
Language: Jupyter Notebook - Size: 227 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 4 - Forks: 1
brainsqueeze/text2vec
Contextual embedding for text blobs.
Language: Python - Size: 771 KB - Last synced: over 1 year ago - Pushed: almost 2 years ago - Stars: 9 - Forks: 1
heartcored98/transformer_anatomy
Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020
Language: Python - Size: 30.8 MB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 14 - Forks: 4
Kojk-AI/spobet
Pose-based word-level sign language recognition with BERT-styled transformer in Keras
Language: Python - Size: 34.2 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0
SuperbTUM/Transformer-Quantization Fork of Alexstrasza98/Transformer-Quantization
Transformer quantization and binarization exploration
Language: Jupyter Notebook - Size: 3 MB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 0 - Forks: 0
naokishibuya/simple_transformer
A Transformer Implementation that is easy to understand and customizable.
Language: Python - Size: 46.9 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 4 - Forks: 2
frankhjh/Abnormality-Recognition-in-Medical-Image-Report
Use several classical deep learning models to solve multi-label NLP classification problem
Language: Python - Size: 8.24 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0
brainsqueeze/SequenceModels.jl
Julia experimentation using sequence-based NLP models
Language: Julia - Size: 34.2 KB - Last synced: over 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0
yurayli/jigsaw-toxic-bias-reduction
unbiased toxicity detection from comments
Language: Jupyter Notebook - Size: 10.1 MB - Last synced: over 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0
DwaraknathT/NABU
Code for the paper "NABU - Multilingual Graph-based Neural RDF Verbalizer"
Language: Python - Size: 16.1 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 1 - Forks: 1
yashkim77/Document-Similarity
Semantic Textual Similarity between two document
Language: Jupyter Notebook - Size: 160 KB - Last synced: 8 months ago - Pushed: over 4 years ago - Stars: 3 - Forks: 0
Suchetaaa/TransformerbasedRL
CS747 - Foundations Of Intelligent Learning Agents (FILA) Course Project
Language: Jupyter Notebook - Size: 4.57 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0
chenjun2hao/transformerOcr
use transformer as the decoder model for OCR
Size: 0 Bytes - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 1 - Forks: 1
aayux/fitfast
Quickly fine-tune language models for your downstream NLP tasks.
Language: Python - Size: 110 KB - Last synced: over 1 year ago - Pushed: about 5 years ago - Stars: 0 - Forks: 0