Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: transformer-encoder

ImMohammadHosseini/MKP-RL

:sparkles: Solve multi_dimensional multiple knapsack problem using state_of_the_art Reinforcement Learning Algorithms and transformers

Language: Python - Size: 5.41 MB - Last synced: 30 days ago - Pushed: 30 days ago - Stars: 8 - Forks: 1

microsoft/DeBERTa

The implementation of DeBERTa

Language: Python - Size: 237 KB - Last synced: 27 days ago - Pushed: 8 months ago - Stars: 1,852 - Forks: 209

Shikhar-S/EvolvedTransformer

Contains pytorch implementation of Transformer and EvolvedTransformer architectures. WIP

Language: Jupyter Notebook - Size: 22.2 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 8 - Forks: 4

lilianweng/transformer-tensorflow

Implementation of Transformer Model in Tensorflow

Language: Python - Size: 22.6 MB - Last synced: about 1 month ago - Pushed: about 1 year ago - Stars: 427 - Forks: 84

microsoft/CASPR

CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.

Language: Python - Size: 2.47 MB - Last synced: 25 days ago - Pushed: over 1 year ago - Stars: 36 - Forks: 3

zhongkaifu/Seq2SeqSharp

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

Language: C# - Size: 427 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 188 - Forks: 38

utahnlp/therapist-observer

Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"

Language: Python - Size: 283 KB - Last synced: 26 days ago - Pushed: almost 2 years ago - Stars: 12 - Forks: 5

helpmefindaname/transformer-smaller-training-vocab

Temporary remove unused tokens during training to save ram and speed.

Language: Python - Size: 1.49 MB - Last synced: 29 days ago - Pushed: about 2 months ago - Stars: 20 - Forks: 2

wgcban/ChangeFormer

[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

Language: Python - Size: 13.8 MB - Last synced: 2 months ago - Pushed: 4 months ago - Stars: 375 - Forks: 52

declare-lab/MIME

This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.

Language: Python - Size: 25.2 MB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 42 - Forks: 13

JayaswalVivek/Transformer_Encoder_Based_Regression

Transformer-encoder for performing a NLP task

Language: Jupyter Notebook - Size: 46.9 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

LLeon360/Google-Decimeter-Challenge-23

Use Transformers to predict Time-Series smartphone positioning from GNSS data.

Language: Jupyter Notebook - Size: 21.5 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 1

VITA-Group/TransGAN

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

Language: Python - Size: 139 MB - Last synced: 3 months ago - Pushed: over 1 year ago - Stars: 1,608 - Forks: 199

young-zonglin/yangzl-deep-text-matching

Text matching using several deep models.

Language: Python - Size: 86.9 KB - Last synced: 3 months ago - Pushed: over 5 years ago - Stars: 1 - Forks: 1

brightmart/bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

Language: Python - Size: 16 MB - Last synced: 3 months ago - Pushed: over 5 years ago - Stars: 959 - Forks: 212

kyegomez/ShallowFF

Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"

Language: Python - Size: 36.2 MB - Last synced: 29 days ago - Pushed: 29 days ago - Stars: 6 - Forks: 0

blaze7451/Project-Haruki-Murakami2

Haruki Murakami style text generation project using transformers.

Language: Jupyter Notebook - Size: 1.9 MB - Last synced: 4 months ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

KanishkNavale/heimdall

A comprehensive code for AI & Robotics.

Language: Python - Size: 104 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 0

zhenyuanlu/PainAttnNet

Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals

Language: Python - Size: 1.83 MB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 7 - Forks: 1

Curtis-Wu/Equivariant-Graph-Transformer

A deep neural network with hybrid architecture (EGNN + Transformer) for molecular properties prediction.

Language: Jupyter Notebook - Size: 41.6 MB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 3 - Forks: 0

Platanus-hy/sememes_codriven_text_matching

Co-Driven Recognition of Semantic Consistency via the Fusion of Transformer and HowNet Sememes Knowledge

Language: Python - Size: 9.81 MB - Last synced: 8 months ago - Pushed: over 1 year ago - Stars: 3 - Forks: 0

maurotangari/deeplearning

Deep Learning project October 2023

Language: Jupyter Notebook - Size: 10.3 MB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

biovino1/VecAligns

Using the similarity between embedded protein sequences to align them

Language: Python - Size: 132 MB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

lucylow/En_francais_si_vous_plait-

French English Machine Translation. Natural language processing (NLP) transformer model from "Attention Is All You Need"

Language: Python - Size: 5.56 MB - Last synced: about 1 month ago - Pushed: over 4 years ago - Stars: 6 - Forks: 1

thomasdurkin/Classification-of-Cancer-Discussion-Posts

A comparative study of deep learning models to correctly identify the cancer a patient has, as a means to creating a more streamlined process when making a post on the Cancer Survivors Network website.,

Language: Jupyter Notebook - Size: 33.7 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0

lordzuko/Transformer-Stance-Detection

This is a transformer based implementation for Stance Detection with Bidirectional Conditional Encoding

Language: Python - Size: 65.9 MB - Last synced: 9 months ago - Pushed: about 1 year ago - Stars: 3 - Forks: 1

Shuvro-d/Projects

Projects based on self learning purpose.

Language: Jupyter Notebook - Size: 4.78 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0

bh1995/AF-classification

The repo is for the Heart Disease classification project using Transformer Encoders in PyTorch.

Language: Python - Size: 23.4 KB - Last synced: 10 months ago - Pushed: almost 3 years ago - Stars: 26 - Forks: 8

matchild/DeepBrownianMotion

A deep learning classification tool for anomalous diffusion trajectories.

Language: Jupyter Notebook - Size: 4.03 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 1 - Forks: 0

liacov/homework3_transformer

Repository for Homework 3 - Neural Networks and Deep Learning course @ UniPD. Second version. Transformer for text generation.

Language: Jupyter Notebook - Size: 314 MB - Last synced: 10 months ago - Pushed: over 3 years ago - Stars: 1 - Forks: 1

amitkumarj441/bCapsule

When BERT meets Capsule

Language: Python - Size: 4.84 MB - Last synced: 10 months ago - Pushed: almost 5 years ago - Stars: 1 - Forks: 0

jackaduma/SecBERT

pretrained BERT model for cyber security text, learned CyberSecurity Knowledge

Language: Python - Size: 490 KB - Last synced: 10 months ago - Pushed: about 1 year ago - Stars: 81 - Forks: 17

keshavbhandari/Predicting-Customer-Return

Objective: Predicting whether the customer will return or not in the next month. Techniques used: XGBoost, logistic regression, attention based LSTM neural network, self attention based transformer neural network

Language: Python - Size: 18.6 KB - Last synced: 10 months ago - Pushed: over 3 years ago - Stars: 2 - Forks: 0

larngroup/TAG-DTA

TAG-DTA: Binding Region-Guided Strategy to Predict Drug-Target Affinity Using Transformers

Language: Python - Size: 466 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0

StefanHeng/Zeroshot-Text-Classification

Exploring fast & accurate zero-shot text classification

Language: Python - Size: 3.68 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0

Vidhiwar/multimodule-ecg-classification

Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification

Language: Jupyter Notebook - Size: 1.5 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 43 - Forks: 14

cslab-hub/LocalTSMHAInterpretability

Visualization method of MHA which was trained on time series data, to improve human interpretation

Language: TypeScript - Size: 68.2 MB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 0 - Forks: 0

cslab-hub/GlobalTimeSeriesCoherenceMatrices

Code for the Paper Constructing Global Coherence Representations:Identifying Interpretability and Coherences ofTransformer Attention in Time Series Data. It is about creating coherence matrices which represent the attention from each symbol to each other symbol.

Language: TypeScript - Size: 114 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 1 - Forks: 0

zarzouram/aics-project 📦

Language: TeX - Size: 14.6 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

Samleo8/SCARF Fork of jchibane/srf

Stereo Cross-Attention Radiance Fields (SCARF) - Modification of SRF with cross-attention (transformer) mechanism

Language: Python - Size: 347 MB - Last synced: 4 months ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

nikhilroxtomar/Vision-Transformer-ViT-in-TensorFlow

Vision Transformer Implementation in TensorFlow

Language: Python - Size: 693 KB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 3 - Forks: 2

OumaimaHourrane/TopicTransformer

A Pytorch implementation of TopicTransformer for language modeling (the original paper is under journal review and coming soon)

Language: Python - Size: 9.77 KB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 1 - Forks: 0

chaithrakc/news-summarization

Generating short length description of news articles

Language: Jupyter Notebook - Size: 64.2 MB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 1

jaketae/realformer

PyTorch implementation of RealFormer: Transformer Likes Residual Attention

Language: Python - Size: 7.81 KB - Last synced: over 1 year ago - Pushed: about 3 years ago - Stars: 8 - Forks: 4

jiangnanboy/knowledge-automatic-tagging

题目知识点预测标注。Question knowledge point prediction.

Language: Jupyter Notebook - Size: 7.74 MB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 11 - Forks: 4

hoangtuanvu/conformer_ocr

Transformer OCR is a Optical Character Recognition tookit built for researchers working on both OCR for both Vietnamese and English. This project only focused on variants of vanilla Transformer (Conformer) and Feature Extraction (CNN-based approach).

Language: Python - Size: 164 KB - Last synced: over 1 year ago - Pushed: over 2 years ago - Stars: 6 - Forks: 4

samrat-halder/personality-detection-with-BERT-RoBERT

Detection of MBTI-type personality with NLP and Deep Learning

Language: Python - Size: 850 KB - Last synced: over 1 year ago - Pushed: about 4 years ago - Stars: 4 - Forks: 1

ApurbaSengupta/Lyrics-Generation-using-BERT

Generating English Rock lyrics using BERT

Language: Jupyter Notebook - Size: 35.2 MB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 17 - Forks: 2

OumaimaHourrane/Bert_LDA_Combo

Topic modeling using BERT and LDA combination.

Language: Jupyter Notebook - Size: 227 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 4 - Forks: 1

brainsqueeze/text2vec

Contextual embedding for text blobs.

Language: Python - Size: 771 KB - Last synced: over 1 year ago - Pushed: almost 2 years ago - Stars: 9 - Forks: 1

heartcored98/transformer_anatomy

Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020

Language: Python - Size: 30.8 MB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 14 - Forks: 4

Kojk-AI/spobet

Pose-based word-level sign language recognition with BERT-styled transformer in Keras

Language: Python - Size: 34.2 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

SuperbTUM/Transformer-Quantization Fork of Alexstrasza98/Transformer-Quantization

Transformer quantization and binarization exploration

Language: Jupyter Notebook - Size: 3 MB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 0 - Forks: 0

naokishibuya/simple_transformer

A Transformer Implementation that is easy to understand and customizable.

Language: Python - Size: 46.9 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 4 - Forks: 2

frankhjh/Abnormality-Recognition-in-Medical-Image-Report

Use several classical deep learning models to solve multi-label NLP classification problem

Language: Python - Size: 8.24 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

brainsqueeze/SequenceModels.jl

Julia experimentation using sequence-based NLP models

Language: Julia - Size: 34.2 KB - Last synced: over 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

yurayli/jigsaw-toxic-bias-reduction

unbiased toxicity detection from comments

Language: Jupyter Notebook - Size: 10.1 MB - Last synced: over 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

DwaraknathT/NABU

Code for the paper "NABU - Multilingual Graph-based Neural RDF Verbalizer"

Language: Python - Size: 16.1 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 1 - Forks: 1

yashkim77/Document-Similarity

Semantic Textual Similarity between two document

Language: Jupyter Notebook - Size: 160 KB - Last synced: 8 months ago - Pushed: over 4 years ago - Stars: 3 - Forks: 0

Suchetaaa/TransformerbasedRL

CS747 - Foundations Of Intelligent Learning Agents (FILA) Course Project

Language: Jupyter Notebook - Size: 4.57 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

chenjun2hao/transformerOcr

use transformer as the decoder model for OCR

Size: 0 Bytes - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 1 - Forks: 1

aayux/fitfast

Quickly fine-tune language models for your downstream NLP tasks.

Language: Python - Size: 110 KB - Last synced: over 1 year ago - Pushed: about 5 years ago - Stars: 0 - Forks: 0

Related Keywords
transformer-encoder 62 deep-learning 16 transformer 16 pytorch 11 attention 8 nlp 8 transformer-architecture 8 attention-mechanism 7 machine-learning 7 bert 6 natural-language-processing 5 python 4 language-model 4 attention-is-all-you-need 4 transformers 4 transformer-models 4 attention-model 4 bert-model 4 lstm 4 tensorflow 4 vision-transformer 3 neural-network 3 sequence-to-sequence 3 transformers-models 3 bert-embeddings 2 text-embedding 2 ocr 2 text-generation 2 xai 2 jupyter-notebook 2 translation 2 lstm-neural-networks 2 cnn 2 text-classification 2 topic-modeling 2 textcnn 2 transformer-pytorch 2 deep-reinforcement-learning 2 deeplearning 2 self-attention 2 transfer-learning 2 seq2seq 1 threat-intelligence 1 threat-analysis 1 threat-hunting 1 threat-detection 1 elasticnet 1 logistic-regression 1 xgboost 1 binding-affinity 1 binding-pocket 1 drug-target-interaction 1 bi-encoder 1 sentence-transformers 1 zero-shot-classification 1 zero-shot-learning 1 mitbih 1 wmt-14 1 implementation 1 stance-detection 1 attention-unet 1 autoencoder 1 confusion-matrix 1 doubleunet 1 image-segmentation 1 inception 1 instance-segmentation 1 object-detection 1 segmentation 1 transunet 1 unet 1 vgg 1 yolov5 1 yolov7 1 ecg-classification 1 diffusion 1 capsule-network 1 apt 1 cyber-security 1 cyber-threat-intelligence 1 cybersecurity 1 deep-learning-security 1 machine-learning-security 1 nlp-machine-learning 1 security 1 security-automation 1 attention-head 1 interpretability 1 interpretable-deep-learning 1 pose-based 1 sign-language-recognition 1 sign-language-recognition-system 1 transformer-keras 1 binarization 1 quantization-aware-training 1 cnn-text-classification 1 lstm-cnn 1 julia 1 bias-reduction 1 gpt-2 1