GitHub topics: transformer-encoder

Repositories

Vlasenko2006/NeuroNMusE

Neural Network for Music Exploration (NeuroNMusE)

Language: Jupyter Notebook - Size: 20.3 MB - Last synced at: 4 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0

microsoft/DeBERTa

The implementation of DeBERTa

Language: Python - Size: 237 KB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 2,096 - Forks: 232

wgcban/ChangeFormer

[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

Language: Python - Size: 13.8 MB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 486 - Forks: 66

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

Language: C# - Size: 432 MB - Last synced at: 15 days ago - Pushed at: about 2 months ago - Stars: 204 - Forks: 42

VITA-Group/TransGAN

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

Language: Python - Size: 139 MB - Last synced at: 17 days ago - Pushed at: over 2 years ago - Stars: 1,672 - Forks: 204

lilianweng/transformer-tensorflow

Implementation of Transformer Model in Tensorflow

Language: Python - Size: 22.6 MB - Last synced at: 14 days ago - Pushed at: about 2 years ago - Stars: 469 - Forks: 90

brightmart/bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

Language: Python - Size: 16 MB - Last synced at: 16 days ago - Pushed at: over 6 years ago - Stars: 966 - Forks: 211

jiangnanboy/knowledge-automatic-tagging

题目知识点预测标注。Question knowledge point prediction.

Language: Jupyter Notebook - Size: 7.74 MB - Last synced at: 21 days ago - Pushed at: over 2 years ago - Stars: 22 - Forks: 7

jackaduma/SecBERT

pretrained BERT model for cyber security text, learned CyberSecurity Knowledge

Language: Python - Size: 490 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 178 - Forks: 34

declare-lab/MIME

This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.

Language: Python - Size: 25.2 MB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 44 - Forks: 11

art-test-stack/credit_risk_eval_model

Replication of the paper "Credit risk evaluation model with textual features from loan descriptions for P2P lending", Zhang et al. (2020), published in Electric Commerce Research and Applications.

Language: Python - Size: 849 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

verneylmavt/st-pos-tagging

A collection of Part of Speech Tagging (POST) models developed using PyTorch

Language: Jupyter Notebook - Size: 14.8 MB - Last synced at: 7 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

nikhilroxtomar/Vision-Transformer-ViT-in-TensorFlow

Vision Transformer Implementation in TensorFlow

Language: Python - Size: 693 KB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 13 - Forks: 2

ImMohammadHosseini/MKP-RL

:sparkles: Solve multi_dimensional multiple knapsack problem using state_of_the_art Reinforcement Learning Algorithms and transformers

Language: Python - Size: 5.45 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 10 - Forks: 1

kyegomez/ShallowFF

Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"

Language: Python - Size: 36.2 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 10 - Forks: 1

NotXia/biomed-ext-summ

Biomedical extractive summarization

Language: Python - Size: 156 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

jianzhi-1/masque

A monotone-to-expressive audio converter

Language: Jupyter Notebook - Size: 138 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

Pavansomisetty21/Attention-is-All-You-Need-The-Transformer-architecture

In this we explore detailed architecture of Transformer

Language: Jupyter Notebook - Size: 109 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

utahnlp/therapist-observer

Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"

Language: Python - Size: 283 KB - Last synced at: about 1 month ago - Pushed at: almost 3 years ago - Stars: 13 - Forks: 5

gazelle93/Transformer-Various-Positional-Encoding

This project aims to implement the Transformer Encoder blocks using various Positional Encoding methods.

Language: Python - Size: 27.3 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 22 - Forks: 1

heartcored98/transformer_anatomy

Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020

Language: Python - Size: 30.8 MB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 16 - Forks: 4

microsoft/CASPR

CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.

Language: Python - Size: 2.47 MB - Last synced at: 4 days ago - Pushed at: over 2 years ago - Stars: 38 - Forks: 3

helpmefindaname/transformer-smaller-training-vocab

Temporary remove unused tokens during training to save ram and speed.

Language: Python - Size: 1.49 MB - Last synced at: about 2 months ago - Pushed at: 11 months ago - Stars: 22 - Forks: 3

we-bears/NLP-Turkish-Brand-Entity-Sentiment-Recognizer

2024 Teknofest, Türkçe Doğal Dil İşleme Yarışması – Doğal Dil İşleme Senaryosu #Acıkhack2024TDDİ

Language: Jupyter Notebook - Size: 21.8 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

swardiantara/DroneLog-old

Augmenting Multitask Learning for Multiclass Anomaly Severity Detection on Drone Flight Logs

Language: HTML - Size: 6.72 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

jaketae/realformer

PyTorch implementation of RealFormer: Transformer Likes Residual Attention

Language: Python - Size: 7.81 KB - Last synced at: 27 days ago - Pushed at: about 4 years ago - Stars: 11 - Forks: 7

Shikhar-S/EvolvedTransformer

Contains pytorch implementation of Transformer and EvolvedTransformer architectures. WIP

Language: Jupyter Notebook - Size: 22.2 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 8 - Forks: 4

JayaswalVivek/Transformer_Encoder_Based_Regression

Transformer-encoder for performing a NLP task

Language: Jupyter Notebook - Size: 46.9 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

LLeon360/Google-Decimeter-Challenge-23

Use Transformers to predict Time-Series smartphone positioning from GNSS data.

Language: Jupyter Notebook - Size: 21.5 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 1

young-zonglin/yangzl-deep-text-matching

Text matching using several deep models.

Language: Python - Size: 86.9 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 1

blaze7451/Project-Haruki-Murakami2

Haruki Murakami style text generation project using transformers.

Language: Jupyter Notebook - Size: 1.9 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

KanishkNavale/heimdall

A comprehensive code for AI & Robotics.

Language: Python - Size: 104 MB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

amitkumarj441/bCapsule

When BERT meets Capsule

Language: Python - Size: 4.84 MB - Last synced at: 3 months ago - Pushed at: almost 6 years ago - Stars: 1 - Forks: 0

zhenyuanlu/PainAttnNet

Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals

Language: Python - Size: 1.83 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 1

Curtis-Wu/Equivariant-Graph-Transformer

A deep neural network with hybrid architecture (EGNN + Transformer) for molecular properties prediction.

Language: Jupyter Notebook - Size: 41.6 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

Platanus-hy/sememes_codriven_text_matching

Co-Driven Recognition of Semantic Consistency via the Fusion of Transformer and HowNet Sememes Knowledge

Language: Python - Size: 9.81 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

maurotangari/deeplearning

Deep Learning project October 2023

Language: Jupyter Notebook - Size: 10.3 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

biovino1/VecAligns

Using the similarity between embedded protein sequences to align them

Language: Python - Size: 132 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

lucylow/En_francais_si_vous_plait-

French English Machine Translation. Natural language processing (NLP) transformer model from "Attention Is All You Need"

Language: Python - Size: 5.56 MB - Last synced at: about 1 year ago - Pushed at: over 5 years ago - Stars: 6 - Forks: 1

thomasdurkin/Classification-of-Cancer-Discussion-Posts

A comparative study of deep learning models to correctly identify the cancer a patient has, as a means to creating a more streamlined process when making a post on the Cancer Survivors Network website.,

Language: Jupyter Notebook - Size: 33.7 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

lordzuko/Transformer-Stance-Detection

This is a transformer based implementation for Stance Detection with Bidirectional Conditional Encoding

Language: Python - Size: 65.9 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 1

Shuvro-d/Projects

Projects based on self learning purpose.

Language: Jupyter Notebook - Size: 4.78 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

bh1995/AF-classification

The repo is for the Heart Disease classification project using Transformer Encoders in PyTorch.

Language: Python - Size: 23.4 KB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 26 - Forks: 8

matchild/DeepBrownianMotion

A deep learning classification tool for anomalous diffusion trajectories.

Language: Jupyter Notebook - Size: 4.03 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

liacov/homework3_transformer

Repository for Homework 3 - Neural Networks and Deep Learning course @ UniPD. Second version. Transformer for text generation.

Language: Jupyter Notebook - Size: 314 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 1

keshavbhandari/Predicting-Customer-Return

Objective: Predicting whether the customer will return or not in the next month. Techniques used: XGBoost, logistic regression, attention based LSTM neural network, self attention based transformer neural network

Language: Python - Size: 18.6 KB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

larngroup/TAG-DTA

TAG-DTA: Binding Region-Guided Strategy to Predict Drug-Target Affinity Using Transformers

Language: Python - Size: 466 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

StefanHeng/Zeroshot-Text-Classification

Exploring fast & accurate zero-shot text classification

Language: Python - Size: 3.68 MB - Last synced at: 2 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

Vidhiwar/multimodule-ecg-classification

Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification

Language: Jupyter Notebook - Size: 1.5 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 43 - Forks: 14

cslab-hub/LocalTSMHAInterpretability

Visualization method of MHA which was trained on time series data, to improve human interpretation

Language: TypeScript - Size: 68.2 MB - Last synced at: 5 months ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 1

cslab-hub/GlobalTimeSeriesCoherenceMatrices

Code for the Paper Constructing Global Coherence Representations:Identifying Interpretability and Coherences ofTransformer Attention in Time Series Data. It is about creating coherence matrices which represent the attention from each symbol to each other symbol.

Language: TypeScript - Size: 114 MB - Last synced at: 5 months ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0