transformer-encoder | Topic | Ecosyste.ms: Repos

Topic: "transformer-encoder"

microsoft/DeBERTa

The implementation of DeBERTa

Language: Python - Size: 237 KB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 2,072 - Forks: 234

VITA-Group/TransGAN

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

Language: Python - Size: 139 MB - Last synced at: 13 days ago - Pushed at: over 2 years ago - Stars: 1,668 - Forks: 203

brightmart/bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

Language: Python - Size: 16 MB - Last synced at: 8 days ago - Pushed at: over 6 years ago - Stars: 964 - Forks: 211

lilianweng/transformer-tensorflow

Implementation of Transformer Model in Tensorflow

Language: Python - Size: 22.6 MB - Last synced at: 16 days ago - Pushed at: about 2 years ago - Stars: 468 - Forks: 90

wgcban/ChangeFormer

[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

Language: Python - Size: 13.8 MB - Last synced at: 7 months ago - Pushed at: about 1 year ago - Stars: 422 - Forks: 56

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

Language: C# - Size: 432 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 203 - Forks: 42

jackaduma/SecBERT

pretrained BERT model for cyber security text, learned CyberSecurity Knowledge

Language: Python - Size: 490 KB - Last synced at: 16 days ago - Pushed at: almost 2 years ago - Stars: 177 - Forks: 33

declare-lab/MIME

This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.

Language: Python - Size: 25.2 MB - Last synced at: 7 days ago - Pushed at: about 2 years ago - Stars: 44 - Forks: 11

Vidhiwar/multimodule-ecg-classification

Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification

Language: Jupyter Notebook - Size: 1.5 MB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 43 - Forks: 14

microsoft/CASPR

CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.

Language: Python - Size: 2.47 MB - Last synced at: about 18 hours ago - Pushed at: about 2 years ago - Stars: 38 - Forks: 3

bh1995/AF-classification

The repo is for the Heart Disease classification project using Transformer Encoders in PyTorch.

Language: Python - Size: 23.4 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 26 - Forks: 8

helpmefindaname/transformer-smaller-training-vocab

Temporary remove unused tokens during training to save ram and speed.

Language: Python - Size: 1.49 MB - Last synced at: 5 days ago - Pushed at: 10 months ago - Stars: 22 - Forks: 3

jiangnanboy/knowledge-automatic-tagging

题目知识点预测标注。Question knowledge point prediction.

Language: Jupyter Notebook - Size: 7.74 MB - Last synced at: 29 days ago - Pushed at: over 2 years ago - Stars: 21 - Forks: 7

ApurbaSengupta/Lyrics-Generation-using-BERT

Generating English Rock lyrics using BERT

Language: Jupyter Notebook - Size: 35.2 MB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 17 - Forks: 2

heartcored98/transformer_anatomy

Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020

Language: Python - Size: 30.8 MB - Last synced at: 7 days ago - Pushed at: about 1 month ago - Stars: 16 - Forks: 4

nikhilroxtomar/Vision-Transformer-ViT-in-TensorFlow

Vision Transformer Implementation in TensorFlow

Language: Python - Size: 693 KB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 13 - Forks: 2

utahnlp/therapist-observer

Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"

Language: Python - Size: 283 KB - Last synced at: 5 months ago - Pushed at: almost 3 years ago - Stars: 12 - Forks: 5

jaketae/realformer

PyTorch implementation of RealFormer: Transformer Likes Residual Attention

Language: Python - Size: 7.81 KB - Last synced at: 20 days ago - Pushed at: almost 4 years ago - Stars: 11 - Forks: 7

kyegomez/ShallowFF

Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"

Language: Python - Size: 36.2 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 10 - Forks: 1

ImMohammadHosseini/MKP-RL

:sparkles: Solve multi_dimensional multiple knapsack problem using state_of_the_art Reinforcement Learning Algorithms and transformers

Language: Python - Size: 5.45 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 10 - Forks: 1

brainsqueeze/text2vec

Contextual embedding for text blobs.

Language: Python - Size: 771 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 9 - Forks: 1

Shikhar-S/EvolvedTransformer

Contains pytorch implementation of Transformer and EvolvedTransformer architectures. WIP

Language: Jupyter Notebook - Size: 22.2 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 8 - Forks: 4

zhenyuanlu/PainAttnNet

Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals

Language: Python - Size: 1.83 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 1

hoangtuanvu/conformer_ocr

Transformer OCR is a Optical Character Recognition tookit built for researchers working on both OCR for both Vietnamese and English. This project only focused on variants of vanilla Transformer (Conformer) and Feature Extraction (CNN-based approach).

Language: Python - Size: 164 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 6 - Forks: 4

lucylow/En_francais_si_vous_plait-

French English Machine Translation. Natural language processing (NLP) transformer model from "Attention Is All You Need"

Language: Python - Size: 5.56 MB - Last synced at: 12 months ago - Pushed at: over 5 years ago - Stars: 6 - Forks: 1

naokishibuya/simple_transformer

A Transformer Implementation that is easy to understand and customizable.

Language: Python - Size: 46.9 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 2

OumaimaHourrane/Bert_LDA_Combo

Topic modeling using BERT and LDA combination.

Language: Jupyter Notebook - Size: 227 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 1

samrat-halder/personality-detection-with-BERT-RoBERT

Detection of MBTI-type personality with NLP and Deep Learning

Language: Python - Size: 850 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 4 - Forks: 1

Curtis-Wu/Equivariant-Graph-Transformer

A deep neural network with hybrid architecture (EGNN + Transformer) for molecular properties prediction.

Language: Jupyter Notebook - Size: 41.6 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

lordzuko/Transformer-Stance-Detection

This is a transformer based implementation for Stance Detection with Bidirectional Conditional Encoding

Language: Python - Size: 65.9 MB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 1

Platanus-hy/sememes_codriven_text_matching

Co-Driven Recognition of Semantic Consistency via the Fusion of Transformer and HowNet Sememes Knowledge

Language: Python - Size: 9.81 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

yashkim77/Document-Similarity

Semantic Textual Similarity between two document

Language: Jupyter Notebook - Size: 160 KB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 0

keshavbhandari/Predicting-Customer-Return

Objective: Predicting whether the customer will return or not in the next month. Techniques used: XGBoost, logistic regression, attention based LSTM neural network, self attention based transformer neural network

Language: Python - Size: 18.6 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

verneylmavt/st-pos-tagging

A collection of Part of Speech Tagging (POST) models developed using PyTorch

Language: Jupyter Notebook - Size: 14.8 MB - Last synced at: 4 days ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

jianzhi-1/masque

A monotone-to-expressive audio converter

Language: Jupyter Notebook - Size: 138 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

matchild/DeepBrownianMotion

A deep learning classification tool for anomalous diffusion trajectories.

Language: Jupyter Notebook - Size: 4.03 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

blaze7451/Project-Haruki-Murakami2

Haruki Murakami style text generation project using transformers.

Language: Jupyter Notebook - Size: 1.9 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

Samleo8/SCARF Fork of jchibane/srf

Stereo Cross-Attention Radiance Fields (SCARF) - Modification of SRF with cross-attention (transformer) mechanism

Language: Python - Size: 347 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

cslab-hub/GlobalTimeSeriesCoherenceMatrices

Code for the Paper Constructing Global Coherence Representations:Identifying Interpretability and Coherences ofTransformer Attention in Time Series Data. It is about creating coherence matrices which represent the attention from each symbol to each other symbol.

Language: TypeScript - Size: 114 MB - Last synced at: 3 months ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

OumaimaHourrane/TopicTransformer

A Pytorch implementation of TopicTransformer for language modeling (the original paper is under journal review and coming soon)

Language: Python - Size: 9.77 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

liacov/homework3_transformer

Repository for Homework 3 - Neural Networks and Deep Learning course @ UniPD. Second version. Transformer for text generation.

Language: Jupyter Notebook - Size: 314 MB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 1

DwaraknathT/NABU

Code for the paper "NABU - Multilingual Graph-based Neural RDF Verbalizer"

Language: Python - Size: 16.1 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 1

amitkumarj441/bCapsule

When BERT meets Capsule

Language: Python - Size: 4.84 MB - Last synced at: about 1 month ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

chenjun2hao/transformerOcr

use transformer as the decoder model for OCR

Size: 0 Bytes - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 1 - Forks: 1

young-zonglin/yangzl-deep-text-matching

Text matching using several deep models.

Language: Python - Size: 86.9 KB - Last synced at: about 1 year ago - Pushed at: about 6 years ago - Stars: 1 - Forks: 1

art-test-stack/credit_risk_eval_model

Replication of the paper "Credit risk evaluation model with textual features from loan descriptions for P2P lending", Zhang et al. (2020), published in Electric Commerce Research and Applications.

Language: Python - Size: 849 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

NotXia/biomed-ext-summ

Biomedical extractive summarization

Language: Python - Size: 156 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Pavansomisetty21/Attention-is-All-You-Need-The-Transformer-architecture

In this we explore detailed architecture of Transformer

Language: Jupyter Notebook - Size: 109 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

we-bears/NLP-Turkish-Brand-Entity-Sentiment-Recognizer

2024 Teknofest, Türkçe Doğal Dil İşleme Yarışması – Doğal Dil İşleme Senaryosu #Acıkhack2024TDDİ

Language: Jupyter Notebook - Size: 21.8 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

swardiantara/DroneLog-old

Augmenting Multitask Learning for Multiclass Anomaly Severity Detection on Drone Flight Logs

Language: HTML - Size: 6.72 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

KanishkNavale/heimdall

A comprehensive code for AI & Robotics.

Language: Python - Size: 104 MB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

LLeon360/Google-Decimeter-Challenge-23

Use Transformers to predict Time-Series smartphone positioning from GNSS data.

Language: Jupyter Notebook - Size: 21.5 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 1

JayaswalVivek/Transformer_Encoder_Based_Regression

Transformer-encoder for performing a NLP task

Language: Jupyter Notebook - Size: 46.9 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

maurotangari/deeplearning

Deep Learning project October 2023

Language: Jupyter Notebook - Size: 10.3 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

biovino1/VecAligns

Using the similarity between embedded protein sequences to align them

Language: Python - Size: 132 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

thomasdurkin/Classification-of-Cancer-Discussion-Posts

A comparative study of deep learning models to correctly identify the cancer a patient has, as a means to creating a more streamlined process when making a post on the Cancer Survivors Network website.,

Language: Jupyter Notebook - Size: 33.7 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

larngroup/TAG-DTA

TAG-DTA: Binding Region-Guided Strategy to Predict Drug-Target Affinity Using Transformers

Language: Python - Size: 466 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Shuvro-d/Projects

Projects based on self learning purpose.

Language: Jupyter Notebook - Size: 4.78 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

StefanHeng/Zeroshot-Text-Classification

Exploring fast & accurate zero-shot text classification

Language: Python - Size: 3.68 MB - Last synced at: 25 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

zarzouram/aics-project 📦

Language: TeX - Size: 14.6 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Topic: "transformer-encoder"

Samleo8/SCARF Fork of jchibane/srf

zarzouram/aics-project 📦

SuperbTUM/Transformer-Quantization Fork of Alexstrasza98/Transformer-Quantization