GitHub topics: albert | Ecosyste.ms: Repos

burneybuilds/burneybuilds

I'm Albet, a 19-year-old developer passionate about coding, gaming, and exploring new tech. Currently learning Node.js and front-end development—open to collaboration and always up for a challenge!

Size: 2.93 KB - Last synced at: about 17 hours ago - Pushed at: about 19 hours ago - Stars: 0 - Forks: 0

brightmart/albert_zh

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

Language: Python - Size: 2 MB - Last synced at: about 15 hours ago - Pushed at: over 2 years ago - Stars: 3,973 - Forks: 752

yongzhuo/Keras-TextClassification

中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

Language: Python - Size: 601 KB - Last synced at: about 9 hours ago - Pushed at: 11 months ago - Stars: 1,803 - Forks: 404

CLUEbenchmark/CLUE

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Language: Python - Size: 2.41 MB - Last synced at: about 22 hours ago - Pushed at: 12 months ago - Stars: 4,127 - Forks: 546

etalab-ia/albert-api

Language: Python - Size: 39.1 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 42 - Forks: 9

albertlauncher/albert

A fast and flexible keyboard launcher

Language: C++ - Size: 26 MB - Last synced at: 3 days ago - Pushed at: 13 days ago - Stars: 7,509 - Forks: 313

CLUEbenchmark/CLUECorpus2020

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

Size: 308 KB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 957 - Forks: 81

christianversloot/machine-learning-articles

🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.

Size: 77.7 MB - Last synced at: about 18 hours ago - Pushed at: 11 months ago - Stars: 3,620 - Forks: 766

lonePatient/BERT-NER-Pytorch

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

Language: Python - Size: 486 KB - Last synced at: 6 days ago - Pushed at: about 2 years ago - Stars: 2,181 - Forks: 434

explosion/curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

Language: Python - Size: 1.47 MB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 885 - Forks: 34

dbiir/UER-py

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Language: Python - Size: 50.5 MB - Last synced at: about 18 hours ago - Pushed at: about 1 year ago - Stars: 3,063 - Forks: 522

bergercookie/awesome-albert-plugins 📦

Unofficial collection of plugins for the Albert launcher (https://albertlauncher.github.io/).

Language: Python - Size: 20.5 MB - Last synced at: 10 days ago - Pushed at: 5 months ago - Stars: 162 - Forks: 11

monpa-team/monpa

MONPA 罔拍是一個提供正體中文斷詞、詞性標註以及命名實體辨識的多任務模型

Language: Python - Size: 8.25 MB - Last synced at: 24 days ago - Pushed at: 3 months ago - Stars: 246 - Forks: 25

lonePatient/Bert-Multi-Label-Text-Classification

This repo contains a PyTorch implementation of a pretrained BERT model for multi-label text classification.

Language: Python - Size: 187 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 907 - Forks: 208

CLUEbenchmark/CLUEPretrainedModels

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

Language: Python - Size: 789 KB - Last synced at: about 1 month ago - Pushed at: almost 5 years ago - Stars: 815 - Forks: 95

mparati31/albert-vscode

Simple unofficial albert-launcher extension that shows and opens recent Visual Studio Code files and folders.

Language: Python - Size: 432 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 8 - Forks: 6

Tencent/TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Language: C++ - Size: 4.04 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1,518 - Forks: 201

Tencent/TencentPretrain

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Language: Python - Size: 41.2 MB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 1,072 - Forks: 148

CLUEbenchmark/CLUENER2020

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

Language: Python - Size: 867 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 1,485 - Forks: 302

amansrivastava17/embedding-as-service

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

Language: Python - Size: 1.93 MB - Last synced at: 28 days ago - Pushed at: almost 2 years ago - Stars: 205 - Forks: 30

bartmachielsen/SupermarktConnector

Collecting product information from Dutch supermarkets: Albert Heijn and Jumbo using the Mobile API

Language: Python - Size: 247 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 131 - Forks: 24

DataXujing/NLP-paper

:art: :art:NLP 自然语言处理教程 :art::art: https://dataxujing.github.io/NLP-paper/

Size: 1.02 GB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 31 - Forks: 9

kamalkraj/ALBERT-TF2.0

ALBERT model Pretraining and Fine Tuning using TF2.0

Language: Python - Size: 235 KB - Last synced at: 7 days ago - Pushed at: about 2 years ago - Stars: 203 - Forks: 44

HHousen/TransformerSum

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

Language: Python - Size: 11.7 MB - Last synced at: 16 days ago - Pushed at: about 2 years ago - Stars: 430 - Forks: 57

duongkstn/albert-vi-as-service

albert-vi-as-service: A Fork of bert-as-service to deploy albert_vi

Language: Python - Size: 8.57 MB - Last synced at: 3 days ago - Pushed at: about 5 years ago - Stars: 11 - Forks: 3

kringkaste/albert-firefox-profiles

Extension for Albert to launch Firefox with an availaible profile.

Language: Python - Size: 14.6 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

NotShrirang/Spam-Filter-using-ALBERT

This project aims to build a spam filter using a fine-tuned ALBERT (A Lite BERT) Transformer model. The ALBERT model, pre-trained on a large corpus of text, is fine-tuned on a spam detection dataset to create an efficient and accurate spam filter.

Language: Jupyter Notebook - Size: 205 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

sudharsan13296/Getting-Started-with-Google-BERT

Build and train state-of-the-art natural language processing models using BERT

Language: Jupyter Notebook - Size: 17 MB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 221 - Forks: 83

kyzhouhzau/NLPGNN

1. Use BERT, ALBERT and GPT2 as tensorflow2.0's layer. 2. Implement GCN, GAN, GIN and GraphSAGE based on message passing.

Language: Python - Size: 205 KB - Last synced at: 30 days ago - Pushed at: 9 months ago - Stars: 335 - Forks: 66

lonePatient/albert_pytorch

A Lite Bert For Self-Supervised Learning Language Representations

Language: Python - Size: 283 KB - Last synced at: about 1 month ago - Pushed at: about 5 years ago - Stars: 716 - Forks: 150

liuyukid/transformers-ner

Pytorch-Named-Entity-Recognition-with-transformers

Language: Python - Size: 1.71 MB - Last synced at: 16 days ago - Pushed at: almost 5 years ago - Stars: 210 - Forks: 44

jiangnanboy/albert_lstm_crf_ner

albert + lstm + crf实体识别，pytorch实现。识别的主要实体是人名、地名、机构名和时间。albert + lstm + crf (named entity recognition)

Language: Python - Size: 472 KB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 137 - Forks: 32

ChineseGLUE/ChineseGLUE

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

Language: Python - Size: 2.65 MB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 1,778 - Forks: 247

labteral/ernie

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

Language: Python - Size: 326 KB - Last synced at: 9 days ago - Pushed at: 12 months ago - Stars: 200 - Forks: 31

jiangnanboy/albert_link_prediction

albert-fc for LP(Link Prediction)，中文实体链接预测

Language: Python - Size: 217 KB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 18 - Forks: 4

diesphink/albert-themes

Themes for albert launcher

Size: 12.7 KB - Last synced at: 2 days ago - Pushed at: over 7 years ago - Stars: 4 - Forks: 0

ardimento/bugfix

This repository contains the implementation for predicting bug-fixing time using transformer-based language models. The models evaluated include ALBERT, DistilBERT, and Google BERT. The dataset consists of bug reports extracted from LiveCode's Bugzilla, with textual features such as bug descriptions and developer comments used for training.

Language: Python - Size: 4.88 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

tomsquest/albert_plugin_firefox_bookmarks

Open Firefox Bookmarks and History in AlbertLauncher

Language: Python - Size: 106 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

CLUEbenchmark/PyCLUE

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark

Language: Python - Size: 141 KB - Last synced at: 30 days ago - Pushed at: almost 2 years ago - Stars: 129 - Forks: 15

jiangnanboy/albert_srl

albert-crf for SRL(Semantic Role Labeling)，中文语义角色标注。

Language: Python - Size: 2.29 MB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 9 - Forks: 1

yongzhuo/Macropodus

自然语言处理工具Macropodus，基于Albert+BiLSTM+CRF深度学习网络架构，中文分词，词性标注，命名实体识别，新词发现，关键词，文本摘要，文本相似度，科学计算器，中文数字阿拉伯数字(罗马数字)转换，中文繁简转换，拼音转换。tookit(tool) of NLP，CWS(chinese word segnment)，POS(Part-Of-Speech Tagging)，NER(name entity recognition)，Find(new words discovery)，Keyword(keyword extraction)，Summarize(text summarization)，Sim(text similarity)，Calculate(scientific calculator)，Chi2num(chinese number to arabic number)

Language: Python - Size: 9.07 MB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 661 - Forks: 92

TomasHubelbauer/albert

Trying to lay out and cluster prices and product images in a supermarket PDF

Language: JavaScript - Size: 27.3 KB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

Hsins/Albert-Mozhi

🎨 A flat, transparent and dark theme for Albert (A fast and flexible keyboard launcher for Linux).

Size: 11.3 MB - Last synced at: about 1 month ago - Pushed at: over 5 years ago - Stars: 12 - Forks: 2

tchar/ulauncher-albert-calculate-anything

A ULauncher/Albert extension that supports currency, units and date time conversion, as well as a calculator that supports complex numbers and functions.

Language: Python - Size: 30.7 MB - Last synced at: 3 months ago - Pushed at: 10 months ago - Stars: 115 - Forks: 14

jiangnanboy/albert_re

albert-fc for RE(Relation Extraction)，中文关系抽取

Language: Python - Size: 14.1 MB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 18 - Forks: 2

lonePatient/CLUE_pytorch

CLUE baseline pytorch CLUE的pytorch版本基线

Language: Python - Size: 340 KB - Last synced at: about 1 month ago - Pushed at: about 5 years ago - Stars: 74 - Forks: 17

CLUEbenchmark/ELECTRA

中文预训练 ELECTRA 模型: 基于对抗学习 pretrain Chinese Model

Size: 955 KB - Last synced at: 3 months ago - Pushed at: about 5 years ago - Stars: 139 - Forks: 11

thepante/albert-snip

Snip screenshot extension for Albert Launcher

Language: Python - Size: 8.79 KB - Last synced at: about 2 months ago - Pushed at: about 4 years ago - Stars: 5 - Forks: 0

huseyincenik/nlp_natural_language_processing

NLP (Natural Language Processing)

Language: Jupyter Notebook - Size: 17.9 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 6 - Forks: 1

abhilash1910/ClusterTransformer

Topic clustering library built on Transformer embeddings and cosine similarity metrics.Compatible with all BERT base transformers from huggingface.

Language: Python - Size: 29.3 KB - Last synced at: 8 days ago - Pushed at: almost 4 years ago - Stars: 43 - Forks: 15

mohammad95labbaf/TransformerSentimentAnalysis

Sentiment analysis on tweets using transformer models like BERT, RoBERTa, DistilBERT, ALBERT, and XLNet with evaluation metrics.

Language: Jupyter Notebook - Size: 3.14 MB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

nithish08/tweet-sent

Using transformer models to extract phrases from sentences.

Language: Jupyter Notebook - Size: 44.9 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

amirgholami/ai_and_memory_wall

AI and Memory Wall

Size: 4.23 MB - Last synced at: 6 months ago - Pushed at: about 1 year ago - Stars: 206 - Forks: 25

gaizkiaadeline/Multilabel-Hate-Speech-Classification-Using-LLM

A project focused on building a multilabel classification model to detect hate speech on social media using BERT and ALBERT pretrained models. It includes data augmentation techniques and hyperparameter tuning for optimal performance in identifying abusive content and hate speech.

Language: Jupyter Notebook - Size: 305 KB - Last synced at: 3 days ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

jiangnanboy/albert_ner

albert-crf for NER(Named Entity Recognition)，中文实体识别。

Language: Python - Size: 2.35 MB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 8 - Forks: 1

DenverCoder1/timezone-convert-albert-ext

Albert launcher extension for converting between timezones

Language: Python - Size: 28.3 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 0

SeaEagleI/question-answering

本科毕设存档

Language: Python - Size: 47.7 MB - Last synced at: 9 months ago - Pushed at: almost 4 years ago - Stars: 3 - Forks: 0

etalab-ia/albert-models

Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.

Language: Python - Size: 734 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 24 - Forks: 3

luozhouyang/transformers-keras

Transformer-based models implemented in tensorflow 2.x(using keras).

Language: Python - Size: 696 KB - Last synced at: 20 days ago - Pushed at: over 3 years ago - Stars: 75 - Forks: 13

chai-co/albert-ner-chinese-starter

中文命名实体识别

Language: Python - Size: 38 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

SalihTuncer/AssessHumor

Assessing Humor in Edited News Headlines with ALBERT

Language: Python - Size: 72.7 MB - Last synced at: 11 months ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

HuiResearch/tfbert

基于tensorflow1.x的预训练模型调用，支持单机多卡、梯度累积，XLA加速，混合精度。可灵活训练、验证、预测。

Language: Python - Size: 7.45 MB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 58 - Forks: 11

dmitrytsyu/SemEval-2021-ToxicSpansDetection

In the field of Natural Language Processing, the detection of text toxicity has become a significant challenge. To facilitate the research in this sphere, one of the tasks of the International Workshop on Semantic Evaluation 2021 is Toxic Spans Detection. The essential objective of this task is to identify toxic spans within English passages. In this paper, two approaches for toxic spans detection considered: Machine Reading Comprehension and modified Named Entity Recognition approach altogether with Machine Reading Comprehension, but also these approaches are improved by Question Generation method. Furthermore, this research presents the exploratory analysis of provided data, proposes a training process and examines the analysis of the results on F1-score of new state-of-the-art BERT-based Language Models: BERT, ALBERT, RoBERTa, XLM-RoBERTa and SpanBERT. Finally, the best language model obtained an F1-score of 0.688 on the test data.

Language: Jupyter Notebook - Size: 33.6 MB - Last synced at: 11 months ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

hammadhadikhan/Sentiment-Analysis-using-Various-NLP-approaches

I performed sentiment analysis aimed at determining the sentiment of 50000 imDB movie reviews, whether they are positive, negative, or neutral. I employed various NLP approaches including lexicon based approaches, machine learning models, PLM models, and hybrid models, and assessed the performance on each type of model.

Language: Jupyter Notebook - Size: 2.34 MB - Last synced at: 11 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

DSXiangLi/SimpleClassification

Simple Text Classification[WIP]

Language: Python - Size: 200 MB - Last synced at: 21 days ago - Pushed at: over 2 years ago - Stars: 11 - Forks: 1

fzehracetin/turkish-question-answering

We extracted 5,000 question-answer pairs from Turkish Wikipedia and fine-tuned Turkish BERT, ALBERT, ELECTRA for the question-answering task.

Language: Jupyter Notebook - Size: 1.52 MB - Last synced at: 10 months ago - Pushed at: over 3 years ago - Stars: 6 - Forks: 1

barissayil/SentimentAnalysis

Sentiment analysis neural network trained by fine-tuning BERT, ALBERT, or DistilBERT on the Stanford Sentiment Treebank.

Language: Python - Size: 16.6 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 347 - Forks: 46

nlpie-research/MiniALBERT

This repository contains the code used for training/fine-tuning the models introduced in the paper "MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers".

Language: Python - Size: 28.3 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 6 - Forks: 1

BALAJIHARIDASAN/Natural-Language-Processing

This repository consist of projects related to Natural Language Processing using machine learning and deep learning concepts

Language: Jupyter Notebook - Size: 107 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1

EscaliBud/techpoll

A bot to send tech related polls in your channel/group

Language: Python - Size: 3.91 KB - Last synced at: 12 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

tchar/ulauncher-albert-files

Ulauncher/Albert extension to search files and directories. Uses caching, gitignore style to ignore and wildcard matching and custom score to match.

Language: Python - Size: 1.25 MB - Last synced at: about 1 year ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 1

Nirbose/Albert-le-bot

Albert-le-bot

Language: PHP - Size: 104 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 0

DenverCoder1/unit-converter-albert-ext 📦

Albert launcher extension for converting units of length, mass, speed, temperature, time, current, luminosity, printing measurements, molecular substance, and more

Language: Python - Size: 71.3 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 0

CLUEbenchmark/MobileQA

离线端阅读理解应用 QA for mobile, Android & iPhone

Language: Python - Size: 52.6 MB - Last synced at: 10 days ago - Pushed at: over 2 years ago - Stars: 60 - Forks: 13

BochkarevV/yelp-reviews-sentiment-analysis

Sentiment analysis with YELP Reviews and Transformers.

Language: Jupyter Notebook - Size: 3.66 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 4

dracula/albert

🧛🏻‍♂️ Dark theme for Albert

Size: 2.65 MB - Last synced at: 26 days ago - Pushed at: about 3 years ago - Stars: 10 - Forks: 2

codegram/calbert

Catalan ALBERT (A Lite BERT for self-supervised learning of language representations)

Language: Python - Size: 1.59 MB - Last synced at: about 1 year ago - Pushed at: almost 5 years ago - Stars: 15 - Forks: 2

zer0Kerbal/StockalikeRandomRocketParts

Stock-alike Random Rocket Parts for Kerbal Space Program.

Size: 619 KB - Last synced at: 4 days ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 1

dhpollack/huggingface_libtorch

Minimal example of using a traced huggingface transformers model with libtorch

Language: C++ - Size: 169 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 31 - Forks: 12

ProHiryu/albert-chinese-ner

使用预训练语言模型ALBERT做中文NER

Language: Python - Size: 3.66 MB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 456 - Forks: 123

abhilash1910/NLP-Workshop-ML-India

NLP Workshop -ML India

Language: Jupyter Notebook - Size: 74.2 KB - Last synced at: 8 days ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 1

hellonlp/classifier_multi_label

multi-label，classifier，text classification，多标签文本分类，文本分类，BERT，ALBERT，multi-label-classification

Language: Python - Size: 691 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 138 - Forks: 41

plkmo/BERT-Relation-Extraction

PyTorch implementation for "Matching the Blanks: Distributional Similarity for Relation Learning" paper

Language: Python - Size: 543 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 530 - Forks: 130

graykode/ALBERT-Pytorch Fork of dhlee347/pytorchic-bert

Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)

Language: Python - Size: 525 KB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 220 - Forks: 48

wjunneng/2019-FlyAI-Chinese-Named-Entity-Recognition

2019 FlyAI 中文的命名实体识别

Language: Python - Size: 106 MB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

YJiangcm/SST-2-sentiment-analysis

Use BiLSTM_attention, BERT, ALBERT, RoBERTa, XLNet model to classify the SST-2 data set based on pytorch

Language: Jupyter Notebook - Size: 528 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 67 - Forks: 16

VinitSR7/TensorFlow-2.0-Question-Answering

Predict short and long answer responses to real questions about Wikipedia articles.

Language: Jupyter Notebook - Size: 1.17 MB - Last synced at: over 1 year ago - Pushed at: almost 5 years ago - Stars: 4 - Forks: 1

mboukabous/Security-Intelligence-on-Exchanged-Multimedia-Messages-Based-on-Deep-Learning

Deep learning (DL) approaches use various processing layers to learn hierarchical representations of data. Recently, many methods and designs of natural language processing (NLP) models have shown significant development, especially in text mining and analysis. For learning vector-space representations of text, there are famous models like Word2vec, GloVe, and fastText. In fact, NLP took a big step forward when BERT and recently GTP-3 came out. Deep Learning algorithms are unable to deal with textual data in their natural language data form which is typically unstructured information; they require special representation of data as inputs instead. Usually, natural language text data needs to be converted into internal representations form that DL algorithms can read such as feature vectors, hence the necessity to use representation learning models. These models have shown a big leap during the last years. Their set ranges from the methods that embed words into distributed representations and use the language modeling objective to adjust them as model parameters (like Word2vec, fastText, and GloVe), to recently transfer learning models (like ELMo, BERT, ULMFiT, XLNet, ALBERT, RoBERTa, and GPT-2). These last use larger corpora, more parameters, more computing resources, and instead of assigning each word with a fixed vector, they use multilayer neural networks to calculate dynamic representations for the words according to their context, which is especially useful for the words with multiple meanings.

Language: Python - Size: 4.13 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 5