GitHub topics: language-modeling

Repositories

young-zonglin/yangzl-deep-lm-keras

Language modeling using several deep models.

Language: Python - Size: 4.19 MB - Last synced at: over 1 year ago - Pushed at: about 6 years ago - Stars: 1 - Forks: 0

fcakyon/gpt2-shakespeare

A tutorial on GPT2 language model training with texts from Shakespeare

Language: Jupyter Notebook - Size: 25.4 KB - Last synced at: 3 months ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 2

joelwk/Generative-Modeling

Experiment and showcase custom and pre-built generative models. Boto3 & ClearML SDK integrations

Language: Jupyter Notebook - Size: 4.92 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

jacerong/normalesp

An open-source spell checker for texts written in Spanish, with a focus on tweets.

Language: Python - Size: 4.85 MB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 2

highplainscomputing/HPC_T5

This repository is made for T5 model where user can train their model on any T5 model version.

Language: Jupyter Notebook - Size: 1.21 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

daskol/lsp-lm

Language Model as a Language Server

Language: Python - Size: 205 KB - Last synced at: 4 months ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

tlu-dt-nlp/POSgram-contexts

Tool for extracting part of speech n-grams (POS-grams) together with their context (preceding/following POS or sentence onset/ending).)

Language: Jupyter Notebook - Size: 468 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

ishan00/translation-for-code-switching-acl

Official repository for the paper titled "From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text" accepted at ACL 2021

Language: Python - Size: 8.59 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 2

ohmthanap/CS584_Natural-Language-Processing

Learned knowledge and techniques in Natural Language Processing and also related tools: Python, Pytorch, Jupyter Notebook, Google Colab, RNN, CNN, Reinforcement Learning, LSTM, Language Modeling

Language: Jupyter Notebook - Size: 185 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

etetteh/e

Language: Python - Size: 51.1 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

jiali-ms/JLM

A fast LSTM Language Model for large vocabulary language like Japanese and Chinese

Language: Python - Size: 51.7 MB - Last synced at: about 2 months ago - Pushed at: about 6 years ago - Stars: 109 - Forks: 23

tm4roon/pytorch-translm

An implementation of transformer-based language model for sentence rewriting tasks such as summarization, simplification, and grammatical error correction.

Language: Python - Size: 1.09 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 28 - Forks: 7

zulfiqarAlibalti/LLM-SaaS

Full Stack Development, Large Language Models, NLP (Natural Language Processing), Language Understanding, Text Generation

Language: TypeScript - Size: 12.8 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

MrHacker-X/ArtifyX

The ultimate AI-powered art generator

Language: Shell - Size: 31.3 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 19 - Forks: 1

ChinmayMittal/COL764-Information-Retrieval

Information Retreival Course Repository, 7th Semester, IITD, 2023-24

Language: C - Size: 234 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

khlaifiabilel/Awesome-Machine-Learning-On-Source-Code-V2

A curated list of awesome research papers, datasets and software projects devoted to machine learning and source code.

Size: 316 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 2

SNUDerek/lm_perplexity_bootstrapping

demo of domain corpus bootstrapping using language model perplexity

Language: Jupyter Notebook - Size: 61.5 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 3

rkapur102/language_phylogeny_feature_simulations

Simulations of language evolution and phylogenetic/feature dynamics, as described in: "Kapur, Rhea and Phillip Rogers. 2020. Modeling language evolution and feature dynamics in a realistic geographic environment. 28th International Conference on Computational Linguistics (COLING 2020), Barcelona, Spain."

Language: R - Size: 11.3 MB - Last synced at: 8 months ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 0

p-lambda/incontext-learning

Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implicit Bayesian Inference"

Language: Python - Size: 76.2 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 69 - Forks: 12

geyingli/unif

基于 Tensorflow，仿 Scikit-Learn 设计的深度学习自然语言处理框架。支持 40 余种模型类，涵盖语言模型、文本分类、NER、MRC、知识蒸馏等各个领域

Language: Python - Size: 6.28 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 110 - Forks: 29

NLP2CT/TempoSum

Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarization

Size: 5.86 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

uzaymacar/comparatively-finetuning-bert

Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in PyTorch.

Language: Python - Size: 113 KB - Last synced at: over 1 year ago - Pushed at: almost 5 years ago - Stars: 112 - Forks: 28

nstrodt/UDSMProt

Protein sequence classification with self-supervised pretraining

Language: Python - Size: 30 MB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 78 - Forks: 24

namanrajpal/Java-Based-Compiler-Using-ASM

Made using Visitor Design Pattern, JVM compiler comprising of Scanner,Parser, Type Checker and JVM Byte Code Generator using ASM.

Language: Java - Size: 49.8 KB - Last synced at: over 1 year ago - Pushed at: almost 8 years ago - Stars: 3 - Forks: 1

halolimat/LNEx

:round_pushpin: :office: :bank: :post_office: :convenience_store: :department_store: LNEx: Location Name Extractor

Language: Python - Size: 87.3 MB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 24 - Forks: 4

georgezoto/RNN-LSTM-NLP-Sequence-Models

Sequence Models repository for all projects and programming assignments of Course 5 of 5 of the Deep Learning Specialization offered on Coursera and taught by Andrew Ng, covering topics such as Recurrent Neural Network (RNN), Gated Recurrent Unit (GRU), Long Short Term Memory (LSTM), Natural Language Processing, Word Embeddings and Attention Model.

Language: Jupyter Notebook - Size: 82.7 MB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 9 - Forks: 4

shayneobrien/language-modeling

Language modeling on the Penn Treebank (PTB) corpus using a trigram model with linear interpolation, a neural probabilistic language model, and a regularized LSTM.

Language: Jupyter Notebook - Size: 1.98 MB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 15 - Forks: 3

dhwajraj/lm-finetune-NER

Language Model Fine-tuning for Named Entity Recognition (and other sequence tagging tasks)

Language: Python - Size: 29.3 KB - Last synced at: over 1 year ago - Pushed at: almost 7 years ago - Stars: 2 - Forks: 0

Wingsdh/transformer-xl-refactoring

A refactored version of kimiyoung / transformer-xl/tf

Language: Python - Size: 875 KB - Last synced at: over 1 year ago - Pushed at: almost 5 years ago - Stars: 11 - Forks: 3

ChocoWu/LasUIE

Universal Information Extraction, codes for the NeurIPS-2022 paper: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model.

Language: Python - Size: 7.17 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 40 - Forks: 3

zhaoyanpeng/syntax-induction-in-deep-learning-era

Unsupervised Learning of Syntax

Size: 6.84 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1

BoHuangLab/Protein-Localization-Transformer

Code for CELL-E: Biological Zero-Shot Text-to-Image Synthesis for Protein Localization Prediction

Language: Python - Size: 10.2 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 22 - Forks: 1

dr-costas/SEDLM

Language modelling for sound event detection

Language: Python - Size: 138 KB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 19 - Forks: 5

SpydazWebAI-NLP/BasicLanguageModelling2023

Basic Language Models , Bag of Words, Ngram Models Etc

Language: Visual Basic .NET - Size: 311 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 1

nilesh2797/perceiver-lm Fork of esceptico/perceiver-io

Unofficial PyTorch implementation of PerceiverIO for language modeling

Language: Python - Size: 1.18 MB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

referit3d/referit3d

Code accompanying our ECCV-2020 paper on 3D Neural Listeners.

Language: C++ - Size: 15.8 MB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 81 - Forks: 13

Shashi456/Deep-Learning-Research

Summaries of papers on Deep Learning, Natural Language Processing, Computer vision

Language: Jupyter Notebook - Size: 2.06 MB - Last synced at: 3 months ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0

ipekseyitoglu/Morse_Translate_Project

Language: Python - Size: 6.84 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

Jeevesh8/AutoRegressive-MLM Fork of deterministic-algorithms-lab/NLP-Journey

This repository extends a basic MLM implementation to allow for efficiently conditioning on chained previous texts, in a tree; for e.g., a Reddit thread.

Language: Python - Size: 1.91 MB - Last synced at: 4 months ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

ymoslem/MT-LM

Domain-Specific Text Generation for Machine Translation (with LLMs) - scripts and config files for the paper

Language: Python - Size: 12.4 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 9 - Forks: 2

CSF-VSU/AutomataTheory

Language: Jupyter Notebook - Size: 44.4 MB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

suriyadeepan/rnn-from-scratch

Use tensorflow's tf.scan to build vanilla, GRU and LSTM RNNs

Language: Python - Size: 1.51 MB - Last synced at: over 1 year ago - Pushed at: over 8 years ago - Stars: 127 - Forks: 55

dobladov/kibana-fieldFormats-locale

Kibana plugin to provide the language or location given a ISO_3166-1 code

Language: JavaScript - Size: 8.79 KB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

ankitesh97/NewsGenerator

Rnn (vanial, GRU and LSTM) from scratch

Language: Python - Size: 40 MB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 2

dlsucelt/Transformer

Language Modeling + Transfer Learning demo using the GPT-2 Transformer architecture.

Language: Jupyter Notebook - Size: 18.6 KB - Last synced at: almost 2 years ago - Pushed at: about 6 years ago - Stars: 4 - Forks: 3

dlsucelt/Cellar

Central repository with pretrained models for transfer learning, BPE subword-tokenization, mono/multilingual embeddings, and everything in between.

Language: Python - Size: 379 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 1

hiepnguyen034/Speech_Generator

generate formal speeches using language modeling

Language: Python - Size: 92.8 MB - Last synced at: almost 2 years ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

mrm8488/electricidad-base

Spanish Electra

Size: 3.91 KB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

markab4/Language-Modeling-in-Python

Python program to train several language models and evaluate them on two test corpora.

Language: Python - Size: 1.95 MB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 1

chao-ji/tf-transformerxl-language-model

Tensorflow 2 implementation of TransformerXL for language modeling

Language: Python - Size: 113 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 1

SantoshPenugurthi/Topic-Modelling-on-Telugu-English-Code-mixed-data-using-LDA-

This is Natural Language Processing project utilized the LDA model to analyze Telugu-English code-mixed data, enabling effective topic modeling and gaining valuable insights from the text

Language: Jupyter Notebook - Size: 1.99 MB - Last synced at: almost 2 years ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

spydaz/ClassTokenizer

Basic Tokenizer - Creates tokens - enabling for creation of personal syntax; removal of unwanted characters etc

Language: Visual Basic .NET - Size: 16.6 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 2

nytud/emLam

Preprocessing scripts for Hungarian Language Modeling

Language: Python - Size: 239 KB - Last synced at: about 1 year ago - Pushed at: about 5 years ago - Stars: 3 - Forks: 2

FilipCore034/Machine-learning-Datasets

Discover the Machine learning datasets! Diverse content for 🎓 education, 📊 research, 👥 non-profit use and experimenting. Download, merge files for 📝 convenience. Contribute to enhance language modeling, 🤖 machine learning, 🎓 education, data analysis, and 🧪 software development. Note: Content sourced for non-profit, educational use. Enjoy! ;)

Language: PowerShell - Size: 138 MB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0

saeeddhqan/tiny-transformer

Tiny transformer models implemented in pytorch.

Language: Python - Size: 11.8 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

AnantShankhdhar/AI-Rap-Lyric-Generator

Generating Rap Lyrics from Artist Name and Song Title using GPT2

Language: Python - Size: 914 KB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

sileod/language-model-recommendation

Resources accompanying the "Zero-Shot Recommendation as Language Modeling" paper (ECIR2022)

Language: Jupyter Notebook - Size: 16.6 KB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 9 - Forks: 2

fgaim/Tigrinya-PLMs

Resources for the paper: Monolingual Pre-trained Language Models for Tigrinya

Language: Python - Size: 55.7 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

SabaUrgup/Language_Detector

With this program, you can find the frequencies of defined biagrams and trigrams in a text entered, and as a result, you can see whether the language of this text is German or English.

Language: C - Size: 247 KB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 7 - Forks: 0

kjgpta/Code-Switch-Language-Modeling-for-English-and-Malay

Code-Switched Data generation based on Part-of-speech and Language Modeling of the generated text.

Language: Jupyter Notebook - Size: 153 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

asahi417/LSTMCell 📦

Implement modern LSTM cell by tensorflow and test them by language modeling task for PTB. Highway State Gating, Hypernets, Recurrent Highway, Attention, Layer norm, Recurrent dropout, Variational dropout.

Language: Python - Size: 391 KB - Last synced at: 6 months ago - Pushed at: over 6 years ago - Stars: 30 - Forks: 8

AndyCheang/TempoSum

TempoSum: Evaluating the Temporal Generalization of Abstractive Summarization

Size: 6.84 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

zotroneneis/LSTM_language_model

LSTM-based language model in TensorFlow

Language: Python - Size: 1.64 MB - Last synced at: about 2 months ago - Pushed at: about 5 years ago - Stars: 8 - Forks: 6

nkcr/overlap-ml 📦

Reference implementation of the paper "Alleviating Sequence Information Loss with Data Overlapping and Prime Batch Sizes" - CoNLL 2019

Language: Python - Size: 2.44 MB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

rusiaaman/XLnet-gen 📦

XLNet for generating language.

Language: Python - Size: 242 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 169 - Forks: 20

styfeng/GenAug

Code for GenAug: Data Augmentation for Finetuning Text Generators.

Language: Jupyter Notebook - Size: 20.7 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 16 - Forks: 3

vaddhiparthy/GPT

Fine-tuning GPT-2 models with custom text corpora, utilizing Hugging Face's Transformers library and advanced training techniques for sophisticated text generation applications.

Language: Python - Size: 15.6 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

dimitry-co/Language-Modeling

Python program to train three language models and evaluate them on a test corpora

Language: Python - Size: 9.89 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

Reason-Wang/mini_lm_lstm

This is a lstm implementation with pytorch. Trained for language modeling.

Language: Jupyter Notebook - Size: 13.8 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

DarshanAdiga/idiom-principle-on-magpie-corpus

Idiom Principle on MAGPIE dataset

Language: Python - Size: 246 MB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 1

duanyiqun/ICOBase-whitepaper

A simple dataset of ICO whitepapers with annotation of the quality of associated projects. The annotation is sparse with cross validation of annotators

Language: Io - Size: 14.3 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 6

gabrielyancy99/SeisMundos

Global etymology approximation with Levenshtein distance

Language: Python - Size: 1.11 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

1ucky40nc3/feed_h3

Feed Hungry Hungry Hippos (H3) - Do Languange Modeling with a 🦛 (unofficial)

Language: Python - Size: 62.5 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

pharo-ai/ngram 📦

N-gram functionality for Pharo

Language: Smalltalk - Size: 40 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 2

lochbrunner/chop-specs

Chop Language Specifications

Size: 71.3 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

asgaardlab/21-markos-test_case_improvement_framework-code

Repository with the source code of our experiments for an automated NLP-based framework to improve test cases written in natural language

Language: Jupyter Notebook - Size: 65.4 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 0

machelreid/m2d2

M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer

Language: Python - Size: 9.08 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 43 - Forks: 2

Hritikbansal/RNNs_SVA_OOD

This is an official pytorch implementation for the experiments described in the paper - Can RNNs trained on harder subject-verb agreement instances still perform well on easier ones?

Language: Python - Size: 53.6 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 1

christian-westbrook/interactive-sentence-predictor 📦

An interactive sentence predictor that generates likely continuations of partial sentences.

Language: Java - Size: 79.1 MB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

miras-tech/MirasText

MirasText

Language: Python - Size: 9.15 MB - Last synced at: over 2 years ago - Pushed at: almost 5 years ago - Stars: 52 - Forks: 7

sedrickkeh/PINEAPPLE

Dataset and code for PINEAPPLE: Personifying INanimate Entities by Acquiring Parallel Personification data for Learning Enhanced generation (COLING 22)

Language: Python - Size: 37.1 KB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 0

davidvos/prefix-tuning-for-data-management

Parameter-efficient automation of data wrangling tasks with prefix-tuning and the T5 language model.

Language: Python - Size: 8.2 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

JoyeBright/NLP981

Repository for the lectures taught in the course named "Natural Language Processing" at the University of Guilan, Department of Computer Engineering.

Language: Python - Size: 7.36 MB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 13 - Forks: 10

seduerr91/ilm-api

Object-oriented micro-service implemented in Python based on Deep Learning model BERT. --- This is a micro-service exposed via the FastAPI that allows to infill words/sentences into a given context based on a paper by Stanford University. The corresponding article got featured on medium.com/analytics-vidhya.

Language: Python - Size: 9.58 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 3