An open API service providing repository metadata for many open source software ecosystems.

gitlab.com topics: tokenizer

interitty/tokenizer

Use regular expressions to split given string into tokens.

Last synced at: 4 months ago - Stars: 1 - Forks: 0

bztsrc/tok

Single header source code tokenizer written in ANSI C

Last synced at: about 2 years ago - Stars: 1 - Forks: 0

morimekta/utils-lexer

Simple tokenizer and lexer library.

Last synced at: over 1 year ago - Stars: 0 - Forks: 0

dsncode/IKAnalyzer

chinese-english dictionary based tokenizer for lucene/solr

Last synced at: over 2 years ago - Stars: 1 - Forks: 0

yiddish/yiddish-segmenter

Sentence segmenter and tokeniser for Yiddish

Last synced at: over 2 years ago - Stars: 0 - Forks: 1

syw2014/NLP-SentimentAnalysis

A repository to complete a sentiment analysis system, which contains training samples preparation, feature selection / extraction (NLP), training model selection, model optimization and evaluation, further description can be found in README

Last synced at: over 2 years ago - Stars: 0 - Forks: 0