Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: php-tokenizer

lionsoul2014/friso

High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.

Language: C - Size: 3.07 MB - Last synced at: 24 days ago - Pushed at: over 1 year ago - Stars: 497 - Forks: 91

baygin/php-simple-lexer

The Lexer layer of Compiler/Interpreter

Language: PHP - Size: 15.6 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

soiqualang/php_token

php_token

Language: PHP - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

Related Keywords
php-tokenizer 3 tokenizer 2 c 1 chinese-tokenizer 1 chinese-word-segmentation 1 cjk-tokenizer 1 full-text-search 1 japanese-tokenizer 1 korean-tokenizer 1 interpreter 1 interpreter-basic 1 lexer 1 php-interpreter 1 php-lexer 1 php-programming-language 1