GitHub topics: tokenizer-parser
yetnt/jaiva
The Jaiva! "programming" languagr
Language: Java - Size: 3.12 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 1 - Forks: 0
nousantx/nguraijs
A small and lightweight library for text tokenizer
Language: TypeScript - Size: 18.6 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1 - Forks: 0
risesoft-y9/Data-Labeling
数据标注是一款专门对文本数据进行处理和标注的工具，通过简化快捷的文本标注流程和动态的算法反馈，支持用户快速标注关键词并能通过算法持续减少人工标注的成本和时间。数据标注的过程先由人工标注构建基础，再由自动标注反哺人工标注，最后由人工标注进行纠偏，从而大幅度提高标注的精准度和高效性。数据标注需要依赖开源的数字底座进行人员岗位管控。
Language: Java - Size: 1.77 MB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 669 - Forks: 95
HamedStack/HamedStack.SyntaxMania
Empowering you to create your own parser.
Language: C# - Size: 15.6 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 0
ldaniels528/oxide
Oxide is a hybrid database and streaming messaging system (think Kafka + MySQL); supporting data access via REST and SQL.
Language: Rust - Size: 1 MB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 2 - Forks: 0
ikskuh/parser-toolkit
A toolkit that makes it easier to write recursive-descent parsers in Zig.
Language: Zig - Size: 1.09 MB - Last synced at: 14 days ago - Pushed at: about 1 month ago - Stars: 75 - Forks: 8
daireto/odata-v4-query
A lightweight, simple and fast parser for OData V4 query options supporting standard query parameters. Provides helper functions to apply OData V4 query options to ORM/ODM queries such as SQLAlchemy and Beanie.
Language: Python - Size: 21.5 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0
bytexenon/LuaXen
Lua Compiler, (De)Obfuscator, Minifier, Beautifier, And more
Language: Lua - Size: 410 KB - Last synced at: 19 days ago - Pushed at: 7 months ago - Stars: 16 - Forks: 2
luminati-io/Golang-html-parsing
Parse HTML in Go using Node Parser, Tokenizer, and tools like Goquery and Colly, with practical examples and efficient web scraping techniques
Size: 7.81 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
recp/xml
🔋 In-place lightweight XML parser
Language: C - Size: 61.5 KB - Last synced at: 17 days ago - Pushed at: 12 months ago - Stars: 13 - Forks: 3
ehwan/C-language-Parser-In-Rust
C language lexer & parser & virtual interpreter from scratch in Rust
Language: Rust - Size: 2.1 MB - Last synced at: about 11 hours ago - Pushed at: 5 months ago - Stars: 24 - Forks: 2
melchisedech333/antlr4-experiments
:wrench: My studies on context-free grammar, using ANTLR4 (C++) to generate the parser files. Some basics are developed, such as token processing, recursion, variable definition, array processing, Abstract Syntax Tree (AST) manipulation, UNICODE support, and error handling.
Language: Java - Size: 378 KB - Last synced at: 10 days ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 1
ardac67/lisp_lisp
some works on lisp
Language: Common Lisp - Size: 9.77 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
Rajspeaks/Machine-Learning-approach-to-Bengali-Corpus-Tokenization-Stemming-POS-Tagging-using-BNLTK
Machine Learning approach to Bengali Corpus POS Tagging using BNLTK. This is an experimenting project under the mentorship of Prof. Sandipan Ganguly, HIT-K.
Language: Jupyter Notebook - Size: 78.1 KB - Last synced at: 17 days ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 0
benjamin-trainor/json-parser
Recreating JSON.parse
Language: TypeScript - Size: 23.4 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0
gabsfredes/LISPtoPOSFIX
Software produzido na disciplina de Linguagens Formais que deverá receber como entrada uma expressão em LISP e retornar a expressão posfixa equivalente.
Language: Python - Size: 46.9 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0
melchisedech333/lex-yacc-experiments
:wrench: My studies involving context-free grammar analysis. The analyzers were built using familiar tools such as YACC, Lex and Bison. Topics covered include token filtering, simple variable manipulation, and arrays.
Language: Yacc - Size: 283 KB - Last synced at: 24 days ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 1
zbroderson/HumanTimeParser
Simple to use parser capable of parsing a usable time object from human input
Language: C# - Size: 219 KB - Last synced at: 5 months ago - Pushed at: about 2 years ago - Stars: 9 - Forks: 0
aboss123/Ice-Programming-Language-Submission
This is a short and modern JIT compiler that transform source text, into LLVM IR bytecode that executes machine code at runtime. This project was developed at the hths.hacks() hackathon against more 250+ participants internationally and was placed as a winner. Among the winners, my project was the only one developed solo.
Language: C - Size: 15.2 MB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 8 - Forks: 0
annapoorna-a-k/SYNTAX-ANALYZER-using-Java
This is a Syntax Analyzer which can parse Jack programmes in accordance with the Jack language and generate an XML file .
Language: Java - Size: 168 KB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 3
muhiris/CompilerConstruction
All CC-Labs of Sir Nadeem.
Language: Python - Size: 44.9 KB - Last synced at: 26 days ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
vxern/text_expressions
A tiny and complete tool to supercharge static JSON strings with dynamic, user-defined expressions.
Language: Dart - Size: 84 KB - Last synced at: about 7 hours ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0
xxEBxx/Math_eval
Command-line application designed to parse and evaluate mathematical expressions
Language: C++ - Size: 271 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
ldaniels528/tinyDB.go
An experimental VM (compiler and runtime) implementation written in pure Go.
Language: Go - Size: 7.81 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
jackr276/Simple-Pascal-Like-Language-Interpreter
An interpreter for a custom-made, Pascal-Like Programming Language
Language: C++ - Size: 410 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
MoRanYue/ApiMarkupLanguage
API Markup Language Parser, implemented using TypeScript and JavaScript.
Language: TypeScript - Size: 35.2 KB - Last synced at: 12 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
DuffsDevice/tiny-parser
Write use-case specific parsers within minutes!
Language: Python - Size: 101 KB - Last synced at: 17 days ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0
HamedFathi/ParserToolkit
A toolkit that helps you to write your own parser.
Language: C# - Size: 41 KB - Last synced at: 13 days ago - Pushed at: about 1 year ago - Stars: 5 - Forks: 1
Degef/Minishell
A bash like shell or command interpreter written in C.
Language: C - Size: 54.7 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
stcjs/flkit
A JS/HTML/CSS Toolkit(Tokenizer、Parser) Support Template Syntax
Language: HTML - Size: 1.1 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0
paulo-granthon/uml-gen-tw
An automatic UML generator for Java that *actually works*
Language: Rust - Size: 7.81 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
idris-aitmoulay/minimal-parser
this repository contient a minimal parser
Language: TypeScript - Size: 3.91 KB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0
2439905184/bkscr-parser
bkengine脚本的解析器（开源实现）基于python3.8.4
Language: Python - Size: 743 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0
ander-db/Tokenizer
A very fast and low memory usage C++ automaton tokenizer that breaks an input string into a list of tokens looking at tabs, spaces, new lines, and detects special tokens like numbers, prces, personal noms, emails, lexemes, etc. It allows to specify delimeters, detect special cases and change to lowercase the tokens.
Language: C++ - Size: 7.07 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
melchisedech333/antlr4-demonstration-project
:wrench: Demonstration of using ANTLR4 (with runtime for C++) in projects for context-free grammar processing. The ANTLR4 (Java) package is included, and the project is configured to compile on Linux.
Language: C++ - Size: 2.8 MB - Last synced at: 24 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0
atmay/Tokenization
tokeniser for math in c#
Language: C# - Size: 7.81 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0
spydaz/AI_ZX81
A Basic Experiment in Parser and Compilers and Stack VM . A basic stack based CPU with Assembly language and basic commands. A basic programming Languge Parsed to Tokens to e parsed to expressions to be compiled to assembly code to be executed on the virtual CPU... Also to be used to Parse English grammar to make abstract syntax trees.
Language: Visual Basic .NET - Size: 2.72 MB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 3 - Forks: 0
MitchellGray100/Critter-World-README
A README for my private CS 2112 Critter World Project
Size: 1.37 MB - Last synced at: 26 days ago - Pushed at: almost 3 years ago - Stars: 2 - Forks: 0
jasont14/tokenizer
Python Token Tokenizer for SQL using Postgresql Keywords
Language: Python - Size: 1.95 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 1
jalalmansoori19/Compiler-Lexical-Analyzer
Assignment02 For Compiler Construction Course
Language: C++ - Size: 14.6 KB - Last synced at: 5 months ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0
