GitHub topics: lexical-analysis

Repositories

DmitryRyumin/INTERSPEECH-2023-24-Papers

INTERSPEECH 2023-2024 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023-24 conference. Explore the latest advances in speech and language processing. Code included. Star the repository to support the advancement of speech technology!

Size: 11.4 MB - Last synced at: about 17 hours ago - Pushed at: 5 months ago - Stars: 668 - Forks: 42

acquitelol/elle

A procedural programming language built in Rust and QBE

Language: Rust - Size: 1.85 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 62 - Forks: 3

nunnowdc/Construcao-de-Compiladores--Projeto-Analisador-Lexico

Código e Relatório do projeto de construir um analisador léxico da cadeira de Construção de Compiladores

Language: C - Size: 650 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1 - Forks: 0

baidu/lac

百度NLP：分词，词性标注，命名实体识别，词重要性

Language: C++ - Size: 63.6 MB - Last synced at: about 3 hours ago - Pushed at: almost 4 years ago - Stars: 3,931 - Forks: 596

kuchuk-borom-debbarma/KukuLang-v2

A programming language for non-programmers with Syntax similar to spoken English. Created by Kuku

Language: C# - Size: 1.23 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 0

JoseRuiz01/TinyLanguageProcessor

Language processor for the Tiny programming language

Language: Java - Size: 0 Bytes - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

joejo-joestar/uni-codes

🐢

Language: C - Size: 17.4 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 2 - Forks: 1

DoctorWkt/acwj

A Compiler Writing Journey

Language: C - Size: 4.28 MB - Last synced at: 12 days ago - Pushed at: 10 months ago - Stars: 11,601 - Forks: 1,090

gecko0307/dlib

Allocators, I/O streams, math, geometry, image and audio processing for D

Language: D - Size: 12.7 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 218 - Forks: 33

iamDyeus/UCTool

Making Compiler Stages Seamless! 🚀

Language: C++ - Size: 8.79 KB - Last synced at: 15 days ago - Pushed at: 16 days ago - Stars: 1 - Forks: 1

pratyaynotfound/Recursive-descent-calculator

This is a simple calculator implemented using a recursive descent parser and lexical analyzer (scanner) in C. It supports basic arithmetic operations like addition, subtraction, multiplication, and division, as well as variable declarations, assignments, and input/output operations.

Language: C - Size: 8.79 KB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 1 - Forks: 0

Kariaro/AmpleProgrammingLanguage

Creating a compiler for my own programming language

Language: Java - Size: 1.94 MB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 8 - Forks: 0

namberino/nimble

The NIMBLE Programming Language

Language: C++ - Size: 3.22 MB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 11 - Forks: 3

HrishikeshSuchindra/Process-In-Memory-ISA-Compiler

📦 PIM Compiler A lightweight compiler for a custom 24-bit Processor-In-Memory (PIM) Instruction Set Architecture. This tool translates simple C-like matrix operations into 24-bit machine instructions through parsing, intermediate representation (IR) generation, and custom microcode mapping.

Language: C - Size: 47.9 KB - Last synced at: 23 days ago - Pushed at: 24 days ago - Stars: 1 - Forks: 0

PrathameshChatorikar/compilers-in-cpp

Language: C++ - Size: 7.81 KB - Last synced at: 26 days ago - Pushed at: 26 days ago - Stars: 0 - Forks: 0

vonderklaas/tiny-lexer

A program written in pure C language, that can perform lexical tokenization of an arbitrary programming language, 'tinylang' in this particular case.

Language: C - Size: 50.8 KB - Last synced at: 18 days ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

ghaiklor/pascal-interpreter

A simple interpreter for a large subset of Pascal language written for educational purposes

Language: JavaScript - Size: 770 KB - Last synced at: 27 days ago - Pushed at: 3 months ago - Stars: 36 - Forks: 1

gbroques/compiler

A simple compiler written from scratch in C++ for an undergraduate course in program translation.

Language: C++ - Size: 2.47 MB - Last synced at: 8 days ago - Pushed at: about 7 years ago - Stars: 49 - Forks: 13

ghaiklor/llvm-kaleidoscope

LLVM Tutorial: Kaleidoscope (Implementing a Language with LLVM)

Language: C++ - Size: 26.4 KB - Last synced at: 29 days ago - Pushed at: over 2 years ago - Stars: 248 - Forks: 49

xxas/mint

C++26 Custom Instruction Set Architecture Framework

Language: C++ - Size: 66.4 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

katef/libfsm

DFA regular expression library & friends

Language: C - Size: 7.3 MB - Last synced at: 27 days ago - Pushed at: about 1 month ago - Stars: 955 - Forks: 56

kamadorueda/santiago

Santiago is a lexing and parsing toolkit for Rust

Language: Rust - Size: 504 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 100 - Forks: 7

WGrape/lexer

A lexical analyzer based on DFA that is built using JS and supports multi-language extensions / 一个基于DFA的支持多语言扩展的JS版开源词法分析器

Language: JavaScript - Size: 6.42 MB - Last synced at: 1 day ago - Pushed at: about 2 years ago - Stars: 342 - Forks: 23

LSYS/LexicalRichness

:smile_cat: :speech_balloon: A module to compute textual lexical richness (aka lexical diversity).

Language: Python - Size: 3.46 MB - Last synced at: 28 days ago - Pushed at: over 1 year ago - Stars: 105 - Forks: 20

devangi2000/Compiler-Design

A repository containing all experiments for the course Compiler Design.

Language: Python - Size: 443 KB - Last synced at: 19 days ago - Pushed at: about 4 years ago - Stars: 28 - Forks: 11

xosnrdev/rdp 📦

A minimalist pure functional language implemented via recursive descent parsing.

Language: Rust - Size: 80.1 KB - Last synced at: 7 days ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0

Ozzy-ZY/LexOZz

About Lexus -> LexOzzz. a toy Language where I'll be Just implementing the Lexer and maybe a parser

Language: C# - Size: 11.7 KB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

SeanLee97/xmnlp

xmnlp：提供中文分词, 词性标注, 命名体识别，情感分析，文本纠错，文本转拼音，文本摘要，偏旁部首，句子表征及文本相似度计算等功能

Language: Python - Size: 114 MB - Last synced at: 27 days ago - Pushed at: over 2 years ago - Stars: 1,277 - Forks: 188

Karthikrgpt/Lexical-Analyser

Lexical analysis, also known as scanning is the first phase of a compiler which involves reading the source program character by character from left to right and organizing them into tokens.

Language: C - Size: 0 Bytes - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

miguel-amg/CompilerDesign-Project

A Forth compiler developed as part of the Compiler Design course. Made in 2024.

Language: TeX - Size: 449 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

miguel-amg/CompilerDesign-Assignments

Contains the practical assignments developed during the Compiler Design classes. Created in 2024.

Language: Python - Size: 5.48 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

sahilbansal17/AC_Circuit_Solver

Given the netlist, this program draws an AC circuit and finds the current/voltage values.

Language: C++ - Size: 1.09 MB - Last synced at: about 1 month ago - Pushed at: about 7 years ago - Stars: 8 - Forks: 2

Jamie-Rodriguez/htmlify

Converts source-code into semantically-labelled HTML

Language: Rust - Size: 0 Bytes - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

e-gun/HipparchiaGoServer

front end to greek and latin corpora: searching, browsing, concordances, texts, dictionaries, parsing

Language: Go - Size: 85.1 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

joshday/TokenIterators.jl

Easy syntax for writing fast tokenizers/lexers

Language: Julia - Size: 89.8 KB - Last synced at: 4 days ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 0

brucewlee/lingfeat

[EMNLP 2021] LingFeat - A Comprehensive Linguistic Features Extraction ToolKit for Readability Assessment

Language: Python - Size: 56.9 MB - Last synced at: 22 days ago - Pushed at: about 2 years ago - Stars: 127 - Forks: 16

Duiccni/EIC

Compiler for custom language by Egemen

Language: C++ - Size: 13.7 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

milderhc/qb64-parser

Lexer, parser and interpreter of QB64

Language: Java - Size: 512 KB - Last synced at: about 2 months ago - Pushed at: about 8 years ago - Stars: 3 - Forks: 0

hanifabd/lexifuzz-ner

Python Package for Named Entity Recognition (NER) - Based on Dictionary and Fuzzy Matching (Lexical Fuzzy Named Entity Recognition)

Language: Python - Size: 1.81 MB - Last synced at: 28 days ago - Pushed at: 10 months ago - Stars: 13 - Forks: 2

siMobin/Compiler-Lab

Fuck'n lex/flex

Language: Lex - Size: 1.45 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

JacobTheCoder19/Personal-Programming-Language

This is the repository for my very own programming language that I am making with the knowledge from one of my classes for spring semester of 2025.

Language: Python - Size: 74.2 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

h2337/clex 📦

clex is a simple lexer generator

Language: C - Size: 123 KB - Last synced at: 12 days ago - Pushed at: 5 months ago - Stars: 95 - Forks: 8

petru-braha/YP-compiler

A custom C-like compiler developed on Linux

Language: C++ - Size: 1.06 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

sazmb/compiler

Compiler of Nepal Language

Language: C - Size: 2 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

gyolkin/lexicon

Lexicon PL interpreter

Language: C - Size: 7.81 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

erickNunes000/MiniLang

Analisador lexico e sintatico utilizando linguagem Python. Projeto realizado como tarefa da disciplina de Compiladores

Language: Python - Size: 133 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

SwiftStudies/OysterKit

OysterKit is a framework that provides a native Swift scanning, lexical analysis, and parsing capabilities. In addition it provides a language that can be used to rapidly define the rules used by OysterKit called STLR

Language: Swift - Size: 8.28 MB - Last synced at: about 1 month ago - Pushed at: over 5 years ago - Stars: 177 - Forks: 23

saiteja-talluri/CS-316-Assignments

Assignments for the Compilers course in Spring 2019, IIT Bombay

Language: C++ - Size: 74.7 MB - Last synced at: about 1 month ago - Pushed at: almost 6 years ago - Stars: 3 - Forks: 6

AkashSasikumar47/Compiler-Design-Lab

This repository contains programs from the Compiler Design Lab, covering lexical analysis, parsing, syntax tree generation, and more. Implemented in C, C++, Java, and Lex, these programs demonstrate essential compiler design concepts and techniques.

Language: C - Size: 23.4 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

provrb/vm

A virtual machine and lexer in C for a custom Aseembly-like language (.pvb). Capable of running on ATmega328p microprocessors.

Language: C - Size: 3.03 MB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

LaputanMachines/simple-script

An interpreted, BASIC-like programming language. The language is built with Python. Project was built as a proof-of-concept language but has since been used for data processing at home.

Language: Python - Size: 116 KB - Last synced at: 29 days ago - Pushed at: almost 3 years ago - Stars: 6 - Forks: 0

tadiusfrank2001/CS101-Theory-of-Computation-and-Languages

Investigate models of computation, formal languages, and computability in Haskell

Language: Haskell - Size: 1.87 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

theMHD-120/EGC-Flex-Yacc-Compilers-Project

Eqbal G Mansoori Compilers; a simple version of a compiler including mathematical expressions with specified rules and instructions - Principles of Compilers Design final project - Winter 2025 /// by theMHD

Language: Yacc - Size: 3.12 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

ReshiAdavan/SPI

simple pascal interpreter

Language: Python - Size: 68.4 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

ReshiAdavan/351_Compiler

java compiler, capable of compiling w, f, java, and vhdl [ECE351]

Size: 5.86 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

NayaneBatista/compiler

Construção do trabalho prático da disciplina de Compiladores (1/2024)

Language: Yacc - Size: 703 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

DSCmatter/B2C-Transpiler

B2C Transpiler is a lightweight and minimalistic compiler designed to process a BASIC dialect using a clean and simple syntax for better readability and ease of use.

Language: Python - Size: 20.5 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

ghadeeras/languasaurus

A dynamic parser generator tool for TypeScript/JavaScript

Language: TypeScript - Size: 215 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

alirezakay/RegexToDFA

converting regex (regular expression) to DFA directly by creating syntax tree in java

Language: Java - Size: 1.44 MB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 30 - Forks: 15

ULL-ESIT-GRADOII-PL/esprima-pegjs-jsconfeu-talk Fork of pdubroy/jsconfeu-talk

Source code from talks by Patrick Dubois, Yonatan Mevorach and others about Compilers

Language: CoffeeScript - Size: 4.63 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

LIU42/LexicalAnalyzer

《编译原理》课程设计，基于有穷自动机的类 C 语言词法分析器

Language: Python - Size: 14.6 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

missipsag/LEX-ical-Analyzer

This project implements a lexical analyzer using Lex to tokenize and analyze the structure of a given input file. It efficiently identifies tokens such as keywords, identifiers, operators, and literals, serving as the foundational component of a compiler or interpreter.

Language: C - Size: 41 KB - Last synced at: 26 days ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0

Jayanth-MKV/tinyc-compiler-from-scratch

This intermediate code, also known as intermediate representation (IR), is then passed on to the next phase of the compiler, which is typically code optimization and code generation.

Language: C - Size: 306 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

vporton/shlex-dlang

Simple shell-like lexical analysis library

Language: D - Size: 61.5 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 3

takamin/lex-bnf

General-purpose recursive descent parser and evaluator

Language: JavaScript - Size: 1.45 MB - Last synced at: 4 days ago - Pushed at: 8 months ago - Stars: 9 - Forks: 4

quil-lang/alexa

A Lexical Analyzer Generator

Language: Common Lisp - Size: 35.2 KB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 61 - Forks: 6

fadel-hasan/python-compiler

simple python compiler by using flex\bison

Language: C++ - Size: 34.2 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

FelipeTomazEC/Lexical-Analyzer

A basic Lexical-Analyzer written in Java.

Language: Java - Size: 204 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 29 - Forks: 11

rangoo94/universal-lexer

Parse any text input to tokens, according to provided regular expressions.

Language: JavaScript - Size: 384 KB - Last synced at: about 1 month ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 2

CaioAndersonMM/CompiladorPlyLex

Este repositório contém implementações de analisadores léxicos (lexer), analisadores sintáticos e outras etapas essenciais para o desenvolvimento de compiladores, utilizando técnicas como análise de linguagem formal, expressões regulares, gramáticas livres de contexto, e tabelas de símbolos. Fundamentado na disciplina de Compiladores (UFERSA).

Language: Python - Size: 156 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

howl-anderson/MicroCompiler

一个微型的 LL/LR/LALR 语法解析器 | A micro compiler project to provide LL/LR/LALR syntax parser

Language: Python - Size: 1010 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 17 - Forks: 2

Naveen-369/CompilerDesign_Questions

Compiler Design Question

Language: C - Size: 11.7 KB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

izuzanak/yapgen

Rapid prototyping parser generator

Language: C++ - Size: 291 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 17 - Forks: 2

ignaciopieroni/compiler-lexical_analysis-parsing

The objective of this project is to build a table-driven predictive top-down parser, along with a lexicographic analyzer (lexer), implemented in the Python programming language, to recognize the PL-0 programming language (a language designed to understand the fundamentals of compilers and language theory).

Language: Python - Size: 78.1 KB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

Amirreza81/Compiler-Theoretical-Solution

Compiler Design - Fall 2023 - Sharif University of Technology

Size: 23.3 MB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

khaouitiabdelhakim/Pascal-Compiler

This repository contains a minimalistic Pascal compiler implemented in C, covering lexical and syntax analysis. It serves as a learning resource for understanding the fundamental aspects of compiler design. The code is intentionally kept concise to provide a clear insight into the key stages of lexical and syntax analysis in a compiler.

Language: C - Size: 133 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 1

missipsag/LexiC-analyser

This project is a Lexical Analyzer (Scanner) implemented in C, designed to tokenize a simple programming language. It processes an input string (source code) and identifies valid tokens such as keywords, identifiers, numbers, operators, and punctuation marks. The analyzer is based on a Deterministic Finite Automaton (DFA).

Language: C - Size: 91.8 KB - Last synced at: 26 days ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0

Raihan4520/Compiler-Design

C and C++ projects from the Compiler Design course at AIUB, covering lexical analysis, syntax analysis, and code generation phases.

Language: C++ - Size: 22.4 MB - Last synced at: 2 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

Muhammad-Yaqoob-4110/CS-471-Compiler-Construction-C

This repository contains the final project for the CS-471L Compiler Construction course at the University of Engineering and Technology (UET), Lahore. Supervised by Mr. Laeeq Khan Niazai, it focuses on Lexical Analysis, Syntax Analysis, Semantic Analysis, Intermediate Code Generation (Three-Address Code), and x86 Assembly Code Generation.

Language: C++ - Size: 18.6 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0