GitHub / SreecharanV / Tokenization-and-Categorization-using-OCaml-A-Lexical-Analysis-Approach

An OCaml-based lexical analyzer that identifies and classifies tokens such as identifiers, operators, punctuation symbols, integer literals, and keywords. The project involves tokenizing input text, categorizing tokens, and printing them with their respective categories. Key functions include tokenize, is_alnum, is_punctuation, and print_tokens.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SreecharanV%2FTokenization-and-Categorization-using-OCaml-A-Lexical-Analysis-Approach

Topics: lexical-analysis, lexical-analyzer, ocaml, ocaml-program, tokenization

• Files
• Readme
• Dependencies