tokenizer
A grammar describes the syntax of a programming language, and might be defined in Backus-Naur form (BNF). A lexer performs lexical analysis, turning text into tokens. A parser takes tokens and builds a data structure like an abstract syntax tree (AST). The parser is concerned with context: does the sequence of tokens fit the grammar? A compiler is a combined lexer and parser, built for a specific grammar.
Here are 50 public repositories matching this topic...
A mathematical expression parser, optimised for quickly-written expressions
-
Updated
May 26, 2024 - C#
A Unity package to run pretrained transformer models with Unity Sentis
-
Updated
Apr 10, 2024 - C#
A command-line calculator
-
Updated
Mar 20, 2024 - C#
A C# Lua, GLua and Luau parser, code analysis, transformation and generation library.
-
Updated
Mar 18, 2024 - C#
.NET text parsing helper class.
-
Updated
Mar 17, 2024 - C#
A toolkit that helps you to write your own parser.
-
Updated
Mar 17, 2024 - C#
Empowering you to create your own parser.
-
Updated
Sep 28, 2023 - C#
HTML.NET is an HTML Parser.
-
Updated
Aug 25, 2023 - C#
.NET 7 SDK for OpenAI with a Blazor Server playground
-
Updated
May 17, 2023 - C#
A collection of tools for working with OpenAI
-
Updated
May 4, 2023 - C#
- Followers
- 10.2k followers
- Wikipedia
- Wikipedia