tokenizer
A grammar describes the syntax of a programming language, and might be defined in Backus-Naur form (BNF). A lexer performs lexical analysis, turning text into tokens. A parser takes tokens and builds a data structure like an abstract syntax tree (AST). The parser is concerned with context: does the sequence of tokens fit the grammar? A compiler is a combined lexer and parser, built for a specific grammar.
Here are 46 public repositories matching this topic...
A POSIX regex utilities library for C
-
Updated
Aug 3, 2022 - C
A JIT compiler for a custom low-level assembly-like programming language.
-
Updated
Oct 10, 2021 - C
X86-64 bilateral instruction tokenizer implemented in C. Supports the following processor extensions: AES, AVX, AVX2, AVX512, FMA, MMX, SSE, SSE2, SSE3, SSE4, x87(FPU), VMX. In order to ease testing, a diassembler which transforms tokens into compilable assembly (for NASM compiler) has been implemented.
-
Updated
Oct 2, 2022 - C
This repository contains all the lab assignments done in the CSE420 course of BracU.
-
Updated
May 14, 2024 - C
A programming language made in pure C
-
Updated
Oct 23, 2020 - C
A set of libraries that allow you to manipulate files, linked lists, sorting algorithms and much more.
-
Updated
Mar 10, 2021 - C
This is a simple lexical analyzer for the programming language PL/0. The program reads in a source program written in PL/0, identifies tokens, and produces an output that includes the source program, the source program lexeme table, and the token list.
-
Updated
Mar 4, 2024 - C
Implementation of an Deterministic Finite Automaton (DFA) in C to tokenize expressions for a simple Calculator (Lexical Analyser).
-
Updated
Feb 13, 2020 - C
CS214 Rutgers Systems Programming Assignment 2: Using C's file system API to produce an inverted index based on how many times words occur in files
-
Updated
Jul 2, 2017 - C
My first attemp to write a sqlite3 clone. It's just an experimental attempt to understand RDBMS. Never use it in any production.
-
Updated
May 6, 2019 - C
The objective of this project is to create a simple shell. Yes, my own little shell. I've learned a lot about processes and file descriptors in this project.
-
Updated
Mar 15, 2023 - C
- Followers
- 10.2k followers
- Wikipedia
- Wikipedia