Skip to content
#

lexical-analysis

A grammar describes the syntax of a programming language, and might be defined in Backus-Naur form (BNF). A lexer performs lexical analysis, turning text into tokens. A parser takes tokens and builds a data structure like an abstract syntax tree (AST). The parser is concerned with context: does the sequence of tokens fit the grammar? A compiler is a combined lexer and parser, built for a specific grammar.

Here are 80 public repositories matching this topic...

Pipographe v2.0.0 est une application web reposant sur une base de données relationnelle stockant des titres de thèses vraies... ou fausses ! Générées par Machine Learning ou mash-up de donnée, l'application - outre son caractère humoristique - vise à évaluer les deux méthodes en proposant un jeu "vrai ou faux" à l'utilisateur·ice.

  • Updated Sep 27, 2021
  • Python

This repository hosts two Python tools for the Pascal programming language: a lexical analyzer and a formatter. The lexical analyzer reads Pascal source code, identifies tokens, and reports lexical errors, while the formatter indents and cleans the source code to improve readability and structure.

  • Updated May 4, 2024
  • Python