1.md

summary

front end

compile

      tokenizer / lexer                     parser                                     compile                                           optimize
file -------------------> token stream --------------> abstract syntax tree (AST) ----------------> intermediate representation (IR) ----------------> intermediate representation (IR) 

backend

compile

                                |-------------> Platform1
intermedia representation (IR) -|-------------> Platform2
                                |-------------> Platform3

run / interprete

intermedia representation (IR) <----> virtual machine (VM)

grammar

• context-free grammar / CFG
  • Context-free grammar
  • Backus–Naur form / BNF
    • Backus–Naur form
• parsing expression grammar / PEG
  • PEG wiki
  • PEG Basics

parser

• Bottom-up parsing
  • LR parser
    • Operator-precedence parser
      • Shunting-yard algorithm
• Top-down parsing
  • LL parser
• LL parser vs LR parser
  • What is the difference between LL and LR parsing?
• lex / flex: lexer
• yacc / bison: bnf + lr parser
• antlr: bnf + ll parser
  • antlr/antlr4
• pegen: peg + lr parser
  • The origins of pgen
  • gvanrossum/pegen

intermedia representation

• llvm

virtual machine

• stack
• process / thread / coroutine
• object model
• extension