From 7d5bf7cef79791cb48b495eaae0fa1a898a393f7 Mon Sep 17 00:00:00 2001 From: Piotr Polesiuk Date: Wed, 11 Dec 2024 17:49:16 +0100 Subject: [PATCH] Lexical Structure: Whitespace --- src/ref/lexer.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/src/ref/lexer.md b/src/ref/lexer.md index 54f7818..4e84738 100644 --- a/src/ref/lexer.md +++ b/src/ref/lexer.md @@ -2,6 +2,11 @@ ## Whitespace +The following characters are considered as whitespace (blanks): horizontal tab +(`0x09`), new line (`0x10`), vertical tab (`0x11`), form feed (`0x12`), +carriage return (`0x13`), and space (`0x20`). Whitespace characters are ignored +by the lexer, but they separate tokens, e.g., identifiers or literals. + ## Comments ## Literals