Module Surface.Lexer_enSource

include Lexer_common.LocalisedLexer
Sourceval token_list : (string * Tokens.token) list

Same as token_list_language_agnostic, but with tokens whose string varies with the input language.

Sourceval lex_builtin : string -> Ast.builtin_expression option

Simple lexer for builtins

Main lexing function used in a code block

Main lexing function used outside code blocks

Entry point of the lexer, distributes to lex_code or lex_law depending of is_code.