Module Surface.Lexer_commonSource

Auxiliary functions used by all lexers.

Sourcetype lexing_context =
  1. | Law
  2. | Code
  3. | Directive
  4. | Directive_args

Reference, used by the lexer as the mutable state to distinguish whether it is lexing code or law.

Sourceval code_buffer : Buffer.t

Buffer that accumulates the string representation of the body of code being lexed. This string representation is used in the literate programming backends to faithfully capture the spacing pattern of the original program

Sourceval update_acc : Sedlexing.lexbuf -> unit

Updates code_buffer with the current lexeme

Sourceval raise_lexer_error : Catala_utils.Pos.t -> string -> 'a

Error-generating helper

Sourceval token_list_language_agnostic : (string * Tokens.token) list

Associative list matching each punctuation string part of the Catala syntax with its Surface.Parser token. Same for all the input languages (English, French, etc.)

Sourceval calc_precedence : string -> int

Calculates the precedence according a matched regex of the form : '#+'

Sourceval get_law_heading : Sedlexing.lexbuf -> Tokens.token

Gets the LAW_HEADING token from the current lexbuf

Sourcetype line_token =
  1. | LINE_TEST of string
  2. | LINE_INLINE_TEST
  3. | LINE_BLOCK_END
  4. | LINE_INCLUDE of string
  5. | LINE_MODULE_DEF of string * bool
  6. | LINE_MODULE_USE of string
  7. | LINE_ANY

Simplified tokens for dependency extraction

Sourcemodule type LocalisedLexer = sig ... end