Module CLexerSource

Sourcetype starts_quotation =
  1. | NoQuotation
  2. | Quotation

When one registers a keyword she can declare it starts a quotation. In particular using QUOTATION("name:") in a grammar rule declares "name:" as a keyword and the token QUOTATION is matched whenever the keyword is followed by an identifier or a parenthesized text. Eg

constr:x string:.... ltac:(....) ltac:....

The delimiter is made of 1 or more occurrences of the same parenthesis, eg ((.....)) or [[[....]]]. The idea being that if the text happens to contain the closing delimiter, one can make the delimiter longer and avoid confusion (no escaping). Eg

string:[ .. ']' .. ]

Nesting the delimiter is allowed, eg ((..((...))..)) is OK.

Keywords don't need to end in ':'

Sourceval add_keyword : ?quotation:starts_quotation -> string -> unit

This should be functional but it is not due to the interface

Sourceval remove_keyword : string -> unit
Sourceval is_keyword : string -> bool
Sourceval keywords : unit -> CString.Set.t
Sourcetype keyword_state
Sourceval set_keyword_state : keyword_state -> unit
Sourceval get_keyword_state : unit -> keyword_state
Sourceval check_ident : string -> unit
Sourceval is_ident : string -> bool
Sourceval check_keyword : string -> unit
Sourceval terminal : string -> string Tok.p

When string is not an ident, returns a keyword.

Sourceval terminal_number : string -> NumTok.Unsigned.t Tok.p

Precondition: the input is a number (c.f. NumTok.t)

The lexer of Coq:

Sourcemodule Lexer : Gramlib.Plexing.S with type te = Tok.t and type 'c pattern = 'c Tok.p
Sourcemodule Error : sig ... end

Create a lexer. true enables alternate handling for computing diffs. It ensures that, ignoring white space, the concatenated tokens equal the input string. Specifically:

Sourcemodule LexerDiff : Gramlib.Plexing.S with type te = Tok.t and type 'c pattern = 'c Tok.p