Token

open class Token

A token of the SAPERE math-expression grammar, as produced by ExpTokenManager. Tokens form a singly linked stream through next.

Constructors

constructor()

Builds a token with kind 0 and no image.

constructor(kind: Int)

Builds a token of the given kind with no image.

constructor(kind: Int, image: String)

Builds a token of the given kind and image.

The column number of the first character of this Token.

The line number of the first character of this Token.

The column number of the last character of this Token.

open var endLine: Int

The line number of the last character of this Token.

The string image of the token.

open var kind: Int

The kind of this token, as one of the token identifiers declared in ExpConstants.

open var next: Token

The next regular token of the input stream, or null if this is the last token or the token manager has not read beyond it yet.

The last special token between the preceding regular token and this one, or null if there is none.

open fun getValue(): Any

An optional semantic value attached to this token, distinct from its image.

open fun newToken(ofKind: Int): Token

Factory for tokens without an image.

open fun newToken(ofKind: Int, image: String): Token

Factory used by ExpTokenManager to create tokens.