Token

Describes the input token stream.

Constructors

open fun Token()

No-argument constructor

open fun Token(kind: Int)

Constructs a new token for the specified Image.

open fun Token(kind: Int, image: String)

Constructs a new token for the specified Image and Kind.

open fun getValue(): Any

An optional attribute value of the Token.

open fun newToken(ofKind: Int): Token

open fun newToken(ofKind: Int, image: String): Token

Returns a new Token object, by default.

Returns the image.

The column number of the first character of this Token.

The line number of the first character of this Token.

The column number of the last character of this Token.

open val endLine: Int

The line number of the last character of this Token.

The string image of the token.

open val kind: Int

An integer that describes the kind of this token.

open val next: Token

A reference to the next regular (non-special) token from the input stream.

This field is used to access special tokens that occur prior to this token, but after the immediately preceding regular (non-special) token.