Token

Describes the input token stream.

Constructors

constructor()

No-argument constructor

constructor(kind: Int)

Constructs a new token for the specified Image.

constructor(kind: Int, image: String)

Constructs a new token for the specified Image and Kind.

The column number of the first character of this Token.

The line number of the first character of this Token.

The column number of the last character of this Token.

open var endLine: Int

The line number of the last character of this Token.

The string image of the token.

open var kind: Int

An integer that describes the kind of this token.

open var next: Token

A reference to the next regular (non-special) token from the input stream.

This field is used to access special tokens that occur prior to this token, but after the immediately preceding regular (non-special) token.

open fun getValue(): Any

An optional attribute value of the Token.

open fun newToken(ofKind: Int): Token

open fun newToken(ofKind: Int, image: String): Token

Returns a new Token object, by default.

Returns the image.