final class Token
extends Object
Internal token representation.
It is used as contract between the lexer and the parser.
-
Nested Class Summary
Nested Classes
(package private) static enum
-
Field Summary
Fields
private static final int
length of the initial token (content-)buffer
(package private) boolean
(package private) boolean
Token ready flag: indicates a valid token with content (ready for the parser).
-
Constructor Summary
Constructors
-
Method Summary
-
Field Details
-
INITIAL_TOKEN_LENGTH
private static final int INITIAL_TOKEN_LENGTH
length of the initial token (content-)buffer
- See Also:
-
-
-
content
The content buffer.
-
isReady
boolean isReady
Token ready flag: indicates a valid token with content (ready for the parser).
-
isQuoted
boolean isQuoted
-
-
Method Details
-
-
toString
Eases IDE debugging.
- Overrides:
toString
in class Object
- Returns:
- a string helpful for debugging.