EOF_CHAR
public static final char EOF_CHAR
- '\uffff'
NO_CHAR
(package private) static final char NO_CHAR
- '\u0000'
_returnToken
protected Token _returnToken
caseSensitive
protected boolean caseSensitive
caseSensitiveLiterals
protected boolean caseSensitiveLiterals
commitToPath
protected boolean commitToPath
Used during filter mode to indicate that path is desired.
A subsequent scan error will report an error as usual if
acceptPath=true;
literals
protected Hashtable literals
saveConsumedInput
protected boolean saveConsumedInput
tabsize
protected int tabsize
Tab chars are handled by tab() according to this value; override
method to do anything weird with tabs.
tokenObjectClass
protected Class tokenObjectClass
traceDepth
protected int traceDepth
Used to keep track of indentdepth for traceIn/Out
append
public void append(String s)
append
public void append(char c)
commit
public void commit()
consumeUntil
public void consumeUntil(int c)
throws CharStreamException
Consume chars until one matches the given char
getCaseSensitive
public boolean getCaseSensitive()
getCaseSensitiveLiterals
public final boolean getCaseSensitiveLiterals()
getColumn
public int getColumn()
getCommitToPath
public boolean getCommitToPath()
getFilename
public String getFilename()
getLine
public int getLine()
getTabSize
public int getTabSize()
getText
public String getText()
return a copy of the current text buffer
getTokenObject
public Token getTokenObject()
makeToken
protected Token makeToken(int t)
newline
public void newline()
panic
public void panic(String s)
This method is executed by ANTLR internally when it detected an illegal
state that cannot be recovered from.
The default implementation of this method calls
java.lang.System.exit(int)
and writes directly to
java.lang.System.err)
, which is usually not appropriate when
a translator is embedded into a larger application. It is highly
recommended that this method be overridden to handle the error in a
way appropriate for your application (e.g. throw an unchecked
exception).
reportError
public void reportError(String s)
Parser error-reporting function can be overridden in subclass
reportError
public void reportError(RecognitionException ex)
Parser error-reporting function can be overridden in subclass
reportWarning
public void reportWarning(String s)
Parser warning-reporting function can be overridden in subclass
resetText
public void resetText()
rewind
public void rewind(int pos)
setCaseSensitive
public void setCaseSensitive(boolean t)
setColumn
public void setColumn(int c)
setCommitToPath
public void setCommitToPath(boolean commit)
setFilename
public void setFilename(String f)
setLine
public void setLine(int line)
setTabSize
public void setTabSize(int size)
setText
public void setText(String s)
setTokenObjectClass
public void setTokenObjectClass(String cl)
tab
public void tab()
advance the current column number by an appropriate amount
according to tab size. This method is called from consume().
testLiteralsTable
public int testLiteralsTable(String text,
int ttype)
Test the text passed in against the literals table
Override this method to perform a different literals test
This is used primarily when you want to test a portion of
a token.
testLiteralsTable
public int testLiteralsTable(int ttype)
toLower
public char toLower(char c)
traceIndent
public void traceIndent()
uponEOF
public void uponEOF()
throws TokenStreamException,
CharStreamException
This method is called by YourLexer.nextToken() when the lexer has
hit EOF condition. EOF is NOT a character.
This method is not called if EOF is reached during
syntactic predicate evaluation or during evaluation
of normal lexical rules, which presumably would be
an IOException. This traps the "normal" EOF condition.
uponEOF() is called after the complete evaluation of
the previous token and only if your parser asks
for another token beyond that last non-EOF token.
You might want to throw token or char stream exceptions
like: "Heh, premature eof" or a retry stream exception
("I found the end of this file, go back to referencing file").