NONUNIQUE
protected static final String NONUNIQUE
Special value used to mark duplicate in treeVariableMap
astVarNumber
(package private) int astVarNumber
caseSizeThreshold
public static final int caseSizeThreshold
- 127
commonExtraArgs
(package private) String commonExtraArgs
commonExtraParams
(package private) String commonExtraParams
commonLocalVars
(package private) String commonLocalVars
currentASTResult
(package private) String currentASTResult
Tracks the rule or labeled subrule being generated. Used for
AST generation.
currentRule
(package private) RuleBlock currentRule
Tracks the rule being generated. Used for mapTreeId
declaredASTVariables
(package private) Hashtable declaredASTVariables
Used to keep track of which AST variables have been defined in a rule
(except for the #rule_name and #rule_name_in var's
exceptionThrown
(package private) String exceptionThrown
genAST
protected boolean genAST
initHeaderAction
public static final String initHeaderAction
labeledElementASTType
(package private) String labeledElementASTType
labeledElementInit
(package private) String labeledElementInit
labeledElementType
(package private) String labeledElementType
lexerClassName
(package private) String lexerClassName
lt1Value
(package private) String lt1Value
mainHeaderAction
public static final String mainHeaderAction
parserClassName
(package private) String parserClassName
saveText
protected boolean saveText
syntacticPredLevel
protected int syntacticPredLevel
throwNoViable
(package private) String throwNoViable
treeVariableMap
(package private) Hashtable treeVariableMap
Mapping between the ids used in the current alt, and the
names of variables used to represent their AST values.
treeWalkerClassName
(package private) String treeWalkerClassName
_printAction
protected void _printAction(String s)
Print an action without leading tabs, attempting to
preserve the current indentation level for multi-line actions
Ignored if string is null.
- _printAction in interface CodeGenerator
s
- The action string to output
_printJavadoc
protected void _printJavadoc(String s)
addSemPred
protected int addSemPred(String predicate)
Adds a semantic predicate string to the sem pred vector
These strings will be used to build an array of sem pred names
when building a debugging parser. This method should only be
called when the debug option is specified
checkCurrentOutputStream
protected void checkCurrentOutputStream()
exitIfError
public void exitIfError()
extractIdOfAction
protected String extractIdOfAction(String s,
int line,
int column)
Get the identifier portion of an argument-action.
For Python the ID of an action is assumed to be everything before
the assignment, as Python does not support a type.
- extractIdOfAction in interface CodeGenerator
s
- The action textline
- Line used for error reporting.column
- Line used for error reporting.
- A string containing the text of the identifier
extractTypeOfAction
protected String extractTypeOfAction(String s,
int line,
int column)
Get the type portion of an argument-action.
Python does not have a type declaration before an identifier, so we
just return the empty string.
- extractTypeOfAction in interface CodeGenerator
s
- The action textline
- Line used for error reporting.
- A string containing the text of the type
flushTokens
protected void flushTokens()
gen
public void gen()
Generate the parser, lexer, treeparser, and token types in Java
- gen in interface CodeGenerator
gen
public void gen(AlternativeBlock blk)
Generate code for the given grammar element.
- gen in interface CodeGenerator
blk
- The "x|y|z|..." block to generate
gen
public void gen(OneOrMoreBlock blk)
Generate code for the given grammar element.
- gen in interface CodeGenerator
blk
- The (...)+ block to generate
gen
public void gen(WildcardElement wc)
Generate code for the given grammar element.
- gen in interface CodeGenerator
wc
- The wildcard element to generate
gen
public void gen(ZeroOrMoreBlock blk)
Generate code for the given grammar element.
- gen in interface CodeGenerator
blk
- The (...)* block to generate
genASTDeclaration
protected void genASTDeclaration(AlternativeElement el,
String node_type)
genASTDeclaration
protected void genASTDeclaration(AlternativeElement el,
String var_name,
String node_type)
genAlt
protected void genAlt(Alternative alt,
AlternativeBlock blk)
Generate an alternative.
alt
- The alternative to generateblk
- The block to which the alternative belongs
genBitsets
protected void genBitsets(Vector bitsetList,
int maxVocabulary)
Generate all the bitsets to be used in the parser or lexer
Generate the raw bitset data like "long _tokenSet1_data[] = {...}"
and the BitSet object declarations like "BitSet _tokenSet1 = new BitSet(_tokenSet1_data)"
Note that most languages do not support object initialization inside a
class definition, so other code-generators may have to separate the
bitset declarations from the initializations (e.g., put the initializations
in the generated constructor instead).
bitsetList
- The list of bitsets to generate.maxVocabulary
- Ensure that each generated bitset can contain at least this value.
genBlockInitAction
protected void genBlockInitAction(AlternativeBlock blk)
Generate the init action for a block, which may be a RuleBlock or a
plain AlternativeBLock.
genBlockPreamble
protected void genBlockPreamble(AlternativeBlock blk)
Generate the header for a block, which may be a RuleBlock or a
plain AlternativeBLock. This generates any variable declarations
and syntactic-predicate-testing variables.
genCases
protected void genCases(BitSet p)
Generate a series of case statements that implement a BitSet test.
p
- The Bitset for which cases are to be generated
genCommonBlock
public PythonBlockFinishingInfo genCommonBlock(AlternativeBlock blk,
boolean noTestForSingle)
Generate common code for a block of alternatives; return a
postscript that needs to be generated at the end of the
block. Other routines may append else-clauses and such for
error checking before the postfix is generated. If the
grammar is a lexer, then generate alternatives in an order
where alternatives requiring deeper lookahead are generated
first, and EOF in the lookahead set reduces the depth of
the lookahead. @param blk The block to generate @param
noTestForSingle If true, then it does not generate a test
for a single alternative.
genHeader
protected void genHeader()
Generate a header that is common to all Python files
genHeaderInit
protected void genHeaderInit(Grammar grammar)
genHeaderMain
protected void genHeaderMain(Grammar grammar)
genJavadocComment
protected void genJavadocComment(Grammar g)
genJavadocComment
protected void genJavadocComment(RuleSymbol g)
genLexerTest
protected void genLexerTest()
Generate an automated test for Python CharScanner (sub)classes.
genMatch
protected void genMatch(BitSet b)
genMatchUsingAtomText
protected void genMatchUsingAtomText(GrammarAtom atom)
genMatchUsingAtomTokenType
protected void genMatchUsingAtomTokenType(GrammarAtom atom)
genNextToken
public void genNextToken()
Generate the nextToken() rule. nextToken() is a synthetic
lexer rule that is the implicit OR of all user-defined
lexer rules.
genRule
public void genRule(RuleSymbol s,
boolean startSymbol,
int ruleNum)
Gen a named rule block.
ASTs are generated for each element of an alternative unless
the rule or the alternative have a '!' modifier.
If an alternative defeats the default tree construction, it
must set _AST to the root of the returned AST.
Each alternative that does automatic tree construction, builds
up root and child list pointers in an ASTPair structure.
A rule finishes by setting the returnAST variable from the
ASTPair.
startSymbol
- true if the rule is a start symbol (i.e., not referenced elsewhere)
genSemPred
protected void genSemPred(String pred,
int line)
genSemPredMap
protected void genSemPredMap()
Write an array of Strings which are the semantic predicate
expressions. The debugger will reference them by number only
genSynPred
protected void genSynPred(SynPredBlock blk,
String lookaheadExpr)
genTokenASTNodeMap
protected void genTokenASTNodeMap()
Create and set Integer token type objects that map
to Java Class objects (which AST node to create).
genTokenStrings
public void genTokenStrings()
Generate a static array containing the names of the tokens,
indexed by the token type values. This static array is used
to format error messages so that the token identifers or literal
strings are displayed instead of the token numbers.
If a lexical rule has a paraphrase, use it rather than the
token label.
genTokenTypes
protected void genTokenTypes(TokenManager tm)
throws IOException
Generate the token types Java file
getASTCreateString
public String getASTCreateString(String astCtorArgs)
Get a string for an expression to generate creating of an AST node.
Parse the first (possibly only) argument looking for the token type.
If the token type is a valid token symbol, ask for it's AST node type
and add to the end if only 2 arguments. The forms are #[T], #[T,"t"],
and as of 2.7.2 #[T,"t",ASTclassname].
getASTCreateString
public String getASTCreateString(GrammarAtom atom,
String astCtorArgs)
Get a string for an expression to generate creating of an AST node
- getASTCreateString in interface CodeGenerator
atom
- The grammar node for which you are creating the node
getASTCreateString
public String getASTCreateString(Vector v)
Get a string for an expression to generate creation of an AST subtree.
- getASTCreateString in interface CodeGenerator
v
- A Vector of String, where each element is an expression in the target language yielding an AST node.
getLookaheadTestExpression
protected String getLookaheadTestExpression(Alternative alt,
int maxDepth)
Generate a lookahead test expression for an alternate. This
will be a series of tests joined by '&&' and enclosed by '()',
the number of such tests being determined by the depth of the lookahead.
getLookaheadTestExpression
protected String getLookaheadTestExpression(Lookahead look,
int k)
getLookaheadTestTerm
protected String getLookaheadTestTerm(int k,
BitSet p)
Generate a depth==1 lookahead test expression given the BitSet.
This may be one of:
1) a series of 'x==X||' tests
2) a range test using >= && <= where possible,
3) a bitset membership test for complex comparisons
k
- The lookahead levelp
- The lookahead set for level k
getRangeExpression
public String getRangeExpression(int k,
int[] elems)
Return an expression for testing a contiguous renage of elements
k
- The lookahead levelelems
- The elements representing the set, usually from BitSet.toArray().
- String containing test expression.
isEmpty
(package private) static boolean isEmpty(String s)
isspace
protected boolean isspace(char c)
lookaheadIsEmpty
protected boolean lookaheadIsEmpty(Alternative alt,
int maxDepth)
Is the lookahead for this alt empty?
mapTreeId
public String mapTreeId(String idParam,
ActionTransInfo transInfo)
Map an identifier to it's corresponding tree-node variable.
This is context-sensitive, depending on the rule and alternative
being generated
- mapTreeId in interface CodeGenerator
idParam
- The identifier name to map
- The mapped id (which may be the same as the input), or null if
the mapping is invalid due to duplicates
od
protected void od(String s,
int i,
int end,
String msg)
printAction
protected void printAction(String s)
Print an action with leading tabs, attempting to
preserve the current indentation level for multi-line actions
Ignored if string is null.
- printAction in interface CodeGenerator
s
- The action string to output
printActionCode
protected void printActionCode(String actionStr,
int line)
printGrammarAction
protected void printGrammarAction(Grammar grammar)
printMainFunc
protected void printMainFunc(String s)
printTabs
protected void printTabs()
Create a Java code-generator using the given Grammar.
The caller must still call setTool, setBehavior, and setAnalyzer
before generating code.
- printTabs in interface CodeGenerator
processActionCode
protected String processActionCode(String actionStr,
int line)
processActionForSpecialSymbols
protected String processActionForSpecialSymbols(String actionStr,
int line,
RuleBlock currentRule,
ActionTransInfo tInfo)
Lexically process $var and tree-specifiers in the action.
This will replace #id and #(...) with the appropriate
function calls and/or variables etc...
- processActionForSpecialSymbols in interface CodeGenerator
setupOutput
public void setupOutput(String className)
throws IOException
This method exists so a subclass, namely VAJCodeGenerator,
can open the file in its own evil way. JavaCodeGenerator
simply opens a text file...
toString
(package private) String toString(boolean v)