All Packages Class Hierarchy This Package Previous Next Index
java.lang.Object | +----xe.xe_Tokenizer | +----xe.xe_TokenizerAuto
An xe_Tokenizer Perform which uses an approach to parsing the next token different to xe_Tokenizer. This approach uses the definition of each keyword in xe_TokenType to identify when the token has been parsed.
Auto-parsing in this way has turned out to be very slow - which is why this functionality has been relegated to a separate class. However, it can be reinstated simply by instantiating this class instead of xe_Tokenizer for low-level parsing.
public xe_TokenizerAuto()
public xe_Token parseNextToken(boolean InputConsumeWhitespaceFlag) throws xm_ParseException, IOException
All Packages Class Hierarchy This Package Previous Next Index