All Packages  Class Hierarchy  This Package  Previous  Next  Index

Class xe.xe_TokenizerAuto

java.lang.Object
   |
   +----xe.xe_Tokenizer
           |
           +----xe.xe_TokenizerAuto

public class xe_TokenizerAuto
extends xe_Tokenizer

An xe_Tokenizer Perform which uses an approach to parsing the next token different to xe_Tokenizer. This approach uses the definition of each keyword in xe_TokenType to identify when the token has been parsed.

Auto-parsing in this way has turned out to be very slow - which is why this functionality has been relegated to a separate class. However, it can be reinstated simply by instantiating this class instead of xe_Tokenizer for low-level parsing.


Constructor Index

 o xe_TokenizerAuto()
Default constructor.

Method Index

 o parseNextToken(boolean)
Parse the next token.

Constructors

 o xe_TokenizerAuto
 public xe_TokenizerAuto()
Default constructor.

Methods

 o parseNextToken
 public xe_Token parseNextToken(boolean InputConsumeWhitespaceFlag) throws xm_ParseException, IOException
Parse the next token. Overrides ParseNextToken() from xe_Tokenizer.

Parameters:
InputConsumeWhitespaceFlag - If true, all preceding whitespace is separated; otherwise, it is treated as part of the token itself
Returns:
Token representing the value parsed
Throws: xm_ParseException
Something was parsed which didn't fit the parse rules
Throws: IOException
Error reading from source reader
Overrides:
parseNextToken in class xe_Tokenizer

All Packages  Class Hierarchy  This Package  Previous  Next  Index