Data type ParseToken
access this type via: parsing.Tokeniser (uses)
Data type representing a parsed entity.
Constants
int TYPE_PARTICLE Possible value for 'type', indicating that this is a something other than a syntax token, literal, or comment.
int TYPE_LITERAL_STRING Possible value for 'type', indicating that this is string literal.
int TYPE_LITERAL_NUMBER Possible value for 'type', indicating that this is a literal number.
int TYPE_LINE_COMMENT Possible value for 'type', indicating that this is a line comment.
int TYPE_BLOCK_COMMENT Possible value for 'type', indicating that this is a block comment.
int TYPE_TOKEN Possible value for 'type', indicating that this is a syntax token.
Fields
int type The type of this parsed entity, such as token or string literal.
char content[] The contents of this parsed entity (i.e., the syntax token, or the comment).
int sourceStart The position at which this parsed entity starts, as an index into the original unparsed text.
int sourceLength The length of the original unparsed text from which this parsed entity was derived.