For a list of all members of this type, see Token members.
Name | Description | |
---|---|---|
IsPartial | Gets the value indicating whether the Token is a portion of a multi-line token on one line. | |
Language | Returns the Language that was used to produce this token (read-only). | |
Length | Returns the length of the string which this token represents. | |
OverallOffset | Returns the overall character offset from the beginning of the document to the start of this token (read-only). | |
Span | Retirnms the span of the token within the document (read-only). | |
TerminalSymbol | Returns the TerminalSymbol which produced this token. | |
Text | Returns the text which this token represents. |