For a list of all members of this type, see Token members.
Name | Description | |
---|---|---|
![]() | IsPartial | Gets the value indicating whether the Token is a portion of a multi-line token on one line. |
![]() | Language | Returns the Language that was used to produce this token (read-only). |
![]() | Length | Returns the length of the string which this token represents. |
![]() | OverallOffset | Returns the overall character offset from the beginning of the document to the start of this token (read-only). |
![]() | Span | Retirnms the span of the token within the document (read-only). |
![]() | TerminalSymbol | Returns the TerminalSymbol which produced this token. |
![]() | Text | Returns the text which this token represents. |