The following tables list the members exposed by Token.
Name | Description | |
---|---|---|
![]() | IsPartial | Gets the value indicating whether the Token is a portion of a multi-line token on one line. |
![]() | Language | Returns the Language that was used to produce this token (read-only). |
![]() | Length | Returns the length of the string which this token represents. |
![]() | OverallOffset | Returns the overall character offset from the beginning of the document to the start of this token (read-only). |
![]() | Span | Retirnms the span of the token within the document (read-only). |
![]() | TerminalSymbol | Returns the TerminalSymbol which produced this token. |
![]() | Text | Returns the text which this token represents. |
Name | Description | |
---|---|---|
![]() | Equals | Overloaded. Compares the specified object to this object to see if they are equivalent. |
![]() | GetFullToken | If the Token has its IsPartial value set to True, gets the full multiline token. Otherwise, returns the Token. |
![]() | GetHashCode | Returns the hash code of the object. |
![]() | ToString | Returns the string representation of this object. |
![]() | Compares the values of two Token structures for equality |
![]() | Compares the values of two Token structures for inequality |