We're sorry but this site requires JavaScript.

Version

Is this content useful?

Thank you for your feedback!

Thank you for your feedback! You have rated this topic in the last 30 days.

Tokenizer Class Members

The following tables list the members exposed by Tokenizer.

Public Constructors

	Name	Description
	Tokenizer Constructor	Overloaded.

Public Properties

	Name	Description
	UseTokenList

Public Methods

	Name	Description
	AddPattern
	GetCurrentColumn
	GetCurrentLine
	GetPatternDescription
	GetUseTokenList
	Next
	Reset
	SetUseTokenList
	ToString

Protected Methods

	Name	Description
	NewToken

See Also

Reference

Tokenizer Class
PerCederberg.Grammatica.Runtime Namespace

This page has encountered an error. We've attempted to send the information to the server.