tivars.tokenizer.state

module documentation

(source)

Encoder states

Class	`EncoderState`	Base class for encoder states
Class	`InterpolatedString`	Strings interpolated via `Send(`
Class	`InterpolationStart`	Encoder state to initialize `InterpolatedString`
Class	`Line`	Encoder state which is always exited after a line break
Class	`ListName`	List names
Class	`MaxMode`	Maximal munching mode
Class	`MinMode`	Minimal munching mode
Class	`Name`	Valid var identifiers
Class	`ProgramName`	Program names
Class	`SmartMode`	Smart tokenization mode
Class	`String`	Strings