tivars.tokenizer.state

module documentation
(source)

Encoder states

Class EncoderState Base class for encoder states
Class InterpolatedString Strings interpolated via Send(
Class InterpolationStart Encoder state to initialize InterpolatedString
Class Line Encoder state which is always exited after a line break
Class ListName List names
Class MaxMode Maximal munching mode
Class MinMode Minimal munching mode
Class Name Valid var identifiers
Class ProgramName Program names
Class SmartMode Smart tokenization mode
Class String Strings