Package jfun.parsec.tokens

Provides some predefined tokens and Tokenizer implementations.

See: Description

Class Summary

Class	Description
MyToken	Deprecated
NamedToken	A token that has a name.
TokenCharLiteral	Deprecated
TokenDecimal	Deprecated
TokenInteger	Deprecated
Tokenizers	The facade class for all pre-built Tokenizer implementations.
TokenLong	Deprecated
TokenQuoted	represents a string that is quoted by a open and close string.
TokenReserved	Deprecated
Tokens	This class create some basic tokens.
TokenString	Deprecated
TokenStringLiteral	Deprecated
TokenWord	Deprecated
TypedToken<Type>	Represents a token associated with a token type.

Enum Summary

Enum	Description
TokenType	This represents all pre-built token types.

Package jfun.parsec.tokens Description

Provides some predefined tokens and Tokenizer implementations. These tokens are being used by the default behavior of some lexers.

Package Specification

The code is developed and tested under Java 5.0.

Related Documentation

For overviews, tutorials, examples, guides, and tool documentation, please see README.txt: