Module syntax::parse::tokenExperimental

Reexports

pub use self::BinOpToken::*;

pub use self::Nonterminal::*;

pub use self::DelimToken::*;

pub use self::IdentStyle::*;

pub use self::Lit::*;

pub use self::Token::*;

Modules

keywords	All the valid words that have meaning in the Rust language.
special_idents
special_names

Structs

InternedString

Represents a string stored in the task-local interner. Because the interner lives for the life of the task, this can be safely treated as an immortal string, as long as it never crosses between tasks.

Enums

BinOpToken
DelimToken	A delimeter token
IdentStyle
Lit
Nonterminal	For interpolation during macro expansion.
Token

Constants

SELF_KEYWORD_NAME
SELF_KEYWORD_NAME_NUM

Functions

fresh_mark
fresh_name
gensym	gensym's a new uint, using the current interner.
gensym_ident	Maps a string to a gensym'ed identifier.
get_ident	Returns the string contents of an identifier, using the task-local interner.
get_ident_interner
get_name	Returns the string contents of a name, using the task-local interner.
intern	Maps a string to its interned representation.
intern_and_get_ident	Interns and returns the string contents of an identifier, using the task-local interner.
reset_ident_interner	Reset the ident interner to its initial state.
str_to_ident	Maps a string to an identifier with an empty syntax context.

Type Definitions

IdentInterner