Module

TokenStream

Inheritance

A TokenStream is a list of tokens, gathered during the parse of some entity (say a method). Entities populate these streams by being registered with the lexer. Any class can collect tokens by including TokenStream. From the outside, you use such an object by calling the start_collecting_tokens method, followed by calls to add_token and pop_token

Methods

Instance

Visibility Signature
public add_token (tk)
public add_tokens (tks)
public pop_token ()
public start_collecting_tokens ()
public token_stream ()

Instance Method Detail

add_token(tk)

add_tokens(tks)

pop_token()

start_collecting_tokens()

token_stream()