Package org.ek9lang.compiler.tokenizer

Class TokenStreamAssessment

java.lang.Object

org.ek9lang.compiler.tokenizer.TokenStreamAssessment

public class TokenStreamAssessment
extends Object

But also to aid in listing out tokens so that when building grammars out of tokens it is possible to see what is being produced. Note the use of the LexerPlugin, this is so we can alter the underlying Lexer to get the right stream of tokens. As an aside - aids in assessing the readability of source code.

Constructor Summary

Constructors

Constructor	Description
TokenStreamAssessment()

Method Summary

Modifier and Type	Method	Description
String	assess(LexerPlugin lexer, boolean printTokens)	Assess the reading complexity of the tokens from the lexer.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

TokenStreamAssessment

public TokenStreamAssessment()

Method Details

assess

public String assess(LexerPlugin lexer,
 boolean printTokens)

Assess the reading complexity of the tokens from the lexer.