Uses of Class
adams.flow.transformer.tokenizer.AbstractTokenizer

Packages that use AbstractTokenizer

Package	Description
adams.flow.transformer
adams.flow.transformer.tokenizer

Uses of AbstractTokenizer in adams.flow.transformer

Fields in adams.flow.transformer declared as AbstractTokenizer

Modifier and Type	Field	Description
protected AbstractTokenizer	Tokenize.m_Tokenizer	the tokenizer to use.

Methods in adams.flow.transformer that return AbstractTokenizer

Modifier and Type	Method	Description
AbstractTokenizer	Tokenize.getTokenizer()	Returns the tokenizer to use.

Methods in adams.flow.transformer with parameters of type AbstractTokenizer

Modifier and Type	Method	Description
void	Tokenize.setTokenizer(AbstractTokenizer value)	Sets the tokenizer to use.

Uses of AbstractTokenizer in adams.flow.transformer.tokenizer

Subclasses of AbstractTokenizer in adams.flow.transformer.tokenizer

Modifier and Type	Class	Description
class	StanfordPTBTokenizer	Uses Stanford's PTBTokenizer. For more details on the options see: http://nlp.stanford.edu/software/tokenizer.shtml
class	Twokenize	Uses TweetNLP's Twokenize. For more details on the tokenizer see: https://github.com/brendano/ark-tweet-nlp/blob/master/src/cmu/arktweetnlp/Twokenize.java
class	WekaTokenizer	Uses the specified Weka tokenizer.