Package weka.core.tokenizers.cleaners

Interface Summary

Interface	Description
TokenCleaner	Interface for token cleaners.

Class Summary

Class	Description
AbstractTokenCleaner	Ancestor for cleaning tokens.
MultiCleaner	Combines multiple cleaners, applies them sequentially.
NormalizeDuplicateChars	Replaces all duplicate characters with a single one.
PassThrough	Dummy, never removes a token.
RemoveNonWordCharTokens	Removes tokens that contain non-word characters.