Package weka.core.tokenizers.cleaners

Interface TokenCleaner

All Superinterfaces:

weka.core.OptionHandler, Serializable

All Known Implementing Classes:

AbstractTokenCleaner, MultiCleaner, NormalizeDuplicateChars, PassThrough, RemoveNonWordCharTokens

public interface TokenCleaner
extends weka.core.OptionHandler, Serializable

Interface for token cleaners.

Version:

$Revision$

Author:

FracPete (fracpete at waikato dot ac dot nz)

Method Summary

Modifier and Type	Method	Description
String	clean(String token)	Determines whether a token is clean or not.

Methods inherited from interface weka.core.OptionHandler

getOptions, listOptions, setOptions

Method Detail

clean

String clean(String token)

Determines whether a token is clean or not.

Parameters:

token - the token to check

Returns:

the clean token or null to ignore