Package adams.flow.transformer

Class MOAClassifierEvaluation

  • All Implemented Interfaces:
    adams.core.AdditionalInformationHandler, adams.core.CleanUpHandler, adams.core.Destroyable, adams.core.GlobalInfoSupporter, adams.core.logging.LoggingLevelHandler, adams.core.logging.LoggingSupporter, adams.core.option.OptionHandler, adams.core.QuickInfoSupporter, adams.core.ShallowCopySupporter<adams.flow.core.Actor>, adams.core.SizeOfHandler, adams.core.Stoppable, adams.core.StoppableWithFeedback, adams.core.VariablesInspectionHandler, adams.event.VariableChangeListener, adams.flow.core.Actor, adams.flow.core.ErrorHandler, adams.flow.core.InputConsumer, adams.flow.core.OutputProducer, Serializable, Comparable
    public class MOAClassifierEvaluation
extends adams.flow.transformer.AbstractTransformer
    Evaluates a MOA classifier using prequential evaluation. With each incoming instance, the classifier is first evaluated, then trained.

    Input/output:
    - accepts:
       weka.core.Instance
       weka.core.Instances
    - generates:
       moa.core.Measurement[]


    -logging-level <OFF|SEVERE|WARNING|INFO|CONFIG|FINE|FINER|FINEST> (property: loggingLevel)
    The logging level for outputting errors and debugging output.
    default: WARNING
 
    -name <java.lang.String> (property: name)
    The name of the actor.
    default: MOAClassifierEvaluation
 
    -annotation <adams.core.base.BaseText> (property: annotations)
    The annotations to attach to this actor.
    default: 
 
    -skip <boolean> (property: skip)
    If set to true, transformation is skipped and the input token is just forwarded 
    as it is.
    default: false
 
    -stop-flow-on-error <boolean> (property: stopFlowOnError)
    If set to true, the flow gets stopped in case this actor encounters an error;
     useful for critical actors.
    default: false
 
    -classifier <adams.flow.core.CallableActorReference> (property: classifier)
    The name of the callable MOA classifier to train/evaluate.
    default: MOAClassifier
 
    -evaluator <moa.options.ClassOption> (property: evaluator)
    The MOA evaluator to use for evaluating a trained MOA classifier.
    default: moa.evaluation.BasicClassificationPerformanceEvaluator
 
    -output-interval <int> (property: outputInterval)
    The number of tokens to skip before evaluating the classifier stored in 
    the token (only used when receiving Instance objects).
    default: 1
    minimum: 1
    Author:
    fracpete (fracpete at waikato dot ac dot nz)
    See Also:
    Serialized Form

    • Field Summary

      Fields 
      Modifier and Type Field Description
      static String BACKUP_CLASSIFIER
      the key for storing the current classifier in the backup.
      protected moa.classifiers.AbstractClassifier m_ActualClassifier
      the model to use for prediction/training.
      protected moa.evaluation.ClassificationPerformanceEvaluator m_ActualEvaluator
      the actual evaluator to use.
      protected adams.flow.core.CallableActorReference m_Classifier
      the name of the callable classifier to use.
      protected int m_Count
      the current count of tokens that have passed through this actor.
      protected moa.options.ClassOption m_Evaluator
      the evaluation to use.
      protected int m_OutputInterval
      the output interval.

      • Fields inherited from class adams.flow.transformer.AbstractTransformer

        BACKUP_INPUT, BACKUP_OUTPUT, m_InputToken, m_OutputToken

      • Fields inherited from class adams.flow.core.AbstractActor

        m_Annotations, m_BackupState, m_DetectedObjectVariables, m_DetectedVariables, m_ErrorHandler, m_Executed, m_Executing, m_ExecutionListeningSupporter, m_FullName, m_LoggingPrefix, m_Name, m_Parent, m_ScopeHandler, m_Self, m_Silent, m_Skip, m_StopFlowOnError, m_StopMessage, m_Stopped, m_StorageHandler, m_VariablesUpdated

      • Fields inherited from class adams.core.option.AbstractOptionHandler

        m_OptionManager

      • Fields inherited from class adams.core.logging.LoggingObject

        m_Logger, m_LoggingIsEnabled, m_LoggingLevel

      • Fields inherited from interface adams.flow.core.Actor

        FILE_EXTENSION, FILE_EXTENSION_GZ

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      Class[] accepts()
      Returns the class that the consumer accepts.
      protected Hashtable<String,​Object> backupState()
      Backs up the current state of the actor before update the variables.
      String classifierTipText()
      Returns the tip text for this property.
      void defineOptions()
      Adds options to the internal list of options.
      protected String doExecute()
      Executes the flow item.
      String evaluatorTipText()
      Returns the tip text for this property.
      Class[] generates()
      Returns the class of objects that it generates.
      adams.flow.core.CallableActorReference getClassifier()
      Returns the callable classifier to use.
      protected moa.classifiers.AbstractClassifier getClassifierInstance()
      Returns an instance of the callable classifier.
      protected moa.evaluation.ClassificationPerformanceEvaluator getCurrentEvaluator()
      Returns the current evaluator, based on the class option.
      protected moa.evaluation.ClassificationPerformanceEvaluator getDefaultEvaluator()
      Returns the default evaluator.
      protected moa.options.ClassOption getDefaultOption()
      Returns the default class option.
      moa.options.ClassOption getEvaluator()
      Returns the evaluator in use.
      int getOutputInterval()
      Returns the number of tokens after which to evaluate the classifier.
      String getQuickInfo()
      Returns a quick info about the actor, which will be displayed in the GUI.
      String globalInfo()
      Returns a string describing the object.
      protected void initialize()
      Initializes the members.
      String outputIntervalTipText()
      Returns the tip text for this property.
      protected void pruneBackup()
      Removes entries from the backup.
      protected void reset()
      Initializes the members.
      protected void restoreState​(Hashtable<String,​Object> state)
      Restores the state of the actor before the variables got updated.
      void setClassifier​(adams.flow.core.CallableActorReference value)
      Sets the callable classifier to use.
      void setEvaluator​(moa.options.ClassOption value)
      Sets the evaluator to use.
      void setOutputInterval​(int value)
      Sets the number of tokens after which to evaluate the classifier.
      void wrapUp()
      Cleans up after the execution has finished.

      • Methods inherited from class adams.flow.transformer.AbstractTransformer

        currentInput, execute, hasInput, hasPendingOutput, input, output, postExecute

      • Methods inherited from class adams.flow.core.AbstractActor

        annotationsTipText, canInspectOptions, canPerformSetUpCheck, cleanUp, compareTo, configureLogger, destroy, equals, finalUpdateVariables, findVariables, findVariables, forceVariables, forCommandLine, forName, forName, getAdditionalInformation, getAnnotations, getDefaultName, getDetectedVariables, getErrorHandler, getFlowActors, getFlowExecutionListeningSupporter, getFullName, getName, getNextSibling, getParent, getParentComponent, getPreviousSibling, getRoot, getScopeHandler, getSilent, getSkip, getStopFlowOnError, getStopMessage, getStorageHandler, getVariables, handleError, handleException, hasErrorHandler, hasStopMessage, index, isBackedUp, isExecuted, isExecuting, isFinished, isHeadless, isStopped, nameTipText, performSetUpChecks, performVariableChecks, preExecute, pruneBackup, setAnnotations, setErrorHandler, setName, setParent, setSilent, setSkip, setStopFlowOnError, setUp, setVariables, shallowCopy, shallowCopy, silentTipText, sizeOf, skipTipText, stopExecution, stopExecution, stopFlowOnErrorTipText, updateDetectedVariables, updatePrefix, updateVariables, variableChanged

      • Methods inherited from class adams.core.option.AbstractOptionHandler

        cleanUpOptions, finishInit, getDefaultLoggingLevel, getOptionManager, loggingLevelTipText, newOptionManager, setLoggingLevel, toCommandLine, toString

      • Methods inherited from class adams.core.logging.LoggingObject

        getLogger, getLoggingLevel, initializeLogging, isLoggingEnabled

      • Methods inherited from interface adams.flow.core.Actor

        cleanUp, compareTo, destroy, equals, findVariables, getAnnotations, getDefaultName, getDetectedVariables, getErrorHandler, getFlowExecutionListeningSupporter, getFullName, getName, getNextSibling, getParent, getParentComponent, getPreviousSibling, getRoot, getScopeHandler, getSilent, getSkip, getStopFlowOnError, getStopMessage, getStorageHandler, getVariables, handleError, hasErrorHandler, hasStopMessage, index, isExecuted, isFinished, isHeadless, isStopped, setAnnotations, setErrorHandler, setName, setParent, setSilent, setSkip, setStopFlowOnError, setUp, setVariables, shallowCopy, shallowCopy, sizeOf, stopExecution, stopExecution, toCommandLine, variableChanged

      • Methods inherited from interface adams.core.AdditionalInformationHandler

        getAdditionalInformation

      • Methods inherited from interface adams.core.logging.LoggingLevelHandler

        getLoggingLevel, setLoggingLevel

      • Methods inherited from interface adams.core.logging.LoggingSupporter

        getLogger, isLoggingEnabled

      • Methods inherited from interface adams.core.option.OptionHandler

        cleanUpOptions, getOptionManager

      • Methods inherited from interface adams.core.VariablesInspectionHandler

        canInspectOptions

    • Field Detail

      • BACKUP_CLASSIFIER

        public static final String BACKUP_CLASSIFIER
        the key for storing the current classifier in the backup.
        See Also:
        Constant Field Values

      • m_Classifier

        protected adams.flow.core.CallableActorReference m_Classifier
        the name of the callable classifier to use.

      • m_ActualClassifier

        protected moa.classifiers.AbstractClassifier m_ActualClassifier
        the model to use for prediction/training.

      • m_Evaluator

        protected moa.options.ClassOption m_Evaluator
        the evaluation to use.

      • m_ActualEvaluator

        protected moa.evaluation.ClassificationPerformanceEvaluator m_ActualEvaluator
        the actual evaluator to use.

      • m_OutputInterval

        protected int m_OutputInterval
        the output interval.

      • m_Count

        protected int m_Count
        the current count of tokens that have passed through this actor.

    • Constructor Detail

      • MOAClassifierEvaluation

        public MOAClassifierEvaluation()

    • Method Detail

      • globalInfo

        public String globalInfo()
        Returns a string describing the object.
        Specified by:
        globalInfo in interface adams.core.GlobalInfoSupporter
        Specified by:
        globalInfo in class adams.core.option.AbstractOptionHandler
        Returns:
        a description suitable for displaying in the gui

      • defineOptions

        public void defineOptions()
        Adds options to the internal list of options.
        Specified by:
        defineOptions in interface adams.core.option.OptionHandler
        Overrides:
        defineOptions in class adams.flow.core.AbstractActor

      • reset

        protected void reset()
        Initializes the members.
        Overrides:
        reset in class adams.flow.core.AbstractActor

      • initialize

        protected void initialize()
        Initializes the members.
        Overrides:
        initialize in class adams.flow.core.AbstractActor

      • setClassifier

        public void setClassifier​(adams.flow.core.CallableActorReference value)
        Sets the callable classifier to use.
        Parameters:
        value - the classifier name

      • getClassifier

        public adams.flow.core.CallableActorReference getClassifier()
        Returns the callable classifier to use.
        Returns:
        the classifier name

      • classifierTipText

        public String classifierTipText()
        Returns the tip text for this property.
        Returns:
        tip text for this property suitable for displaying in the GUI or for listing the options.

      • getDefaultEvaluator

        protected moa.evaluation.ClassificationPerformanceEvaluator getDefaultEvaluator()
        Returns the default evaluator.
        Returns:
        the evaluator

      • getDefaultOption

        protected moa.options.ClassOption getDefaultOption()
        Returns the default class option.
        Returns:
        the option

      • setEvaluator

        public void setEvaluator​(moa.options.ClassOption value)
        Sets the evaluator to use.
        Parameters:
        value - the evaluator

      • getEvaluator

        public moa.options.ClassOption getEvaluator()
        Returns the evaluator in use.
        Returns:
        the evaluator

      • evaluatorTipText

        public String evaluatorTipText()
        Returns the tip text for this property.
        Returns:
        tip text for this property suitable for displaying in the GUI or for listing the options.

      • getCurrentEvaluator

        protected moa.evaluation.ClassificationPerformanceEvaluator getCurrentEvaluator()
        Returns the current evaluator, based on the class option.
        Returns:
        the evaluator
        See Also:
        getEvaluator()

      • setOutputInterval

        public void setOutputInterval​(int value)
        Sets the number of tokens after which to evaluate the classifier.
        Parameters:
        value - the interval

      • getOutputInterval

        public int getOutputInterval()
        Returns the number of tokens after which to evaluate the classifier.
        Returns:
        the interval

      • outputIntervalTipText

        public String outputIntervalTipText()
        Returns the tip text for this property.
        Returns:
        tip text for this property suitable for displaying in the GUI or for listing the options.

      • getQuickInfo

        public String getQuickInfo()
        Returns a quick info about the actor, which will be displayed in the GUI.
        Specified by:
        getQuickInfo in interface adams.flow.core.Actor
        Specified by:
        getQuickInfo in interface adams.core.QuickInfoSupporter
        Overrides:
        getQuickInfo in class adams.flow.core.AbstractActor
        Returns:
        null if no info available, otherwise short string

      • accepts

        public Class[] accepts()
        Returns the class that the consumer accepts.
        Returns:
        weka.core.Instance.class, weka.core.Instances.class

      • generates

        public Class[] generates()
        Returns the class of objects that it generates.
        Returns:
        moa.core.Measurement[].class

      • pruneBackup

        protected void pruneBackup()
        Removes entries from the backup.
        Overrides:
        pruneBackup in class adams.flow.core.AbstractActor

      • backupState

        protected Hashtable<String,​Object> backupState()
        Backs up the current state of the actor before update the variables.
        Overrides:
        backupState in class adams.flow.transformer.AbstractTransformer
        Returns:
        the backup

      • restoreState

        protected void restoreState​(Hashtable<String,​Object> state)
        Restores the state of the actor before the variables got updated.
        Overrides:
        restoreState in class adams.flow.transformer.AbstractTransformer
        Parameters:
        state - the backup of the state to restore from

      • getClassifierInstance

        protected moa.classifiers.AbstractClassifier getClassifierInstance()
        Returns an instance of the callable classifier.
        Returns:
        the classifier

      • doExecute

        protected String doExecute()
        Executes the flow item.
        Specified by:
        doExecute in class adams.flow.core.AbstractActor
        Returns:
        null if everything is fine, otherwise error message

      • wrapUp

        public void wrapUp()
        Cleans up after the execution has finished.
        Specified by:
        wrapUp in interface adams.flow.core.Actor
        Overrides:
        wrapUp in class adams.flow.transformer.AbstractTransformer