Package moa.tasks
Class EvaluatePrequentialCV
- java.lang.Object
-
- moa.AbstractMOAObject
-
- moa.options.AbstractOptionHandler
-
- moa.tasks.AbstractTask
-
- moa.tasks.MainTask
-
- moa.tasks.ClassificationMainTask
-
- moa.tasks.EvaluatePrequentialCV
-
- All Implemented Interfaces:
Configurable
,Serializable
,CapabilitiesHandler
,MOAObject
,OptionHandler
,Task
public class EvaluatePrequentialCV extends ClassificationMainTask
Task for prequential cross-validation evaluation of a classifier on a stream by testing then training with each example in sequence and doing cross-validation at the same time.Albert Bifet, Gianmarco De Francisci Morales, Jesse Read, Geoff Holmes, Bernhard Pfahringer: Efficient Online Evaluation of Big Data Stream Classifiers. KDD 2015: 59-68
- Version:
- $Revision: 7 $
- Author:
- Richard Kirkby (rkirkby@cs.waikato.ac.nz), Albert Bifet (abifet at cs dot waikato dot ac dot nz)
- See Also:
- Serialized Form
-
-
Field Summary
-
Fields inherited from class moa.tasks.ClassificationMainTask
events
-
Fields inherited from class moa.tasks.MainTask
INSTANCES_BETWEEN_MONITOR_UPDATES, outputFileOption
-
Fields inherited from class moa.options.AbstractOptionHandler
config
-
-
Constructor Summary
Constructors Constructor Description EvaluatePrequentialCV()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected Object
doMainTask(TaskMonitor monitor, ObjectRepository repository)
This method performs this task.Measurement[]
getEvaluationMeasurements(Measurement[] modelMeasurements, LearningPerformanceEvaluator[] subEvaluators)
String
getPurposeString()
Dictionary with option texts and objectsClass<?>
getTaskResultType()
Gets the result type of this task.-
Methods inherited from class moa.tasks.ClassificationMainTask
defineImmutableCapabilities, getEventsList, setEventsList
-
Methods inherited from class moa.tasks.MainTask
doTaskImpl
-
Methods inherited from class moa.tasks.AbstractTask
doTask, doTask, getDescription, getTaskName, prepareForUseImpl
-
Methods inherited from class moa.options.AbstractOptionHandler
copy, getCLICreationString, getOptions, getPreparedClassOption, prepareClassOptions, prepareForUse, prepareForUse
-
Methods inherited from class moa.AbstractMOAObject
copy, measureByteSize, measureByteSize, toString
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
-
Methods inherited from interface moa.capabilities.CapabilitiesHandler
getCapabilities
-
Methods inherited from interface moa.MOAObject
measureByteSize
-
-
-
-
Field Detail
-
learnerOption
public ClassOption learnerOption
-
streamOption
public ClassOption streamOption
-
evaluatorOption
public ClassOption evaluatorOption
-
instanceLimitOption
public IntOption instanceLimitOption
-
timeLimitOption
public IntOption timeLimitOption
-
sampleFrequencyOption
public IntOption sampleFrequencyOption
-
memCheckFrequencyOption
public IntOption memCheckFrequencyOption
-
dumpFileOption
public FileOption dumpFileOption
-
numFoldsOption
public IntOption numFoldsOption
-
validationMethodologyOption
public MultiChoiceOption validationMethodologyOption
-
randomSeedOption
public IntOption randomSeedOption
-
-
Method Detail
-
getPurposeString
public String getPurposeString()
Description copied from class:AbstractOptionHandler
Dictionary with option texts and objects- Specified by:
getPurposeString
in interfaceOptionHandler
- Overrides:
getPurposeString
in classAbstractOptionHandler
- Returns:
- the string with the purpose of this object
-
getTaskResultType
public Class<?> getTaskResultType()
Description copied from interface:Task
Gets the result type of this task. Tasks can return LearningCurve, LearningEvaluation, Classifier, String, Instances..- Returns:
- a class object of the result of this task
-
doMainTask
protected Object doMainTask(TaskMonitor monitor, ObjectRepository repository)
Description copied from class:MainTask
This method performs this task.AbstractTask
implementsdoTask
, that usesdoTaskImpl
.MainTask
implementsdoTaskImpl
usingdoMainTask
so its extensions only need to implementdoMainTask
.- Specified by:
doMainTask
in classMainTask
- Parameters:
monitor
- the TaskMonitor to userepository
- the ObjectRepository to use- Returns:
- an object with the result of this task
-
getEvaluationMeasurements
public Measurement[] getEvaluationMeasurements(Measurement[] modelMeasurements, LearningPerformanceEvaluator[] subEvaluators)
-
-