Package moa.tasks
Class EvaluatePrequentialDelayedCV
- java.lang.Object
-
- moa.AbstractMOAObject
-
- moa.options.AbstractOptionHandler
-
- moa.tasks.AbstractTask
-
- moa.tasks.MainTask
-
- moa.tasks.ClassificationMainTask
-
- moa.tasks.EvaluatePrequentialDelayedCV
-
- All Implemented Interfaces:
Configurable
,Serializable
,CapabilitiesHandler
,MOAObject
,OptionHandler
,Task
public class EvaluatePrequentialDelayedCV extends ClassificationMainTask
Task for delayed cross-validation evaluation of a classifier on a stream by testing and only training with the example after the arrival of other k examples (delayed labeling).See details in:
Heitor Murilo Gomes, Albert Bifet, Jesse Read, Jean Paul Barddal, Fabricio Enembreck, Bernhard Pfharinger, Geoff Holmes, Talel Abdessalem. Adaptive random forests for evolving data stream classification. In Machine Learning, DOI: 10.1007/s10994-017-5642-8, Springer, 2017.
Cross-validation for data streams was originally proposed in:
Albert Bifet, Gianmarco De Francisci Morales, Jesse Read, Geoff Holmes, Bernhard Pfahringer: Efficient Online Evaluation of Big Data Stream Classifiers. KDD 2015: 59-68- Version:
- $Revision: 7 $
- Author:
- Richard Kirkby (rkirkby@cs.waikato.ac.nz), Albert Bifet (abifet at cs dot waikato dot ac dot nz), Heitor Murilo Gomes (heitor dot gomes at telecom-paristech dot fr)
- See Also:
- Serialized Form
-
-
Field Summary
-
Fields inherited from class moa.tasks.ClassificationMainTask
events
-
Fields inherited from class moa.tasks.MainTask
INSTANCES_BETWEEN_MONITOR_UPDATES, outputFileOption
-
Fields inherited from class moa.options.AbstractOptionHandler
config
-
-
Constructor Summary
Constructors Constructor Description EvaluatePrequentialDelayedCV()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected Object
doMainTask(TaskMonitor monitor, ObjectRepository repository)
This method performs this task.Measurement[]
getEvaluationMeasurements(Measurement[] modelMeasurements, LearningPerformanceEvaluator[] subEvaluators)
String
getPurposeString()
Dictionary with option texts and objectsClass<?>
getTaskResultType()
Gets the result type of this task.-
Methods inherited from class moa.tasks.ClassificationMainTask
defineImmutableCapabilities, getEventsList, setEventsList
-
Methods inherited from class moa.tasks.MainTask
doTaskImpl
-
Methods inherited from class moa.tasks.AbstractTask
doTask, doTask, getDescription, getTaskName, prepareForUseImpl
-
Methods inherited from class moa.options.AbstractOptionHandler
copy, getCLICreationString, getOptions, getPreparedClassOption, prepareClassOptions, prepareForUse, prepareForUse
-
Methods inherited from class moa.AbstractMOAObject
copy, measureByteSize, measureByteSize, toString
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
-
Methods inherited from interface moa.capabilities.CapabilitiesHandler
getCapabilities
-
Methods inherited from interface moa.MOAObject
measureByteSize
-
-
-
-
Field Detail
-
learnerOption
public ClassOption learnerOption
-
streamOption
public ClassOption streamOption
-
evaluatorOption
public ClassOption evaluatorOption
-
delayLengthOption
public IntOption delayLengthOption
-
instanceLimitOption
public IntOption instanceLimitOption
-
timeLimitOption
public IntOption timeLimitOption
-
sampleFrequencyOption
public IntOption sampleFrequencyOption
-
memCheckFrequencyOption
public IntOption memCheckFrequencyOption
-
dumpFileOption
public FileOption dumpFileOption
-
numFoldsOption
public IntOption numFoldsOption
-
validationMethodologyOption
public MultiChoiceOption validationMethodologyOption
-
randomSeedOption
public IntOption randomSeedOption
-
trainInstances
protected LinkedList<LinkedList<Example>> trainInstances
-
-
Method Detail
-
getPurposeString
public String getPurposeString()
Description copied from class:AbstractOptionHandler
Dictionary with option texts and objects- Specified by:
getPurposeString
in interfaceOptionHandler
- Overrides:
getPurposeString
in classAbstractOptionHandler
- Returns:
- the string with the purpose of this object
-
getTaskResultType
public Class<?> getTaskResultType()
Description copied from interface:Task
Gets the result type of this task. Tasks can return LearningCurve, LearningEvaluation, Classifier, String, Instances..- Returns:
- a class object of the result of this task
-
doMainTask
protected Object doMainTask(TaskMonitor monitor, ObjectRepository repository)
Description copied from class:MainTask
This method performs this task.AbstractTask
implementsdoTask
, that usesdoTaskImpl
.MainTask
implementsdoTaskImpl
usingdoMainTask
so its extensions only need to implementdoMainTask
.- Specified by:
doMainTask
in classMainTask
- Parameters:
monitor
- the TaskMonitor to userepository
- the ObjectRepository to use- Returns:
- an object with the result of this task
-
getEvaluationMeasurements
public Measurement[] getEvaluationMeasurements(Measurement[] modelMeasurements, LearningPerformanceEvaluator[] subEvaluators)
-
-