cmu.arktweetnlp.impl.features

Class WordClusterPaths

java.lang.Object

cmu.arktweetnlp.impl.features.WordClusterPaths

All Implemented Interfaces:

FeatureExtractor.FeatureExtractorInterface

public class WordClusterPaths
extends java.lang.Object
implements FeatureExtractor.FeatureExtractorInterface

Brown word clusters: features are path prefixes down the tree.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	clusterResourceName TODO this should be moved into config somehow
static java.util.HashMap<java.lang.String,java.lang.String>	wordToPath

Constructor Summary

Constructors

Constructor and Description
WordClusterPaths()

Method Summary

Methods

Modifier and Type	Method and Description
void	addFeatures(java.util.List<java.lang.String> tokens, FeatureExtractor.PositionFeaturePairs pairs) Input: sentence Output: labelIndexes, featureIDs/Values through positionFeaturePairs We want to yield a sequence of (t, featID, featValue) pairs, to be conjuncted against label IDs at position t.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

clusterResourceName

public static java.lang.String clusterResourceName

TODO this should be moved into config somehow

wordToPath

public static java.util.HashMap<java.lang.String,java.lang.String> wordToPath

Constructor Detail

WordClusterPaths

public WordClusterPaths()
                 throws java.io.IOException

Throws:

java.io.IOException

Method Detail

addFeatures

public void addFeatures(java.util.List<java.lang.String> tokens,
               FeatureExtractor.PositionFeaturePairs pairs)

Description copied from interface: FeatureExtractor.FeatureExtractorInterface

Input: sentence Output: labelIndexes, featureIDs/Values through positionFeaturePairs We want to yield a sequence of (t, featID, featValue) pairs, to be conjuncted against label IDs at position t. Represent as parallel arrays. Ick yes, but we want to save object allocations (is this crazy?) This method should append to them.

Specified by:

addFeatures in interface FeatureExtractor.FeatureExtractorInterface