de.tudarmstadt.ukp.dkpro.core.frequency.phrasedetection

Class FrequencyCounter

java.lang.Object

org.apache.uima.analysis_component.AnalysisComponent_ImplBase

org.apache.uima.analysis_component.Annotator_ImplBase

org.apache.uima.analysis_component.JCasAnnotator_ImplBase

org.apache.uima.fit.component.JCasConsumer_ImplBase

de.tudarmstadt.ukp.dkpro.core.api.io.JCasFileWriter_ImplBase

de.tudarmstadt.ukp.dkpro.core.frequency.phrasedetection.FrequencyCounter

All Implemented Interfaces:

org.apache.uima.analysis_component.AnalysisComponent

public class FrequencyCounter
extends JCasFileWriter_ImplBase

Count unigrams and bigrams in a collection.

Nested Class Summary

Nested classes/interfaces inherited from class de.tudarmstadt.ukp.dkpro.core.api.io.JCasFileWriter_ImplBase

JCasFileWriter_ImplBase.NamedOutputStream

Field Summary

Fields

Modifier and Type	Field and Description
static String	PARAM_COVERING_TYPE Set this parameter if bigrams should only be counted when occurring within a covering type, e.g.
static String	PARAM_FEATURE_PATH The feature path.
static String	PARAM_FILTER_REGEX
static String	PARAM_LOWERCASE If true, all tokens are lowercased.
static String	PARAM_MIN_COUNT Tokens occurring fewer times than this value are omitted.
static String	PARAM_REGEX_REPLACEMENT
static String	PARAM_SORT_BY_ALPHABET If true, sort output alphabetically.
static String	PARAM_SORT_BY_COUNT If true, sort output by count (descending order).
static String	PARAM_STOPWORDS_FILE
static String	PARAM_STOPWORDS_REPLACEMENT

Fields inherited from class de.tudarmstadt.ukp.dkpro.core.api.io.JCasFileWriter_ImplBase

JAR_PREFIX, PARAM_COMPRESSION, PARAM_ESCAPE_DOCUMENT_ID, PARAM_OVERWRITE, PARAM_SINGULAR_TARGET, PARAM_STRIP_EXTENSION, PARAM_TARGET_LOCATION, PARAM_USE_DOCUMENT_ID

Constructor Summary

Constructors

Constructor and Description
FrequencyCounter()

Method Summary

Modifier and Type	Method and Description
void	collectionProcessComplete()
void	initialize(org.apache.uima.UimaContext context)
void	process(org.apache.uima.jcas.JCas aJCas)

Methods inherited from class de.tudarmstadt.ukp.dkpro.core.api.io.JCasFileWriter_ImplBase

getCompressionMethod, getOutputStream, getOutputStream, getRelativePath, getTargetLocation, isStripExtension, isUseDocumentId

Methods inherited from class org.apache.uima.fit.component.JCasConsumer_ImplBase

getLogger

Methods inherited from class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

getRequiredCasInterface, process

Methods inherited from class org.apache.uima.analysis_component.Annotator_ImplBase

getCasInstancesRequired, hasNext, next

Methods inherited from class org.apache.uima.analysis_component.AnalysisComponent_ImplBase

batchProcessComplete, destroy, getContext, getResultSpecification, reconfigure, setResultSpecification

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PARAM_FEATURE_PATH

public static final String PARAM_FEATURE_PATH

The feature path. Default: tokens.

See Also:

Constant Field Values

PARAM_COVERING_TYPE

public static final String PARAM_COVERING_TYPE

Set this parameter if bigrams should only be counted when occurring within a covering type, e.g. sentences.

See Also:

Constant Field Values

PARAM_LOWERCASE

public static final String PARAM_LOWERCASE

If true, all tokens are lowercased.

See Also:

Constant Field Values

PARAM_MIN_COUNT

public static final String PARAM_MIN_COUNT

Tokens occurring fewer times than this value are omitted. Default: 5.

See Also:

Constant Field Values

PARAM_SORT_BY_COUNT

public static final String PARAM_SORT_BY_COUNT

If true, sort output by count (descending order).

See Also:

Constant Field Values

PARAM_SORT_BY_ALPHABET

public static final String PARAM_SORT_BY_ALPHABET

If true, sort output alphabetically.

See Also:

Constant Field Values

PARAM_STOPWORDS_FILE

public static final String PARAM_STOPWORDS_FILE

See Also:

Constant Field Values

PARAM_STOPWORDS_REPLACEMENT

public static final String PARAM_STOPWORDS_REPLACEMENT

See Also:

Constant Field Values

PARAM_FILTER_REGEX

public static final String PARAM_FILTER_REGEX

See Also:

Constant Field Values

PARAM_REGEX_REPLACEMENT

public static final String PARAM_REGEX_REPLACEMENT

See Also:

Constant Field Values

Constructor Detail

FrequencyCounter

public FrequencyCounter()

Method Detail

initialize

public void initialize(org.apache.uima.UimaContext context)
                throws org.apache.uima.resource.ResourceInitializationException

Specified by:

initialize in interface org.apache.uima.analysis_component.AnalysisComponent

Overrides:

initialize in class org.apache.uima.fit.component.JCasConsumer_ImplBase

Throws:

org.apache.uima.resource.ResourceInitializationException

process

public void process(org.apache.uima.jcas.JCas aJCas)
             throws org.apache.uima.analysis_engine.AnalysisEngineProcessException

Specified by:

process in class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

Throws:

org.apache.uima.analysis_engine.AnalysisEngineProcessException

collectionProcessComplete

public void collectionProcessComplete()
                               throws org.apache.uima.analysis_engine.AnalysisEngineProcessException

Specified by:

collectionProcessComplete in interface org.apache.uima.analysis_component.AnalysisComponent

Overrides:

collectionProcessComplete in class JCasFileWriter_ImplBase

Throws:

org.apache.uima.analysis_engine.AnalysisEngineProcessException