de.tudarmstadt.ukp.dkpro.core.stopwordremover

Class StopWordRemover

java.lang.Object

org.apache.uima.analysis_component.AnalysisComponent_ImplBase

org.apache.uima.analysis_component.Annotator_ImplBase

org.apache.uima.analysis_component.JCasAnnotator_ImplBase

org.apache.uima.fit.component.JCasAnnotator_ImplBase

de.tudarmstadt.ukp.dkpro.core.stopwordremover.StopWordRemover

All Implemented Interfaces:

org.apache.uima.analysis_component.AnalysisComponent

public class StopWordRemover
extends org.apache.uima.fit.component.JCasAnnotator_ImplBase

Remove all of the specified types from the CAS if their covered text is in the stop word dictionary. Also remove any other of the specified types that is covered by a matching instance.

Field Summary

Fields

Modifier and Type	Field and Description
static String	PARAM_MODEL_ENCODING The character encoding used by the model.
static String	PARAM_MODEL_LOCATION A list of URLs from which to load the stop word lists.
static String	PARAM_PATHS Feature paths for annotations that should be matched/removed.
static String	PARAM_STOP_WORD_TYPE Anything annotated with this type will be removed even if it does not match any word in the lists.

Constructor Summary

Constructors

Constructor and Description
StopWordRemover()

Method Summary

Modifier and Type	Method and Description
void	initialize(org.apache.uima.UimaContext context)
void	process(org.apache.uima.jcas.JCas jcas)

Methods inherited from class org.apache.uima.fit.component.JCasAnnotator_ImplBase

getLogger

Methods inherited from class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

getRequiredCasInterface, process

Methods inherited from class org.apache.uima.analysis_component.Annotator_ImplBase

getCasInstancesRequired, hasNext, next

Methods inherited from class org.apache.uima.analysis_component.AnalysisComponent_ImplBase

batchProcessComplete, collectionProcessComplete, destroy, getContext, getResultSpecification, reconfigure, setResultSpecification

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PARAM_MODEL_LOCATION

public static final String PARAM_MODEL_LOCATION

A list of URLs from which to load the stop word lists. If an URL is prefixed with a language code in square brackets, the stop word list is only used for documents in that language. Using no prefix or the prefix "[*]" causes the list to be used for every document. Example: "[de]classpath:/stopwords/en_articles.txt"

See Also:

Constant Field Values

PARAM_MODEL_ENCODING

public static final String PARAM_MODEL_ENCODING

The character encoding used by the model.

See Also:

Constant Field Values

PARAM_PATHS

public static final String PARAM_PATHS

Feature paths for annotations that should be matched/removed. The default is

 StopWord.class.getName()
 Token.class.getName()
 Lemma.class.getName()+"/value"
 

See Also:

Constant Field Values

PARAM_STOP_WORD_TYPE

public static final String PARAM_STOP_WORD_TYPE

Anything annotated with this type will be removed even if it does not match any word in the lists.

See Also:

Constant Field Values

Constructor Detail

StopWordRemover

public StopWordRemover()

Method Detail

initialize

public void initialize(org.apache.uima.UimaContext context)
                throws org.apache.uima.resource.ResourceInitializationException

Specified by:

initialize in interface org.apache.uima.analysis_component.AnalysisComponent

Overrides:

initialize in class org.apache.uima.fit.component.JCasAnnotator_ImplBase

Throws:

org.apache.uima.resource.ResourceInitializationException

process

public void process(org.apache.uima.jcas.JCas jcas)
             throws org.apache.uima.analysis_engine.AnalysisEngineProcessException

Specified by:

process in class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

Throws:

org.apache.uima.analysis_engine.AnalysisEngineProcessException