de.tudarmstadt.ukp.dkpro.core.stopwordremover

Class StopWordSet

java.lang.Object

de.tudarmstadt.ukp.dkpro.core.stopwordremover.StopWordSet

All Implemented Interfaces:

org.apache.uima.resource.SharedResourceObject

public class StopWordSet
extends Object
implements org.apache.uima.resource.SharedResourceObject

Used for storing stop words in a HashSet. Can be used as resource object in UIMA. Terms in stop word files are converted to lower case.

Constructor Summary

Constructors

Constructor and Description
StopWordSet()
StopWordSet(String[] fileNames)

Method Summary

Modifier and Type	Method and Description
void	addStopWordListFile(String fileName) Loads a text file (UTF-8 encoding!) containing stop words.
boolean	contains(String aWord)
void	load(org.apache.uima.resource.DataResource dataRes)
void	load(InputStream aIs)
void	load(InputStream aIs, String aEncoding)
void	load(Reader aReader) Load the stopwords from the given reader.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StopWordSet

public StopWordSet()

StopWordSet

public StopWordSet(String[] fileNames)
            throws IOException

Throws:

IOException

Method Detail

addStopWordListFile

public void addStopWordListFile(String fileName)
                         throws IOException

Loads a text file (UTF-8 encoding!) containing stop words. Only first word in each line will be taken into account. Everything after "|" will be treated as comment.

Parameters:

fileName - the file to read.

Throws:

IOException - if the file could not be read.

load

public void load(org.apache.uima.resource.DataResource dataRes)
          throws org.apache.uima.resource.ResourceInitializationException

Specified by:

load in interface org.apache.uima.resource.SharedResourceObject

Throws:

org.apache.uima.resource.ResourceInitializationException

load

public void load(InputStream aIs)
          throws IOException

Throws:

IOException

load

public void load(InputStream aIs,
                 String aEncoding)
          throws IOException

Throws:

IOException

load

public void load(Reader aReader)
          throws IOException

Load the stopwords from the given reader. If the set already contains data, new stopwords are added.

Parameters:

aReader - a reader.

Throws:

IOException - if the data could not be read.

contains

public boolean contains(String aWord)