de.tudarmstadt.ukp.dkpro.core.io.reuters

Class ExtractReuters

java.lang.Object

de.tudarmstadt.ukp.dkpro.core.io.reuters.ExtractReuters

public class ExtractReuters
extends Object

Extract all the documents from a Reuters-21587 corpus in SGML format. The SGML files are expected to reside in a single directory.

This is an adaption of the ExtractReuters class in the lucene-benchmarks package.

See Also:

ExtractReuters

Constructor Summary

Constructors

Constructor and Description
ExtractReuters()

Method Summary

Modifier and Type	Method and Description
static List<ReutersDocument>	extract(Path reutersDir) Read all the SGML file in the given directory.
static List<ReutersDocument>	extractFile(InputStream sgmFile, URI uri) Read the documents out of a single file.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ExtractReuters

public ExtractReuters()

Method Detail

extract

public static List<ReutersDocument> extract(Path reutersDir)
                                     throws IOException,
                                            ParseException

Read all the SGML file in the given directory.

Parameters:

reutersDir - the directory that contains the Reuters SGML files.

Returns:

a list of ReutersDocuments

Throws:

IOException - if any of the files cannot be read.

ParseException - if there was a problem parsing a date

extractFile

public static List<ReutersDocument> extractFile(InputStream sgmFile,
                                                URI uri)
                                         throws IOException,
                                                ParseException

Read the documents out of a single file. Each file contains approximately 1000 documents.

Parameters:

sgmFile - an InputStream of a Reuters SGML file.

uri - an URI pointing to the original SGML file location

Returns:

a list of ReutersDocuments extracted from the input stream

Throws:

IOException - if any of the files cannot be read.

ParseException - if there was a problem parsing a date