org.dkpro.core.tokit

Class WhitespaceSegmenter

java.lang.Object

org.apache.uima.analysis_component.AnalysisComponent_ImplBase

org.apache.uima.analysis_component.Annotator_ImplBase

org.apache.uima.analysis_component.JCasAnnotator_ImplBase

org.apache.uima.fit.component.JCasAnnotator_ImplBase

org.dkpro.core.api.segmentation.SegmenterBase

org.dkpro.core.tokit.WhitespaceSegmenter

All Implemented Interfaces:

org.apache.uima.analysis_component.AnalysisComponent

Deprecated.

Use RegexSegmenter

@Deprecated
public class WhitespaceSegmenter
extends SegmenterBase

A strict whitespace tokenizer, i.e. tokenizes according to whitespaces and linebreaks only.

If PARAM_WRITE_SENTENCES is set to true, one sentence per line is assumed. Otherwise, no sentences are created.

Field Summary

Fields inherited from class org.dkpro.core.api.segmentation.SegmenterBase

PARAM_LANGUAGE, PARAM_STRICT_ZONING, PARAM_WRITE_FORM, PARAM_WRITE_SENTENCE, PARAM_WRITE_TOKEN, PARAM_ZONE_TYPES

Constructor Summary

Constructors

Constructor and Description
WhitespaceSegmenter() Deprecated.

Method Summary

Modifier and Type	Method and Description
protected void	process(org.apache.uima.jcas.JCas aJCas, String text, int zoneBegin) Deprecated.

Methods inherited from class org.dkpro.core.api.segmentation.SegmenterBase

createSentence, createToken, createToken, createToken, getLanguage, getLocale, getZoneTypes, isEmpty, isStrictZoning, isWriteSentence, isWriteToken, limit, process

Methods inherited from class org.apache.uima.fit.component.JCasAnnotator_ImplBase

initialize

Methods inherited from class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

getRequiredCasInterface, process

Methods inherited from class org.apache.uima.analysis_component.Annotator_ImplBase

getCasInstancesRequired, hasNext, next

Methods inherited from class org.apache.uima.analysis_component.AnalysisComponent_ImplBase

batchProcessComplete, collectionProcessComplete, destroy, getContext, getLogger, getResultSpecification, reconfigure, setResultSpecification

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WhitespaceSegmenter

public WhitespaceSegmenter()

Deprecated.

Method Detail

process

protected void process(org.apache.uima.jcas.JCas aJCas,
                       String text,
                       int zoneBegin)
                throws org.apache.uima.analysis_engine.AnalysisEngineProcessException

Deprecated.

Specified by:

process in class SegmenterBase

Throws:

org.apache.uima.analysis_engine.AnalysisEngineProcessException