de.tudarmstadt.ukp.dkpro.core.tokit
Classes
AnnotationByLengthFilter
BreakIteratorSegmenter
CamelCaseTokenSegmenter
GermanSeparatedParticleAnnotator
LineBasedSentenceSegmenter
ParagraphSplitter
PatternBasedTokenSegmenter
RegexSegmenter
TokenMerger
TokenTrimmer
WhitespaceSegmenter
Enums
TokenMerger.LemmaMode