Class | Description |
---|---|
DictionaryBasedTokenTransformer |
Reads a tab-separated file containing mappings from one token to another.
|
FileBasedTokenTransformer |
Replaces all tokens that are listed in the file in
FileBasedTokenTransformer.PARAM_MODEL_LOCATION by the string
specified in FileBasedTokenTransformer.PARAM_REPLACEMENT . |
HyphenationRemover |
Simple dictionary-based hyphenation remover.
|
RegexBasedTokenTransformer |
A
JCasTransformerChangeBased_ImplBase implementation that replaces tokens based on a
regular expressions. |
TokenCaseTransformer |
Change tokens to follow a specific casing: all upper case, all lower case, or 'normal case':
lowercase everything but the first character of a token and the characters immediately following
a hyphen.
|
Enum | Description |
---|---|
TokenCaseTransformer.Case |
Copyright © 2007–2018 Ubiquitous Knowledge Processing (UKP) Lab, Technische Universität Darmstadt. All rights reserved.