public class TokenizerOperation extends AbstractDelegatingOperation
Modifier and Type | Field and Description |
---|---|
static java.lang.String |
DELIMITERS
Parameter list that determines the delimiters this
operation will use to concatenate tokens.
|
static java.lang.String |
PHRASE_OPERATIONS
Parameter that determines the operations this operation
will perform on the phrases.
|
static java.lang.String |
TOKEN_OPERATIONS
Parameter that determines the operations this operation
will perform on the tokens.
|
params
dictionary
Constructor and Description |
---|
TokenizerOperation(Dictionary dictionary,
java.util.Map<java.lang.String,Param> params) |
Modifier and Type | Method and Description |
---|---|
boolean |
execute(POS pos,
java.lang.String lemma,
BaseFormSet forms)
Executes the operation.
|
protected java.lang.String[] |
getKeys() |
addDelegate, delegate, hasDelegate
getDictionary, setDictionary
public static final java.lang.String TOKEN_OPERATIONS
public static final java.lang.String PHRASE_OPERATIONS
public static final java.lang.String DELIMITERS
public TokenizerOperation(Dictionary dictionary, java.util.Map<java.lang.String,Param> params) throws JWNLException
JWNLException
protected java.lang.String[] getKeys()
getKeys
in class AbstractDelegatingOperation
public boolean execute(POS pos, java.lang.String lemma, BaseFormSet forms) throws JWNLException
Operation
pos
- part of speechlemma
- lemmaforms
- BaseFormSet to which all discovered base forms should
be added.JWNLException
- JWNLException