org.simmetrics.utils

Interface Tokenizing

All Known Subinterfaces:

TokenizingTokenizer

All Known Implementing Classes:

CachingTokenizer

Deprecated.

@Deprecated
public interface Tokenizing

Interface for classes that delegate to a Tokenizer.

Method Summary

Modifier and Type	Method and Description
Tokenizer	getTokenizer() Deprecated. Gets the tokenizer.
void	setTokenizer(Tokenizer tokenizer) Deprecated. Sets the tokenizer.

Method Detail

getTokenizer

Tokenizer getTokenizer()

Deprecated.

Gets the tokenizer. When null no simplifier was set.

Returns:

the tokenizer or null when not set

setTokenizer

void setTokenizer(Tokenizer tokenizer)

Deprecated.

Sets the tokenizer. May not be null.

Parameters:

tokenizer - a tokenizer to set