org.simmetrics.utils

Class CachingTokenizer

java.lang.Object

org.simmetrics.utils.CachingTokenizer

All Implemented Interfaces:

Tokenizer, Tokenizing, TokenizingTokenizer

Deprecated.

@Deprecated
public class CachingTokenizer
extends Object
implements TokenizingTokenizer

Tokenizer that caches tokenized results. Can be used to improve performance when repeatedly processing identical strings. Least used cache entries are evicted once the cache reaches its maximum size.

This class is thread-safe provided its components are and the setTokenizer(Tokenizer) is not called in a concurrent context.

See Also:

StringMetricBuilder

Constructor Summary

Constructors

Constructor and Description
CachingTokenizer(int initialCapacity, int maximumSize) Deprecated. Creates a caching tokenizer with initialCapacity and maximumSize.
CachingTokenizer(int initialCapacity, int maximumSize, Tokenizer tokenizer) Deprecated. Creates a caching tokenizer with initialCapacity and maximumSize.

Method Summary

Modifier and Type	Method and Description
Tokenizer	getTokenizer() Deprecated. Gets the tokenizer.
void	setTokenizer(Tokenizer tokenizer) Deprecated. Sets the tokenizer.
List<String>	tokenizeToList(String input) Deprecated. Return tokenized version of a string as a list of tokens.
Set<String>	tokenizeToSet(String input) Deprecated. Return tokenized version of a string as a set of tokens.
String	toString() Deprecated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

CachingTokenizer

public CachingTokenizer(int initialCapacity,
                        int maximumSize)

Deprecated.

Creates a caching tokenizer with initialCapacity and maximumSize. Least used cache entries are evicted once the cache reaches its maximum size.

Note: A delegated tokenizer must be set through through setTokenizer(Tokenizer)

Parameters:

initialCapacity - initial size of the cache

maximumSize - maximum size of the cache

CachingTokenizer

public CachingTokenizer(int initialCapacity,
                        int maximumSize,
                        Tokenizer tokenizer)

Deprecated.

Creates a caching tokenizer with initialCapacity and maximumSize. Least used cache entries are evicted once the cache reaches its maximum size.

Uses the delegated tokenizer to perform the tokenization.

Parameters:

initialCapacity - initial size of the cache

maximumSize - maximum size of the cache

tokenizer - the delegate tokenizer

Method Detail

getTokenizer

public Tokenizer getTokenizer()

Deprecated.

Description copied from interface: Tokenizing

Gets the tokenizer. When null no simplifier was set.

Specified by:

getTokenizer in interface Tokenizing

Returns:

the tokenizer or null when not set

setTokenizer

public void setTokenizer(Tokenizer tokenizer)

Deprecated.

Description copied from interface: Tokenizing

Sets the tokenizer. May not be null.

Specified by:

setTokenizer in interface Tokenizing

Parameters:

tokenizer - a tokenizer to set

tokenizeToList

public List<String> tokenizeToList(String input)

Deprecated.

Description copied from interface: Tokenizer

Return tokenized version of a string as a list of tokens.

Specified by:

tokenizeToList in interface Tokenizer

Parameters:

input - input string to tokenize

Returns:

List tokenized version of a string

tokenizeToSet

public Set<String> tokenizeToSet(String input)

Deprecated.

Description copied from interface: Tokenizer

Return tokenized version of a string as a set of tokens.

Specified by:

tokenizeToSet in interface Tokenizer

Parameters:

input - input string to tokenize

Returns:

tokenized version of a string as a set

toString

public String toString()

Deprecated.

Overrides:

toString in class Object