org.simmetrics.tokenizers

Class Whitespace

java.lang.Object

org.simmetrics.tokenizers.AbstractTokenizer

org.simmetrics.tokenizers.Whitespace

All Implemented Interfaces:

Tokenizer

Deprecated.

use Tokenizers.whitespace() instead

@Deprecated
public final class Whitespace
extends AbstractTokenizer

Splits a string into tokens around white space. Does not return leading or trailing empty tokens.

To create tokenizer that returns leading and trailing empty tokens use Tokenizers.pattern("\\s+")

This class is immutable and thread-safe.

Constructor Summary

Constructors

Constructor and Description
Whitespace() Deprecated.

Method Summary

Modifier and Type	Method and Description
List<String>	tokenizeToList(String input) Deprecated. Return tokenized version of a string as a list of tokens.
String	toString() Deprecated.

Methods inherited from class org.simmetrics.tokenizers.AbstractTokenizer

tokenizeToSet

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Whitespace

public Whitespace()

Deprecated.

Method Detail

toString

public String toString()

Deprecated.

Overrides:

toString in class Object

tokenizeToList

public List<String> tokenizeToList(String input)

Deprecated.

Description copied from interface: Tokenizer

Return tokenized version of a string as a list of tokens.

Parameters:

input - input string to tokenize

Returns:

List tokenized version of a string