Uses of Class
org.apache.lucene.analysis.TokenFilter

Packages that use TokenFilter

Package	Description
org.apache.lucene.analysis	Text analysis.
org.apache.lucene.analysis.ar	Analyzer for Arabic.
org.apache.lucene.analysis.bg	Analyzer for Bulgarian.
org.apache.lucene.analysis.bn	Analyzer for Bengali Language.
org.apache.lucene.analysis.boost	Provides various convenience classes for creating boosts on Tokens.
org.apache.lucene.analysis.br	Analyzer for Brazilian Portuguese.
org.apache.lucene.analysis.cjk	Analyzer for Chinese, Japanese, and Korean, which indexes bigrams.
org.apache.lucene.analysis.ckb	Analyzer for Sorani Kurdish.
org.apache.lucene.analysis.commongrams	Construct n-grams for frequently occurring terms and phrases.
org.apache.lucene.analysis.compound	A filter that decomposes compound words you find in many Germanic languages into the word parts.
org.apache.lucene.analysis.core	Basic, general-purpose analysis components.
org.apache.lucene.analysis.cz	Analyzer for Czech.
org.apache.lucene.analysis.de	Analyzer for German.
org.apache.lucene.analysis.el	Analyzer for Greek.
org.apache.lucene.analysis.en	Analyzer for English.
org.apache.lucene.analysis.es	Analyzer for Spanish.
org.apache.lucene.analysis.fa	Analyzer for Persian.
org.apache.lucene.analysis.fi	Analyzer for Finnish.
org.apache.lucene.analysis.fr	Analyzer for French.
org.apache.lucene.analysis.ga	Analyzer for Irish.
org.apache.lucene.analysis.gl	Analyzer for Galician.
org.apache.lucene.analysis.hi	Analyzer for Hindi.
org.apache.lucene.analysis.hu	Analyzer for Hungarian.
org.apache.lucene.analysis.hunspell	Stemming TokenFilter using a Java implementation of the Hunspell stemming algorithm.
org.apache.lucene.analysis.icu	Analysis components based on ICU
org.apache.lucene.analysis.id	Analyzer for Indonesian.
org.apache.lucene.analysis.in	Analyzer for Indian languages.
org.apache.lucene.analysis.it	Analyzer for Italian.
org.apache.lucene.analysis.ja	Analyzer for Japanese.
org.apache.lucene.analysis.ko	Analyzer for Korean.
org.apache.lucene.analysis.lv	Analyzer for Latvian.
org.apache.lucene.analysis.minhash	MinHash filtering (for LSH).
org.apache.lucene.analysis.miscellaneous	Miscellaneous Tokenstreams.
org.apache.lucene.analysis.ngram	Character n-gram tokenizers and filters.
org.apache.lucene.analysis.no	Analyzer for Norwegian.
org.apache.lucene.analysis.pattern	Set of components for pattern-based (regex) analysis.
org.apache.lucene.analysis.payloads	Provides various convenience classes for creating payloads on Tokens.
org.apache.lucene.analysis.phonetic	Analysis components for phonetic search.
org.apache.lucene.analysis.pt	Analyzer for Portuguese.
org.apache.lucene.analysis.reverse	Filter to reverse token text.
org.apache.lucene.analysis.ru	Analyzer for Russian.
org.apache.lucene.analysis.shingle	Word n-gram filters.
org.apache.lucene.analysis.sinks	TeeSinkTokenFilter.
org.apache.lucene.analysis.snowball	TokenFilter and Analyzer implementations that use Snowball stemmers.
org.apache.lucene.analysis.sr	Analyzer for Serbian.
org.apache.lucene.analysis.standard	Fast, general-purpose grammar-based tokenizer StandardTokenizer implements the Word Break rules from the Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.
org.apache.lucene.analysis.stempel	Stempel: Algorithmic Stemmer
org.apache.lucene.analysis.sv	Analyzer for Swedish.
org.apache.lucene.analysis.synonym	Analysis components for Synonyms.
org.apache.lucene.analysis.tr	Analyzer for Turkish.
org.apache.lucene.analysis.util	Utility functions for text analysis.
org.apache.lucene.monitor	Monitoring framework
org.apache.lucene.search.highlight	Highlighting search terms.
org.apache.lucene.search.suggest.analyzing	Analyzer based autosuggest.
org.apache.lucene.search.suggest.document	Support for document suggestion
org.apache.lucene.search.uhighlight	The UnifiedHighlighter -- a flexible highlighter that can get offsets from postings, term vectors, or analysis.

Uses of TokenFilter in org.apache.lucene.analysis

Subclasses of TokenFilter in org.apache.lucene.analysis

Modifier and Type	Class	Description
class	CachingTokenFilter	This class can be used if the token attributes of a TokenStream are intended to be consumed more than once.
class	FilteringTokenFilter	Abstract base class for TokenFilters that may remove tokens.
class	GraphTokenFilter	An abstract TokenFilter that exposes its input stream as a graph Call GraphTokenFilter.incrementBaseToken() to move the root of the graph to the next position in the TokenStream, GraphTokenFilter.incrementGraphToken() to move along the current graph, and GraphTokenFilter.incrementGraph() to reset to the next graph based at the current root.
class	LowerCaseFilter	Normalizes token text to lower case.
class	StopFilter	Removes stop words from a token stream.

Uses of TokenFilter in org.apache.lucene.analysis.ar

Subclasses of TokenFilter in org.apache.lucene.analysis.ar

Modifier and Type	Class	Description
class	ArabicNormalizationFilter	A TokenFilter that applies ArabicNormalizer to normalize the orthography.
class	ArabicStemFilter	A TokenFilter that applies ArabicStemmer to stem Arabic words..

Uses of TokenFilter in org.apache.lucene.analysis.bg

Subclasses of TokenFilter in org.apache.lucene.analysis.bg

Modifier and Type	Class	Description
class	BulgarianStemFilter	A TokenFilter that applies BulgarianStemmer to stem Bulgarian words.

Uses of TokenFilter in org.apache.lucene.analysis.bn

Subclasses of TokenFilter in org.apache.lucene.analysis.bn

Modifier and Type	Class	Description
class	BengaliNormalizationFilter	A TokenFilter that applies BengaliNormalizer to normalize the orthography.
class	BengaliStemFilter	A TokenFilter that applies BengaliStemmer to stem Bengali words.

Uses of TokenFilter in org.apache.lucene.analysis.boost

Subclasses of TokenFilter in org.apache.lucene.analysis.boost

Modifier and Type	Class	Description
class	DelimitedBoostTokenFilter	Characters before the delimiter are the "token", those after are the boost.

Uses of TokenFilter in org.apache.lucene.analysis.br

Subclasses of TokenFilter in org.apache.lucene.analysis.br

Modifier and Type	Class	Description
class	BrazilianStemFilter	A TokenFilter that applies BrazilianStemmer.

Uses of TokenFilter in org.apache.lucene.analysis.cjk

Subclasses of TokenFilter in org.apache.lucene.analysis.cjk

Modifier and Type	Class	Description
class	CJKBigramFilter	Forms bigrams of CJK terms that are generated from StandardTokenizer or ICUTokenizer.
class	CJKWidthFilter	A TokenFilter that normalizes CJK width differences: Folds fullwidth ASCII variants into the equivalent basic latin Folds halfwidth Katakana variants into the equivalent kana

Uses of TokenFilter in org.apache.lucene.analysis.ckb

Subclasses of TokenFilter in org.apache.lucene.analysis.ckb

Modifier and Type	Class	Description
class	SoraniNormalizationFilter	A TokenFilter that applies SoraniNormalizer to normalize the orthography.
class	SoraniStemFilter	A TokenFilter that applies SoraniStemmer to stem Sorani words.

Uses of TokenFilter in org.apache.lucene.analysis.commongrams

Subclasses of TokenFilter in org.apache.lucene.analysis.commongrams

Modifier and Type	Class	Description
class	CommonGramsFilter	Construct bigrams for frequently occurring terms while indexing.
class	CommonGramsQueryFilter	Wrap a CommonGramsFilter optimizing phrase queries by only returning single words when they are not a member of a bigram.

Methods in org.apache.lucene.analysis.commongrams that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	CommonGramsFilterFactory.create(TokenStream input)
TokenFilter	CommonGramsQueryFilterFactory.create(TokenStream input)	Create a CommonGramsFilter and wrap it with a CommonGramsQueryFilter

Uses of TokenFilter in org.apache.lucene.analysis.compound

Subclasses of TokenFilter in org.apache.lucene.analysis.compound

Modifier and Type	Class	Description
class	CompoundWordTokenFilterBase	Base class for decomposition token filters.
class	DictionaryCompoundWordTokenFilter	A TokenFilter that decomposes compound words found in many Germanic languages.
class	HyphenationCompoundWordTokenFilter	A TokenFilter that decomposes compound words found in many Germanic languages.

Methods in org.apache.lucene.analysis.compound that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	HyphenationCompoundWordTokenFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.core

Subclasses of TokenFilter in org.apache.lucene.analysis.core

Modifier and Type	Class	Description
class	DecimalDigitFilter	Folds all Unicode digits in [:General_Category=Decimal_Number:] to Basic Latin digits (0-9).
class	FlattenGraphFilter	Converts an incoming graph token stream, such as one from SynonymGraphFilter, into a flat form so that all nodes form a single linear chain with no side paths.
class	LowerCaseFilter	Normalizes token text to lower case.
class	StopFilter	Removes stop words from a token stream.
class	TypeTokenFilter	Removes tokens whose types appear in a set of blocked types from a token stream.
class	UpperCaseFilter	Normalizes token text to UPPER CASE.

Uses of TokenFilter in org.apache.lucene.analysis.cz

Subclasses of TokenFilter in org.apache.lucene.analysis.cz

Modifier and Type	Class	Description
class	CzechStemFilter	A TokenFilter that applies CzechStemmer to stem Czech words.

Uses of TokenFilter in org.apache.lucene.analysis.de

Subclasses of TokenFilter in org.apache.lucene.analysis.de

Modifier and Type	Class	Description
class	GermanLightStemFilter	A TokenFilter that applies GermanLightStemmer to stem German words.
class	GermanMinimalStemFilter	A TokenFilter that applies GermanMinimalStemmer to stem German words.
class	GermanNormalizationFilter	Normalizes German characters according to the heuristics of the German2 snowball algorithm.
class	GermanStemFilter	A TokenFilter that stems German words.

Uses of TokenFilter in org.apache.lucene.analysis.el

Subclasses of TokenFilter in org.apache.lucene.analysis.el

Modifier and Type	Class	Description
class	GreekLowerCaseFilter	Normalizes token text to lower case, removes some Greek diacritics, and standardizes final sigma to sigma.
class	GreekStemFilter	A TokenFilter that applies GreekStemmer to stem Greek words.

Uses of TokenFilter in org.apache.lucene.analysis.en

Subclasses of TokenFilter in org.apache.lucene.analysis.en

Modifier and Type	Class	Description
class	EnglishMinimalStemFilter	A TokenFilter that applies EnglishMinimalStemmer to stem English words.
class	EnglishPossessiveFilter	TokenFilter that removes possessives (trailing 's) from words.
class	KStemFilter	A high-performance kstem filter for english.
class	PorterStemFilter	Transforms the token stream as per the Porter stemming algorithm.

Methods in org.apache.lucene.analysis.en that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	KStemFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.es

Subclasses of TokenFilter in org.apache.lucene.analysis.es

Modifier and Type	Class	Description
class	SpanishLightStemFilter	A TokenFilter that applies SpanishLightStemmer to stem Spanish words.
class	SpanishMinimalStemFilter	A TokenFilter that applies SpanishMinimalStemmer to stem Spanish words.

Uses of TokenFilter in org.apache.lucene.analysis.fa

Subclasses of TokenFilter in org.apache.lucene.analysis.fa

Modifier and Type	Class	Description
class	PersianNormalizationFilter	A TokenFilter that applies PersianNormalizer to normalize the orthography.

Uses of TokenFilter in org.apache.lucene.analysis.fi

Subclasses of TokenFilter in org.apache.lucene.analysis.fi

Modifier and Type	Class	Description
class	FinnishLightStemFilter	A TokenFilter that applies FinnishLightStemmer to stem Finnish words.

Uses of TokenFilter in org.apache.lucene.analysis.fr

Subclasses of TokenFilter in org.apache.lucene.analysis.fr

Modifier and Type	Class	Description
class	FrenchLightStemFilter	A TokenFilter that applies FrenchLightStemmer to stem French words.
class	FrenchMinimalStemFilter	A TokenFilter that applies FrenchMinimalStemmer to stem French words.

Uses of TokenFilter in org.apache.lucene.analysis.ga

Subclasses of TokenFilter in org.apache.lucene.analysis.ga

Modifier and Type	Class	Description
class	IrishLowerCaseFilter	Normalises token text to lower case, handling t-prothesis and n-eclipsis (i.e., that 'nAthair' should become 'n-athair')

Uses of TokenFilter in org.apache.lucene.analysis.gl

Subclasses of TokenFilter in org.apache.lucene.analysis.gl

Modifier and Type	Class	Description
class	GalicianMinimalStemFilter	A TokenFilter that applies GalicianMinimalStemmer to stem Galician words.
class	GalicianStemFilter	A TokenFilter that applies GalicianStemmer to stem Galician words.

Uses of TokenFilter in org.apache.lucene.analysis.hi

Subclasses of TokenFilter in org.apache.lucene.analysis.hi

Modifier and Type	Class	Description
class	HindiNormalizationFilter	A TokenFilter that applies HindiNormalizer to normalize the orthography.
class	HindiStemFilter	A TokenFilter that applies HindiStemmer to stem Hindi words.

Uses of TokenFilter in org.apache.lucene.analysis.hu

Subclasses of TokenFilter in org.apache.lucene.analysis.hu

Modifier and Type	Class	Description
class	HungarianLightStemFilter	A TokenFilter that applies HungarianLightStemmer to stem Hungarian words.

Uses of TokenFilter in org.apache.lucene.analysis.hunspell

Subclasses of TokenFilter in org.apache.lucene.analysis.hunspell

Modifier and Type	Class	Description
class	HunspellStemFilter	TokenFilter that uses hunspell affix rules and words to stem tokens.

Uses of TokenFilter in org.apache.lucene.analysis.icu

Subclasses of TokenFilter in org.apache.lucene.analysis.icu

Modifier and Type	Class	Description
class	ICUFoldingFilter	A TokenFilter that applies search term folding to Unicode text, applying foldings from UTR#30 Character Foldings.
class	ICUNormalizer2Filter	Normalize token text with ICU's Normalizer2
class	ICUTransformFilter	A TokenFilter that transforms text with ICU.

Uses of TokenFilter in org.apache.lucene.analysis.id

Subclasses of TokenFilter in org.apache.lucene.analysis.id

Modifier and Type	Class	Description
class	IndonesianStemFilter	A TokenFilter that applies IndonesianStemmer to stem Indonesian words.

Uses of TokenFilter in org.apache.lucene.analysis.in

Subclasses of TokenFilter in org.apache.lucene.analysis.in

Modifier and Type	Class	Description
class	IndicNormalizationFilter	A TokenFilter that applies IndicNormalizer to normalize text in Indian Languages.

Uses of TokenFilter in org.apache.lucene.analysis.it

Subclasses of TokenFilter in org.apache.lucene.analysis.it

Modifier and Type	Class	Description
class	ItalianLightStemFilter	A TokenFilter that applies ItalianLightStemmer to stem Italian words.

Uses of TokenFilter in org.apache.lucene.analysis.ja

Subclasses of TokenFilter in org.apache.lucene.analysis.ja

Modifier and Type	Class	Description
class	JapaneseBaseFormFilter	Replaces term text with the BaseFormAttribute.
class	JapaneseKatakanaStemFilter	A TokenFilter that normalizes common katakana spelling variations ending in a long sound character by removing this character (U+30FC).
class	JapaneseNumberFilter	A TokenFilter that normalizes Japanese numbers (kansūji) to regular Arabic decimal numbers in half-width characters.
class	JapanesePartOfSpeechStopFilter	Removes tokens that match a set of part-of-speech tags.
class	JapaneseReadingFormFilter	A TokenFilter that replaces the term attribute with the reading of a token in either katakana or romaji form.

Uses of TokenFilter in org.apache.lucene.analysis.ko

Subclasses of TokenFilter in org.apache.lucene.analysis.ko

Modifier and Type	Class	Description
class	KoreanNumberFilter	A TokenFilter that normalizes Korean numbers to regular Arabic decimal numbers in half-width characters.
class	KoreanPartOfSpeechStopFilter	Removes tokens that match a set of part-of-speech tags.
class	KoreanReadingFormFilter	Replaces term text with the ReadingAttribute which is the Hangul transcription of Hanja characters.

Uses of TokenFilter in org.apache.lucene.analysis.lv

Subclasses of TokenFilter in org.apache.lucene.analysis.lv

Modifier and Type	Class	Description
class	LatvianStemFilter	A TokenFilter that applies LatvianStemmer to stem Latvian words.

Uses of TokenFilter in org.apache.lucene.analysis.minhash

Subclasses of TokenFilter in org.apache.lucene.analysis.minhash

Modifier and Type	Class	Description
class	MinHashFilter	Generate min hash tokens from an incoming stream of tokens.

Uses of TokenFilter in org.apache.lucene.analysis.miscellaneous

Subclasses of TokenFilter in org.apache.lucene.analysis.miscellaneous

Modifier and Type	Class	Description
class	ASCIIFoldingFilter	This class converts alphabetic, numeric, and symbolic Unicode characters which are not in the first 127 ASCII characters (the "Basic Latin" Unicode block) into their ASCII equivalents, if one exists.
class	CapitalizationFilter	A filter to apply normal capitalization rules to Tokens.
class	CodepointCountFilter	Removes words that are too long or too short from the stream.
class	ConditionalTokenFilter	Allows skipping TokenFilters based on the current set of attributes.
class	DateRecognizerFilter	Filters all tokens that cannot be parsed to a date, using the provided DateFormat.
class	DelimitedTermFrequencyTokenFilter	Characters before the delimiter are the "token", the textual integer after is the term frequency.
class	FingerprintFilter	Filter outputs a single token which is a concatenation of the sorted and de-duplicated set of input tokens.
class	FixBrokenOffsetsFilter	Deprecated. Fix the token filters that create broken offsets in the first place.
class	HyphenatedWordsFilter	When the plain text is extracted from documents, we will often have many words hyphenated and broken into two lines.
class	KeepWordFilter	A TokenFilter that only keeps tokens with text contained in the required words.
class	KeywordMarkerFilter	Marks terms as keywords via the KeywordAttribute.
class	KeywordRepeatFilter	This TokenFilter emits each incoming token twice once as keyword and once non-keyword, in other words once with KeywordAttribute.setKeyword(boolean) set to true and once set to false.
class	LengthFilter	Removes words that are too long or too short from the stream.
class	LimitTokenCountFilter	This TokenFilter limits the number of tokens while indexing.
class	LimitTokenOffsetFilter	Lets all tokens pass through until it sees one with a start offset <= a configured limit, which won't pass and ends the stream.
class	LimitTokenPositionFilter	This TokenFilter limits its emitted tokens to those with positions that are not greater than the configured limit.
class	PatternKeywordMarkerFilter	Marks terms as keywords via the KeywordAttribute.
class	ProtectedTermFilter	A ConditionalTokenFilter that only applies its wrapped filters to tokens that are not contained in a protected set.
class	RemoveDuplicatesTokenFilter	A TokenFilter which filters out Tokens at the same position and Term text as the previous token in the stream.
class	ScandinavianFoldingFilter	This filter folds Scandinavian characters åÅäæÄÆ->a and öÖøØ->o.
class	ScandinavianNormalizationFilter	This filter normalize use of the interchangeable Scandinavian characters æÆäÄöÖøØ and folded variants (aa, ao, ae, oe and oo) by transforming them to åÅæÆøØ.
class	SetKeywordMarkerFilter	Marks terms as keywords via the KeywordAttribute.
class	StemmerOverrideFilter	Provides the ability to override any KeywordAttribute aware stemmer with custom dictionary-based stemming.
class	TrimFilter	Trims leading and trailing whitespace from Tokens in the stream.
class	TruncateTokenFilter	A token filter for truncating the terms into a specific length.
class	TypeAsSynonymFilter	Adds the TypeAttribute.type() as a synonym, i.e.
class	WordDelimiterFilter	Deprecated. Use WordDelimiterGraphFilter instead: it produces a correct token graph so that e.g.
class	WordDelimiterGraphFilter	Splits words into subwords and performs optional transformations on subword groups, producing a correct token graph so that e.g.

Methods in org.apache.lucene.analysis.miscellaneous that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	WordDelimiterFilterFactory.create(TokenStream input)	Deprecated.
TokenFilter	WordDelimiterGraphFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.ngram

Subclasses of TokenFilter in org.apache.lucene.analysis.ngram

Modifier and Type	Class	Description
class	EdgeNGramTokenFilter	Tokenizes the given token into n-grams of given size(s).
class	NGramTokenFilter	Tokenizes the input into n-grams of the given size(s).

Methods in org.apache.lucene.analysis.ngram that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	EdgeNGramFilterFactory.create(TokenStream input)
TokenFilter	NGramFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.no

Subclasses of TokenFilter in org.apache.lucene.analysis.no

Modifier and Type	Class	Description
class	NorwegianLightStemFilter	A TokenFilter that applies NorwegianLightStemmer to stem Norwegian words.
class	NorwegianMinimalStemFilter	A TokenFilter that applies NorwegianMinimalStemmer to stem Norwegian words.

Uses of TokenFilter in org.apache.lucene.analysis.pattern

Subclasses of TokenFilter in org.apache.lucene.analysis.pattern

Modifier and Type	Class	Description
class	PatternCaptureGroupTokenFilter	CaptureGroup uses Java regexes to emit multiple tokens - one for each capture group in one or more patterns.
class	PatternReplaceFilter	A TokenFilter which applies a Pattern to each token in the stream, replacing match occurrences with the specified replacement string.

Uses of TokenFilter in org.apache.lucene.analysis.payloads

Subclasses of TokenFilter in org.apache.lucene.analysis.payloads

Modifier and Type	Class	Description
class	DelimitedPayloadTokenFilter	Characters before the delimiter are the "token", those after are the payload.
class	NumericPayloadTokenFilter	Assigns a payload to a token based on the TypeAttribute
class	TokenOffsetPayloadTokenFilter	Adds the OffsetAttribute.startOffset() and OffsetAttribute.endOffset() First 4 bytes are the start
class	TypeAsPayloadTokenFilter	Makes the TypeAttribute a payload.

Uses of TokenFilter in org.apache.lucene.analysis.phonetic

Subclasses of TokenFilter in org.apache.lucene.analysis.phonetic

Modifier and Type	Class	Description
class	BeiderMorseFilter	TokenFilter for Beider-Morse phonetic encoding.
class	DaitchMokotoffSoundexFilter	Create tokens for phonetic matches based on Daitch–Mokotoff Soundex.
class	DoubleMetaphoneFilter	Filter for DoubleMetaphone (supporting secondary codes)
class	PhoneticFilter	Create tokens for phonetic matches.

Uses of TokenFilter in org.apache.lucene.analysis.pt

Subclasses of TokenFilter in org.apache.lucene.analysis.pt

Modifier and Type	Class	Description
class	PortugueseLightStemFilter	A TokenFilter that applies PortugueseLightStemmer to stem Portuguese words.
class	PortugueseMinimalStemFilter	A TokenFilter that applies PortugueseMinimalStemmer to stem Portuguese words.
class	PortugueseStemFilter	A TokenFilter that applies PortugueseStemmer to stem Portuguese words.

Uses of TokenFilter in org.apache.lucene.analysis.reverse

Subclasses of TokenFilter in org.apache.lucene.analysis.reverse

Modifier and Type	Class	Description
class	ReverseStringFilter	Reverse token string, for example "country" => "yrtnuoc".

Uses of TokenFilter in org.apache.lucene.analysis.ru

Subclasses of TokenFilter in org.apache.lucene.analysis.ru

Modifier and Type	Class	Description
class	RussianLightStemFilter	A TokenFilter that applies RussianLightStemmer to stem Russian words.

Uses of TokenFilter in org.apache.lucene.analysis.shingle

Subclasses of TokenFilter in org.apache.lucene.analysis.shingle

Modifier and Type	Class	Description
class	FixedShingleFilter	A FixedShingleFilter constructs shingles (token n-grams) from a token stream.
class	ShingleFilter	A ShingleFilter constructs shingles (token n-grams) from a token stream.

Uses of TokenFilter in org.apache.lucene.analysis.sinks

Subclasses of TokenFilter in org.apache.lucene.analysis.sinks

Modifier and Type	Class	Description
class	TeeSinkTokenFilter	This TokenFilter provides the ability to set aside attribute states that have already been analyzed.

Uses of TokenFilter in org.apache.lucene.analysis.snowball

Subclasses of TokenFilter in org.apache.lucene.analysis.snowball

Modifier and Type	Class	Description
class	SnowballFilter	A filter that stems words using a Snowball-generated stemmer.

Methods in org.apache.lucene.analysis.snowball that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	SnowballPorterFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.sr

Subclasses of TokenFilter in org.apache.lucene.analysis.sr

Modifier and Type	Class	Description
class	SerbianNormalizationFilter	Normalizes Serbian Cyrillic and Latin characters to "bald" Latin.
class	SerbianNormalizationRegularFilter	Normalizes Serbian Cyrillic to Latin.

Uses of TokenFilter in org.apache.lucene.analysis.standard

Subclasses of TokenFilter in org.apache.lucene.analysis.standard

Modifier and Type	Class	Description
class	ClassicFilter	Normalizes tokens extracted with ClassicTokenizer.

Methods in org.apache.lucene.analysis.standard that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	ClassicFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.stempel

Subclasses of TokenFilter in org.apache.lucene.analysis.stempel

Modifier and Type	Class	Description
class	StempelFilter	Transforms the token stream as per the stemming algorithm.

Uses of TokenFilter in org.apache.lucene.analysis.sv

Subclasses of TokenFilter in org.apache.lucene.analysis.sv

Modifier and Type	Class	Description
class	SwedishLightStemFilter	A TokenFilter that applies SwedishLightStemmer to stem Swedish words.

Uses of TokenFilter in org.apache.lucene.analysis.synonym

Subclasses of TokenFilter in org.apache.lucene.analysis.synonym

Modifier and Type	Class	Description
class	SynonymFilter	Deprecated. Use SynonymGraphFilter instead, but be sure to also use FlattenGraphFilter at index time (not at search time) as well.
class	SynonymGraphFilter	Applies single- or multi-token synonyms from a SynonymMap to an incoming TokenStream, producing a fully correct graph output.

Uses of TokenFilter in org.apache.lucene.analysis.tr

Subclasses of TokenFilter in org.apache.lucene.analysis.tr

Modifier and Type	Class	Description
class	ApostropheFilter	Strips all characters after an apostrophe (including the apostrophe itself).
class	TurkishLowerCaseFilter	Normalizes Turkish token text to lower case.

Uses of TokenFilter in org.apache.lucene.analysis.util

Subclasses of TokenFilter in org.apache.lucene.analysis.util

Modifier and Type	Class	Description
class	ElisionFilter	Removes elisions from a TokenStream.

Uses of TokenFilter in org.apache.lucene.monitor

Subclasses of TokenFilter in org.apache.lucene.monitor

Modifier and Type	Class	Description
(package private) class	SuffixingNGramTokenFilter

Uses of TokenFilter in org.apache.lucene.search.highlight

Subclasses of TokenFilter in org.apache.lucene.search.highlight

Modifier and Type	Class	Description
(package private) class	LimitTokenOffsetFilter	This is a simplified version of org.apache.lucene.analysis.miscellaneous.LimitTokenOffsetFilter to prevent a dependency on analyzers-common.jar.
class	OffsetLimitTokenFilter	This TokenFilter limits the number of tokens while indexing by adding up the current offset.

Uses of TokenFilter in org.apache.lucene.search.suggest.analyzing

Subclasses of TokenFilter in org.apache.lucene.search.suggest.analyzing

Modifier and Type	Class	Description
class	SuggestStopFilter	Like StopFilter except it will not remove the last token if that token was not followed by some token separator.

Uses of TokenFilter in org.apache.lucene.search.suggest.document

Subclasses of TokenFilter in org.apache.lucene.search.suggest.document

Modifier and Type	Class	Description
class	CompletionTokenStream	A ConcatenateGraphFilter but we can set the payload and provide access to config options.
private static class	ContextSuggestField.PrefixTokenFilter	The ContextSuggestField.PrefixTokenFilter wraps a TokenStream and adds a set prefixes ahead.

Uses of TokenFilter in org.apache.lucene.search.uhighlight

Subclasses of TokenFilter in org.apache.lucene.search.uhighlight

Modifier and Type	Class	Description
private static class	AnalysisOffsetStrategy.MultiValueTokenStream	Wraps an Analyzer and string text that represents multiple values delimited by a specified character.