# Uses of Package
org.apache.lucene.analysis.tokenattributes

Packages that use org.apache.lucene.analysis.tokenattributes
Package
Description
org.apache.lucene.analysis.standard
Fast, general-purpose grammar-based tokenizer `StandardTokenizer` implements the Word Break rules from the Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.
org.apache.lucene.analysis.tokenattributes
General-purpose attributes for text analysis.

- Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.standard
  Class
  Description
  CharTermAttribute
  The term text of a Token.
- Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.tokenattributes
  Class
  Description
  BytesTermAttribute
  This attribute can be used if you have the raw term bytes to be indexed.
  CharTermAttribute
  The term text of a Token.
  CharTermAttributeImpl
  Default implementation of `CharTermAttribute`.
  FlagsAttribute
  This attribute can be used to pass different flags down the `Tokenizer` chain, e.g.
  KeywordAttribute
  This attribute can be used to mark a token as a keyword.
  OffsetAttribute
  The start and end character offset of a Token.
  PackedTokenAttributeImpl
  Default implementation of the common attributes used by Lucene: `CharTermAttribute` `TypeAttribute` `PositionIncrementAttribute` `PositionLengthAttribute` `OffsetAttribute` `TermFrequencyAttribute`
  PayloadAttribute
  The payload of a Token.
  PayloadAttributeImpl
  Default implementation of `PayloadAttribute`.
  PositionIncrementAttribute
  Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.
  PositionLengthAttribute
  Determines how many positions this token spans.
  SentenceAttribute
  This attribute tracks what sentence a given token belongs to as well as potentially other sentence specific attributes.
  TermFrequencyAttribute
  Sets the custom term frequency of a term within one document.
  TermToBytesRefAttribute
  This attribute is requested by TermsHashPerField to index the contents.
  TypeAttribute
  A Token's lexical type.