#define LUCENE_CLASS(Name)
Definition LuceneObject.h:24
An Analyzer builds TokenStreams, which analyze text. It thus represents a policy for extracting index...
Definition Analyzer.h:19
virtual void setPreviousTokenStream(const LuceneObjectPtr &stream)
Used by Analyzers that implement reusableTokenStream to save a TokenStream for later re-use by the sa...
virtual int32_t getOffsetGap(const FieldablePtr &field)
Just like getPositionIncrementGap, except for Token offsets instead. By default this returns 1 for to...
virtual int32_t getPositionIncrementGap(const String &fieldName)
Invoked before indexing a Fieldable instance if terms have already been added to that field....
virtual TokenStreamPtr reusableTokenStream(const String &fieldName, const ReaderPtr &reader)
Creates a TokenStream that is allowed to be re-used from the previous time that the same thread calle...
virtual TokenStreamPtr tokenStream(const String &fieldName, const ReaderPtr &reader)=0
Creates a TokenStream which tokenizes all the text in the provided Reader. Must be able to handle nul...
virtual void close()
Frees persistent resources used by this Analyzer.
virtual LuceneObjectPtr getPreviousTokenStream()
Used by Analyzers that implement reusableTokenStream to retrieve previously saved TokenStreams for re...
CloseableThreadLocal< LuceneObject > tokenStreams
Definition Analyzer.h:25
General purpose thread-local map.
Definition CloseableThreadLocal.h:16
Base class for all Lucene classes.
Definition LuceneObject.h:31
Definition AbstractAllTermDocs.h:12
boost::shared_ptr< LuceneObject > LuceneObjectPtr
Definition LuceneTypes.h:539
boost::shared_ptr< Fieldable > FieldablePtr
Definition LuceneTypes.h:76
boost::shared_ptr< TokenStream > TokenStreamPtr
Definition LuceneTypes.h:63
boost::shared_ptr< Reader > ReaderPtr
Definition LuceneTypes.h:547