public class LiveIndexWriterConfig extends Object
IndexWriter with few setters for
settings that can be changed on an IndexWriter instance "live".| Modifier and Type | Field and Description |
|---|---|
protected Codec |
codec
Codec used to write new segments. |
protected IndexCommit |
commit
IndexCommit that IndexWriter is
opened on. |
protected boolean |
commitOnClose
True if calls to
IndexWriter.close() should first do a commit. |
protected IndexDeletionPolicy |
delPolicy
IndexDeletionPolicy controlling when commit
points are deleted. |
protected org.apache.lucene.index.FlushPolicy |
flushPolicy
FlushPolicy to control when segments are
flushed. |
protected org.apache.lucene.index.DocumentsWriterPerThreadPool |
indexerThreadPool
DocumentsWriterPerThreadPool to control how
threads are allocated to DocumentsWriterPerThread. |
protected org.apache.lucene.index.DocumentsWriterPerThread.IndexingChain |
indexingChain
DocumentsWriterPerThread.IndexingChain that determines how documents are
indexed. |
protected Sort |
indexSort
The sort order to use to write merged segments.
|
protected Set<String> |
indexSortFields
The field names involved in the index sort
|
protected InfoStream |
infoStream
InfoStream for debugging messages. |
protected MergePolicy |
mergePolicy
MergePolicy for selecting merges. |
protected MergeScheduler |
mergeScheduler
MergeScheduler to use for running merges. |
protected IndexWriterConfig.OpenMode |
openMode
IndexWriterConfig.OpenMode that IndexWriter is opened
with. |
protected int |
perThreadHardLimitMB
Sets the hard upper bound on RAM usage for a single
segment, after which the segment is forced to flush.
|
protected boolean |
readerPooling
True if readers should be pooled.
|
protected Similarity |
similarity
Similarity to use when encoding norms. |
protected boolean |
useCompoundFile
True if segment flushes should use compound file format
|
| Modifier and Type | Method and Description |
|---|---|
Analyzer |
getAnalyzer()
Returns the default analyzer to use for indexing documents.
|
Codec |
getCodec()
Returns the current
Codec. |
boolean |
getCommitOnClose()
Returns
true if IndexWriter.close() should first commit before closing. |
IndexCommit |
getIndexCommit()
Returns the
IndexCommit as specified in
IndexWriterConfig.setIndexCommit(IndexCommit) or the default,
null which specifies to open the latest index commit point. |
IndexDeletionPolicy |
getIndexDeletionPolicy()
Returns the
IndexDeletionPolicy specified in
IndexWriterConfig.setIndexDeletionPolicy(IndexDeletionPolicy) or
the default KeepOnlyLastCommitDeletionPolicy/ |
Sort |
getIndexSort()
Set the index-time
Sort order. |
Set<String> |
getIndexSortFields()
Returns the field names involved in the index sort
|
InfoStream |
getInfoStream()
Returns
InfoStream used for debugging. |
int |
getMaxBufferedDocs()
Returns the number of buffered added documents that will trigger a flush if
enabled.
|
IndexWriter.IndexReaderWarmer |
getMergedSegmentWarmer()
Returns the current merged segment warmer.
|
MergePolicy |
getMergePolicy()
Returns the current MergePolicy in use by this writer.
|
MergeScheduler |
getMergeScheduler()
Returns the
MergeScheduler that was set by
IndexWriterConfig.setMergeScheduler(MergeScheduler). |
IndexWriterConfig.OpenMode |
getOpenMode()
Returns the
IndexWriterConfig.OpenMode set by IndexWriterConfig.setOpenMode(OpenMode). |
double |
getRAMBufferSizeMB()
Returns the value set by
setRAMBufferSizeMB(double) if enabled. |
int |
getRAMPerThreadHardLimitMB()
Returns the max amount of memory each
DocumentsWriterPerThread can
consume until forcefully flushed. |
boolean |
getReaderPooling()
Returns
true if IndexWriter should pool readers even if
DirectoryReader.open(IndexWriter) has not been called. |
Similarity |
getSimilarity()
Expert: returns the
Similarity implementation used by this
IndexWriter. |
boolean |
getUseCompoundFile()
Returns
true iff the IndexWriter packs
newly written segments in a compound file. |
LiveIndexWriterConfig |
setMaxBufferedDocs(int maxBufferedDocs)
Determines the minimal number of documents required before the buffered
in-memory documents are flushed as a new Segment.
|
LiveIndexWriterConfig |
setMergedSegmentWarmer(IndexWriter.IndexReaderWarmer mergeSegmentWarmer)
Set the merged segment warmer.
|
LiveIndexWriterConfig |
setMergePolicy(MergePolicy mergePolicy)
Expert:
MergePolicy is invoked whenever there are changes to the
segments in the index. |
LiveIndexWriterConfig |
setRAMBufferSizeMB(double ramBufferSizeMB)
Determines the amount of RAM that may be used for buffering added documents
and deletions before they are flushed to the Directory.
|
LiveIndexWriterConfig |
setUseCompoundFile(boolean useCompoundFile)
Sets if the
IndexWriter should pack newly written segments in a
compound file. |
String |
toString() |
protected volatile IndexDeletionPolicy delPolicy
IndexDeletionPolicy controlling when commit
points are deleted.protected volatile IndexCommit commit
IndexCommit that IndexWriter is
opened on.protected volatile IndexWriterConfig.OpenMode openMode
IndexWriterConfig.OpenMode that IndexWriter is opened
with.protected volatile Similarity similarity
Similarity to use when encoding norms.protected volatile MergeScheduler mergeScheduler
MergeScheduler to use for running merges.protected volatile org.apache.lucene.index.DocumentsWriterPerThread.IndexingChain indexingChain
DocumentsWriterPerThread.IndexingChain that determines how documents are
indexed.protected volatile InfoStream infoStream
InfoStream for debugging messages.protected volatile MergePolicy mergePolicy
MergePolicy for selecting merges.protected volatile org.apache.lucene.index.DocumentsWriterPerThreadPool indexerThreadPool
DocumentsWriterPerThreadPool to control how
threads are allocated to DocumentsWriterPerThread.protected volatile boolean readerPooling
protected volatile org.apache.lucene.index.FlushPolicy flushPolicy
FlushPolicy to control when segments are
flushed.protected volatile int perThreadHardLimitMB
protected volatile boolean useCompoundFile
protected boolean commitOnClose
IndexWriter.close() should first do a commit.protected Sort indexSort
public Analyzer getAnalyzer()
public LiveIndexWriterConfig setRAMBufferSizeMB(double ramBufferSizeMB)
When this is set, the writer will flush whenever buffered documents and
deletions use this much RAM. Pass in
IndexWriterConfig.DISABLE_AUTO_FLUSH to prevent triggering a flush
due to RAM usage. Note that if flushing by document count is also enabled,
then the flush will be triggered by whichever comes first.
The maximum RAM limit is inherently determined by the JVMs available
memory. Yet, an IndexWriter session can consume a significantly
larger amount of memory than the given RAM limit since this limit is just
an indicator when to flush memory resident documents to the Directory.
Flushes are likely happen concurrently while other threads adding documents
to the writer. For application stability the available memory in the JVM
should be significantly larger than the RAM buffer used for indexing.
NOTE: the account of RAM usage for pending deletions is only approximate. Specifically, if you delete by Query, Lucene currently has no way to measure the RAM usage of individual Queries so the accounting will under-estimate and you should compensate by either calling commit() or refresh() periodically yourself.
NOTE: It's not guaranteed that all memory resident documents are
flushed once this limit is exceeded. Depending on the configured
FlushPolicy only a subset of the buffered documents are flushed and
therefore only parts of the RAM buffer is released.
The default value is IndexWriterConfig.DEFAULT_RAM_BUFFER_SIZE_MB.
Takes effect immediately, but only the next time a document is added, updated or deleted.
IllegalArgumentException - if ramBufferSize is enabled but non-positive, or it disables
ramBufferSize when maxBufferedDocs is already disabledIndexWriterConfig.setRAMPerThreadHardLimitMB(int)public double getRAMBufferSizeMB()
setRAMBufferSizeMB(double) if enabled.public LiveIndexWriterConfig setMaxBufferedDocs(int maxBufferedDocs)
When this is set, the writer will flush every maxBufferedDocs added
documents. Pass in IndexWriterConfig.DISABLE_AUTO_FLUSH to prevent
triggering a flush due to number of buffered documents. Note that if
flushing by RAM usage is also enabled, then the flush will be triggered by
whichever comes first.
Disabled by default (writer flushes by RAM usage).
Takes effect immediately, but only the next time a document is added, updated or deleted.
IllegalArgumentException - if maxBufferedDocs is enabled but smaller than 2, or it disables
maxBufferedDocs when ramBufferSize is already disabledsetRAMBufferSizeMB(double)public int getMaxBufferedDocs()
setMaxBufferedDocs(int)public LiveIndexWriterConfig setMergePolicy(MergePolicy mergePolicy)
MergePolicy is invoked whenever there are changes to the
segments in the index. Its role is to select which merges to do, if any,
and return a MergePolicy.MergeSpecification describing the merges.
It also selects merges to do for forceMerge.
Takes effect on subsequent merge selections. Any merges in flight or any
merges already registered by the previous MergePolicy are not
affected.
public LiveIndexWriterConfig setMergedSegmentWarmer(IndexWriter.IndexReaderWarmer mergeSegmentWarmer)
IndexWriter.IndexReaderWarmer.
Takes effect on the next merge.
public IndexWriter.IndexReaderWarmer getMergedSegmentWarmer()
IndexWriter.IndexReaderWarmer.public IndexWriterConfig.OpenMode getOpenMode()
IndexWriterConfig.OpenMode set by IndexWriterConfig.setOpenMode(OpenMode).public IndexDeletionPolicy getIndexDeletionPolicy()
IndexDeletionPolicy specified in
IndexWriterConfig.setIndexDeletionPolicy(IndexDeletionPolicy) or
the default KeepOnlyLastCommitDeletionPolicy/public IndexCommit getIndexCommit()
IndexCommit as specified in
IndexWriterConfig.setIndexCommit(IndexCommit) or the default,
null which specifies to open the latest index commit point.public Similarity getSimilarity()
Similarity implementation used by this
IndexWriter.public MergeScheduler getMergeScheduler()
MergeScheduler that was set by
IndexWriterConfig.setMergeScheduler(MergeScheduler).public MergePolicy getMergePolicy()
public boolean getReaderPooling()
true if IndexWriter should pool readers even if
DirectoryReader.open(IndexWriter) has not been called.public int getRAMPerThreadHardLimitMB()
DocumentsWriterPerThread can
consume until forcefully flushed.public InfoStream getInfoStream()
InfoStream used for debugging.public LiveIndexWriterConfig setUseCompoundFile(boolean useCompoundFile)
IndexWriter should pack newly written segments in a
compound file. Default is true.
Use false for batch indexing with very large ram buffer
settings.
Note: To control compound file usage during segment merges see
MergePolicy.setNoCFSRatio(double) and
MergePolicy.setMaxCFSSegmentSizeMB(double). This setting only
applies to newly created segments.
public boolean getUseCompoundFile()
public boolean getCommitOnClose()
true if IndexWriter.close() should first commit before closing.public Sort getIndexSort()
Sort order. Merged segments will be written
in this order.public Set<String> getIndexSortFields()
Copyright © 2000-2017 Apache Software Foundation. All Rights Reserved.