|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.lucene.benchmark.byTask.feeds.ContentSource org.apache.lucene.benchmark.byTask.feeds.LineDocSource
public class LineDocSource
A ContentSource
reading one line at a time as a
Document
from a single file. This saves IO
cost (over DirContentSource) of recursing through a directory and opening a
new file for every document.
The expected format of each line is (arguments are separated by <TAB>):
title, date, body. If a line is read in a different format, a
RuntimeException
will be thrown. In general, you should use this
content source for files that were created with WriteLineDocTask
.
Config properties:
LineDocSource.HeaderLineParser
if a header line exists which differs
from WriteLineDocTask.DEFAULT_FIELDS
and to LineDocSource.SimpleLineParser
otherwise.
Nested Class Summary | |
---|---|
static class |
LineDocSource.HeaderLineParser
LineDocSource.LineParser which sets field names and order by
the header - any header - of the lines file. |
static class |
LineDocSource.LineParser
Reader of a single input line into DocData . |
static class |
LineDocSource.SimpleLineParser
LineDocSource.LineParser which ignores the header passed to its constructor
and assumes simply that field names and their order are the same
as in WriteLineDocTask.DEFAULT_FIELDS |
Field Summary |
---|
Fields inherited from class org.apache.lucene.benchmark.byTask.feeds.ContentSource |
---|
encoding, forever, logStep, verbose |
Constructor Summary | |
---|---|
LineDocSource()
|
Method Summary | |
---|---|
void |
close()
Called when reading from this content source is no longer required. |
DocData |
getNextDocData(DocData docData)
Returns the next DocData from the content source. |
void |
resetInputs()
Resets the input for this content source, so that the test would behave as if it was just started, input-wise. |
void |
setConfig(Config config)
Sets the Config for this content source. |
Methods inherited from class org.apache.lucene.benchmark.byTask.feeds.ContentSource |
---|
addBytes, addDoc, collectFiles, getBytesCount, getConfig, getDocsCount, getTotalBytesCount, getTotalDocsCount, shouldLog |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public LineDocSource()
Method Detail |
---|
public void close() throws IOException
ContentSource
close
in class ContentSource
IOException
public DocData getNextDocData(DocData docData) throws NoMoreDataException, IOException
ContentSource
DocData
from the content source.
getNextDocData
in class ContentSource
NoMoreDataException
IOException
public void resetInputs() throws IOException
ContentSource
NOTE: the default implementation resets the number of bytes and documents generated since the last reset, so it's important to call super.resetInputs in case you override this method.
resetInputs
in class ContentSource
IOException
public void setConfig(Config config)
ContentSource
Config
for this content source. If you override this
method, you must call super.setConfig.
setConfig
in class ContentSource
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |