Package org.apache.lucene.store
Class ByteBuffersDirectory
- java.lang.Object
-
- org.apache.lucene.store.Directory
-
- org.apache.lucene.store.BaseDirectory
-
- org.apache.lucene.store.ByteBuffersDirectory
-
- All Implemented Interfaces:
java.io.Closeable,java.lang.AutoCloseable
public final class ByteBuffersDirectory extends BaseDirectory
AByteBuffer-basedDirectoryimplementation that can be used to store index files on the heap.Important: Note that
MMapDirectoryis nearly always a better choice as it uses OS caches more effectively (through memory-mapped buffers). A heap-based directory like this one can have the advantage in case of ephemeral, small, short-lived indexes when disk syncs provide an additional overhead.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description private classByteBuffersDirectory.FileEntry
-
Field Summary
Fields Modifier and Type Field Description private java.util.function.Supplier<ByteBuffersDataOutput>bbOutputSupplierA supplier ofByteBuffersDataOutputinstances used to buffer up the content of written files.private java.util.concurrent.ConcurrentHashMap<java.lang.String,ByteBuffersDirectory.FileEntry>filesstatic java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput>OUTPUT_AS_BYTE_ARRAYstatic java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput>OUTPUT_AS_MANY_BUFFERSstatic java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput>OUTPUT_AS_MANY_BUFFERS_LUCENEstatic java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput>OUTPUT_AS_ONE_BUFFERprivate java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput>outputToInputConversion between a buffered index output and the corresponding index input for a given file.private java.util.function.Function<java.lang.String,java.lang.String>tempFileName-
Fields inherited from class org.apache.lucene.store.BaseDirectory
isOpen, lockFactory
-
-
Constructor Summary
Constructors Constructor Description ByteBuffersDirectory()ByteBuffersDirectory(LockFactory lockFactory)ByteBuffersDirectory(LockFactory factory, java.util.function.Supplier<ByteBuffersDataOutput> bbOutputSupplier, java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput> outputToInput)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description voidclose()Closes the directory.IndexOutputcreateOutput(java.lang.String name, IOContext context)Creates a new, empty file in the directory and returns anIndexOutputinstance for appending data to this file.IndexOutputcreateTempOutput(java.lang.String prefix, java.lang.String suffix, IOContext context)Creates a new, empty, temporary file in the directory and returns anIndexOutputinstance for appending data to this file.voiddeleteFile(java.lang.String name)Removes an existing file in the directory.longfileLength(java.lang.String name)Returns the byte length of a file in the directory.java.util.Set<java.lang.String>getPendingDeletions()Returns a set of files currently pending deletion in this directory.java.lang.String[]listAll()Returns names of all files stored in this directory.IndexInputopenInput(java.lang.String name, IOContext context)Opens a stream for reading an existing file.voidrename(java.lang.String source, java.lang.String dest)Renamessourcefile todestfile wheredestmust not already exist in the directory.voidsync(java.util.Collection<java.lang.String> names)Ensures that any writes to these files are moved to stable storage (made durable).voidsyncMetaData()Ensures that directory metadata, such as recent file renames, are moved to stable storage.-
Methods inherited from class org.apache.lucene.store.BaseDirectory
ensureOpen, obtainLock, toString
-
Methods inherited from class org.apache.lucene.store.Directory
copyFrom, getTempFileName, openChecksumInput
-
-
-
-
Field Detail
-
OUTPUT_AS_MANY_BUFFERS
public static final java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput> OUTPUT_AS_MANY_BUFFERS
-
OUTPUT_AS_ONE_BUFFER
public static final java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput> OUTPUT_AS_ONE_BUFFER
-
OUTPUT_AS_BYTE_ARRAY
public static final java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput> OUTPUT_AS_BYTE_ARRAY
-
OUTPUT_AS_MANY_BUFFERS_LUCENE
public static final java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput> OUTPUT_AS_MANY_BUFFERS_LUCENE
-
tempFileName
private final java.util.function.Function<java.lang.String,java.lang.String> tempFileName
-
files
private final java.util.concurrent.ConcurrentHashMap<java.lang.String,ByteBuffersDirectory.FileEntry> files
-
outputToInput
private final java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput> outputToInput
Conversion between a buffered index output and the corresponding index input for a given file.
-
bbOutputSupplier
private final java.util.function.Supplier<ByteBuffersDataOutput> bbOutputSupplier
A supplier ofByteBuffersDataOutputinstances used to buffer up the content of written files.
-
-
Constructor Detail
-
ByteBuffersDirectory
public ByteBuffersDirectory()
-
ByteBuffersDirectory
public ByteBuffersDirectory(LockFactory lockFactory)
-
ByteBuffersDirectory
public ByteBuffersDirectory(LockFactory factory, java.util.function.Supplier<ByteBuffersDataOutput> bbOutputSupplier, java.util.function.BiFunction<java.lang.String,ByteBuffersDataOutput,IndexInput> outputToInput)
-
-
Method Detail
-
listAll
public java.lang.String[] listAll() throws java.io.IOExceptionDescription copied from class:DirectoryReturns names of all files stored in this directory. The output must be in sorted (UTF-16, java'sString.compareTo(java.lang.String)) order.
-
deleteFile
public void deleteFile(java.lang.String name) throws java.io.IOExceptionDescription copied from class:DirectoryRemoves an existing file in the directory. This method must throw eitherNoSuchFileExceptionorFileNotFoundExceptionifnamepoints to a non-existing file.- Specified by:
deleteFilein classDirectory- Parameters:
name- the name of an existing file.- Throws:
java.io.IOException- in case of I/O error
-
fileLength
public long fileLength(java.lang.String name) throws java.io.IOExceptionDescription copied from class:DirectoryReturns the byte length of a file in the directory. This method must throw eitherNoSuchFileExceptionorFileNotFoundExceptionifnamepoints to a non-existing file.- Specified by:
fileLengthin classDirectory- Parameters:
name- the name of an existing file.- Throws:
java.io.IOException- in case of I/O error
-
createOutput
public IndexOutput createOutput(java.lang.String name, IOContext context) throws java.io.IOException
Description copied from class:DirectoryCreates a new, empty file in the directory and returns anIndexOutputinstance for appending data to this file. This method must throwFileAlreadyExistsExceptionif the file already exists.- Specified by:
createOutputin classDirectory- Parameters:
name- the name of the file to create.- Throws:
java.io.IOException- in case of I/O error
-
createTempOutput
public IndexOutput createTempOutput(java.lang.String prefix, java.lang.String suffix, IOContext context) throws java.io.IOException
Description copied from class:DirectoryCreates a new, empty, temporary file in the directory and returns anIndexOutputinstance for appending data to this file. The temporary file name (accessible viaIndexOutput.getName()) will start withprefix, end withsuffixand have a reserved file extension.tmp.- Specified by:
createTempOutputin classDirectory- Throws:
java.io.IOException
-
rename
public void rename(java.lang.String source, java.lang.String dest) throws java.io.IOExceptionDescription copied from class:DirectoryRenamessourcefile todestfile wheredestmust not already exist in the directory. It is permitted for this operation to not be truly atomic, for example bothsourceanddestcan be visible temporarily inDirectory.listAll(). However, the implementation of this method must ensure the content ofdestappears as the entiresourceatomically. So oncedestis visible for readers, the entire content of previoussourceis visible. This method is used by IndexWriter to publish commits.
-
sync
public void sync(java.util.Collection<java.lang.String> names) throws java.io.IOExceptionDescription copied from class:DirectoryEnsures that any writes to these files are moved to stable storage (made durable). Lucene uses this to properly commit changes to the index, to prevent a machine/OS crash from corrupting the index.- Specified by:
syncin classDirectory- Throws:
java.io.IOException- See Also:
Directory.syncMetaData()
-
syncMetaData
public void syncMetaData() throws java.io.IOExceptionDescription copied from class:DirectoryEnsures that directory metadata, such as recent file renames, are moved to stable storage.- Specified by:
syncMetaDatain classDirectory- Throws:
java.io.IOException- See Also:
Directory.sync(Collection)
-
openInput
public IndexInput openInput(java.lang.String name, IOContext context) throws java.io.IOException
Description copied from class:DirectoryOpens a stream for reading an existing file. This method must throw eitherNoSuchFileExceptionorFileNotFoundExceptionifnamepoints to a non-existing file.
-
close
public void close() throws java.io.IOExceptionDescription copied from class:DirectoryCloses the directory.
-
getPendingDeletions
public java.util.Set<java.lang.String> getPendingDeletions()
Description copied from class:DirectoryReturns a set of files currently pending deletion in this directory.- Specified by:
getPendingDeletionsin classDirectory
-
-