Package org.apache.iceberg.io

Class FanoutPositionOnlyDeleteWriter<T>

java.lang.Object

org.apache.iceberg.io.FanoutPositionOnlyDeleteWriter<T>

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, PartitioningWriter<PositionDelete<T>,DeleteWriteResult>

public class FanoutPositionOnlyDeleteWriter<T>
extends java.lang.Object

A position delete writer capable of writing to multiple specs and partitions if the incoming stream of deletes is not ordered. If the incoming records are ordered by an external process, use ClusteredPositionDeleteWriter instead.

Note this writer stores only positions. It does not store deleted records.

Constructor Summary

Constructors

Constructor	Description
FanoutPositionOnlyDeleteWriter(FileWriterFactory<T> writerFactory, OutputFileFactory fileFactory, FileIO io, long targetFileSizeInBytes)
FanoutPositionOnlyDeleteWriter(FileWriterFactory<T> writerFactory, OutputFileFactory fileFactory, FileIO io, long targetFileSizeInBytes, DeleteGranularity granularity)
FanoutPositionOnlyDeleteWriter(FileWriterFactory<T> writerFactory, OutputFileFactory fileFactory, FileIO io, long targetFileSizeInBytes, DeleteGranularity granularity, java.util.function.Function<java.lang.CharSequence,PositionDeleteIndex> loadPreviousDeletes)

Method Summary

Modifier and Type	Method	Description
protected void	addResult(DeleteWriteResult result)
protected DeleteWriteResult	aggregatedResult()
void	close()
protected FileWriter<PositionDelete<T>,DeleteWriteResult>	newWriter(PartitionSpec spec, StructLike partition)
R	result()	Returns a result that contains information about written DataFiles or DeleteFiles.
void	write(T row, PartitionSpec spec, StructLike partition)	Writes a row to the provided spec/partition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FanoutPositionOnlyDeleteWriter

public FanoutPositionOnlyDeleteWriter(FileWriterFactory<T> writerFactory,
                                      OutputFileFactory fileFactory,
                                      FileIO io,
                                      long targetFileSizeInBytes)

FanoutPositionOnlyDeleteWriter

public FanoutPositionOnlyDeleteWriter(FileWriterFactory<T> writerFactory,
                                      OutputFileFactory fileFactory,
                                      FileIO io,
                                      long targetFileSizeInBytes,
                                      DeleteGranularity granularity)

FanoutPositionOnlyDeleteWriter

public FanoutPositionOnlyDeleteWriter(FileWriterFactory<T> writerFactory,
                                      OutputFileFactory fileFactory,
                                      FileIO io,
                                      long targetFileSizeInBytes,
                                      DeleteGranularity granularity,
                                      java.util.function.Function<java.lang.CharSequence,PositionDeleteIndex> loadPreviousDeletes)

Method Detail

newWriter

protected FileWriter<PositionDelete<T>,DeleteWriteResult> newWriter(PartitionSpec spec,
                                                                          StructLike partition)

addResult

protected void addResult(DeleteWriteResult result)

aggregatedResult

protected DeleteWriteResult aggregatedResult()

write

public void write(T row,
                  PartitionSpec spec,
                  StructLike partition)

Description copied from interface: PartitioningWriter

Writes a row to the provided spec/partition.

Specified by:

write in interface PartitioningWriter<T,R>

Parameters:

row - a data or delete record

spec - a partition spec

partition - a partition or null if the spec is unpartitioned

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Throws:

java.io.IOException

result

public final R result()

Description copied from interface: PartitioningWriter

Returns a result that contains information about written DataFiles or DeleteFiles. The result is valid only after the writer is closed.

Specified by:

result in interface PartitioningWriter<T,R>

Returns:

the writer result