Package org.apache.iceberg.io

Class FanoutDataWriter<T>

java.lang.Object

org.apache.iceberg.io.FanoutDataWriter<T>

All Implemented Interfaces:

Closeable, AutoCloseable, PartitioningWriter<T,DataWriteResult>

public class FanoutDataWriter<T>
extends Object

A data writer capable of writing to multiple specs and partitions that keeps data writers for each seen spec/partition pair open until this writer is closed.

Constructor Summary

Constructors

Constructor	Description
FanoutDataWriter(FileWriterFactory<T> writerFactory, OutputFileFactory fileFactory, FileIO io, long targetFileSizeInBytes)

Method Summary

Modifier and Type	Method	Description
protected void	addResult(DataWriteResult result)
protected DataWriteResult	aggregatedResult()
void	close()
protected FileWriter<T,DataWriteResult>	newWriter(PartitionSpec spec, StructLike partition)
final DataWriteResult	result()	Returns a result that contains information about written DataFiles or DeleteFiles.
void	write(T row, PartitionSpec spec, StructLike partition)	Writes a row to the provided spec/partition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FanoutDataWriter

public FanoutDataWriter(FileWriterFactory<T> writerFactory,
 OutputFileFactory fileFactory,
 FileIO io,
 long targetFileSizeInBytes)

Method Details

newWriter

protected FileWriter<T,DataWriteResult> newWriter(PartitionSpec spec,
 StructLike partition)

addResult

protected void addResult(DataWriteResult result)

aggregatedResult

protected DataWriteResult aggregatedResult()

write

public void write(T row,
 PartitionSpec spec,
 StructLike partition)

Description copied from interface: PartitioningWriter

Writes a row to the provided spec/partition.

Specified by:

write in interface PartitioningWriter<T,R>

Parameters:

row - a data or delete record

spec - a partition spec

partition - a partition or null if the spec is unpartitioned

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Throws:

IOException

result

public final DataWriteResult result()

Description copied from interface: PartitioningWriter

Returns a result that contains information about written DataFiles or DeleteFiles. The result is valid only after the writer is closed.

Specified by:

result in interface PartitioningWriter<T,R>

Returns:

the writer result