Package org.apache.iceberg.data

Class BaseWriterFactory<T>

java.lang.Object

org.apache.iceberg.data.BaseWriterFactory<T>

All Implemented Interfaces:

WriterFactory<T>

public abstract class BaseWriterFactory<T>
extends java.lang.Object
implements WriterFactory<T>

A base writer factory to be extended by query engine integrations.

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	BaseWriterFactory(Table table, FileFormat dataFileFormat, Schema dataSchema, SortOrder dataSortOrder, FileFormat deleteFileFormat, int[] equalityFieldIds, Schema equalityDeleteRowSchema, SortOrder equalityDeleteSortOrder, Schema positionDeleteRowSchema)

Method Summary

Modifier and Type	Method	Description
protected abstract void	configureDataWrite(Avro.DataWriteBuilder builder)
protected abstract void	configureDataWrite(ORC.DataWriteBuilder builder)
protected abstract void	configureDataWrite(Parquet.DataWriteBuilder builder)
protected abstract void	configureEqualityDelete(Avro.DeleteWriteBuilder builder)
protected abstract void	configureEqualityDelete(Parquet.DeleteWriteBuilder builder)
protected abstract void	configurePositionDelete(Avro.DeleteWriteBuilder builder)
protected abstract void	configurePositionDelete(Parquet.DeleteWriteBuilder builder)
protected Schema	dataSchema()
protected Schema	equalityDeleteRowSchema()
DataWriter<T>	newDataWriter(EncryptedOutputFile file, PartitionSpec spec, StructLike partition)	Creates a new DataWriter.
EqualityDeleteWriter<T>	newEqualityDeleteWriter(EncryptedOutputFile file, PartitionSpec spec, StructLike partition)	Creates a new EqualityDeleteWriter.
PositionDeleteWriter<T>	newPositionDeleteWriter(EncryptedOutputFile file, PartitionSpec spec, StructLike partition)	Creates a new PositionDeleteWriter.
protected Schema	positionDeleteRowSchema()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BaseWriterFactory

protected BaseWriterFactory(Table table,
                            FileFormat dataFileFormat,
                            Schema dataSchema,
                            SortOrder dataSortOrder,
                            FileFormat deleteFileFormat,
                            int[] equalityFieldIds,
                            Schema equalityDeleteRowSchema,
                            SortOrder equalityDeleteSortOrder,
                            Schema positionDeleteRowSchema)

Method Detail

configureDataWrite

protected abstract void configureDataWrite(Avro.DataWriteBuilder builder)

configureEqualityDelete

protected abstract void configureEqualityDelete(Avro.DeleteWriteBuilder builder)

configurePositionDelete

protected abstract void configurePositionDelete(Avro.DeleteWriteBuilder builder)

configureDataWrite

protected abstract void configureDataWrite(Parquet.DataWriteBuilder builder)

configureEqualityDelete

protected abstract void configureEqualityDelete(Parquet.DeleteWriteBuilder builder)

configurePositionDelete

protected abstract void configurePositionDelete(Parquet.DeleteWriteBuilder builder)

configureDataWrite

protected abstract void configureDataWrite(ORC.DataWriteBuilder builder)

newDataWriter

public DataWriter<T> newDataWriter(EncryptedOutputFile file,
                                   PartitionSpec spec,
                                   StructLike partition)

Description copied from interface: WriterFactory

Creates a new DataWriter.

Specified by:

newDataWriter in interface WriterFactory<T>

Parameters:

file - the output file

spec - the partition spec written data belongs to

partition - the partition written data belongs to or null if the spec is unpartitioned

Returns:

the constructed data writer

newEqualityDeleteWriter

public EqualityDeleteWriter<T> newEqualityDeleteWriter(EncryptedOutputFile file,
                                                       PartitionSpec spec,
                                                       StructLike partition)

Description copied from interface: WriterFactory

Creates a new EqualityDeleteWriter.

Specified by:

newEqualityDeleteWriter in interface WriterFactory<T>

Parameters:

file - the output file

spec - the partition spec written deletes belong to

partition - the partition written deletes belong to or null if the spec is unpartitioned

Returns:

the constructed equality delete writer

newPositionDeleteWriter

public PositionDeleteWriter<T> newPositionDeleteWriter(EncryptedOutputFile file,
                                                       PartitionSpec spec,
                                                       StructLike partition)

Description copied from interface: WriterFactory

Creates a new PositionDeleteWriter.

Specified by:

newPositionDeleteWriter in interface WriterFactory<T>

Parameters:

file - the output file

spec - the partition spec written deletes belong to

partition - the partition written deletes belong to or null if the spec is unpartitioned

Returns:

the constructed position delete writer

dataSchema

protected Schema dataSchema()

equalityDeleteRowSchema

protected Schema equalityDeleteRowSchema()

positionDeleteRowSchema

protected Schema positionDeleteRowSchema()