Package org.apache.iceberg.arrow.vectorized

Class GenericArrowVectorAccessorFactory<DecimalT,Utf8StringT,ArrayT,ChildVectorT extends AutoCloseable>

java.lang.Object

org.apache.iceberg.arrow.vectorized.GenericArrowVectorAccessorFactory<DecimalT,Utf8StringT,ArrayT,ChildVectorT>

Type Parameters:

DecimalT - A concrete type that can represent a decimal.

Utf8StringT - A concrete type that can represent a UTF8 string.

ArrayT - A concrete type that can represent an array value in a list vector, e.g. Spark's ColumnarArray.

ChildVectorT - A concrete type that can represent a child vector in a struct, e.g. Spark's ArrowColumnVector.

public class GenericArrowVectorAccessorFactory<DecimalT,Utf8StringT,ArrayT,ChildVectorT extends AutoCloseable>
extends Object

This class is creates typed ArrowVectorAccessor from VectorHolder. It provides a generic implementation for following Arrow types:

• Decimal type can be deserialized to a type that supports decimal, e.g. BigDecimal or Spark's Decimal.
• UTF8 String type can deserialized to a Java String or Spark's UTF8String.
• List type: the child elements of a list can be deserialized to Spark's ColumnarArray or similar type.
• Struct type: the child elements of a struct can be deserialized to a Spark's ArrowColumnVector or similar type.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
protected static interface	GenericArrowVectorAccessorFactory.ArrayFactory<ChildVectorT,ArrayT>	Create an array value of type ArrayT from arrow vector value.
protected static interface	GenericArrowVectorAccessorFactory.DecimalFactory<DecimalT>	Create a decimal value of type DecimalT from arrow vector value.
protected static interface	GenericArrowVectorAccessorFactory.StringFactory<Utf8StringT>	Create a UTF8 String value of type Utf8StringT from arrow vector value.
protected static interface	GenericArrowVectorAccessorFactory.StructChildFactory<ChildVectorT>	Create a struct child vector of type ChildVectorT from arrow vector value.

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	GenericArrowVectorAccessorFactory(Supplier<GenericArrowVectorAccessorFactory.DecimalFactory<DecimalT>> decimalFactorySupplier, Supplier<GenericArrowVectorAccessorFactory.StringFactory<Utf8StringT>> stringFactorySupplier, Supplier<GenericArrowVectorAccessorFactory.StructChildFactory<ChildVectorT>> structChildFactorySupplier, Supplier<GenericArrowVectorAccessorFactory.ArrayFactory<ChildVectorT,ArrayT>> arrayFactorySupplier)	The constructor is parameterized using the decimal, string, struct and array factories.

Method Summary

Modifier and Type	Method	Description
ArrowVectorAccessor<DecimalT,Utf8StringT,ArrayT,ChildVectorT>	getVectorAccessor(VectorHolder holder)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

GenericArrowVectorAccessorFactory

protected GenericArrowVectorAccessorFactory(Supplier<GenericArrowVectorAccessorFactory.DecimalFactory<DecimalT>> decimalFactorySupplier,
 Supplier<GenericArrowVectorAccessorFactory.StringFactory<Utf8StringT>> stringFactorySupplier,
 Supplier<GenericArrowVectorAccessorFactory.StructChildFactory<ChildVectorT>> structChildFactorySupplier,
 Supplier<GenericArrowVectorAccessorFactory.ArrayFactory<ChildVectorT,ArrayT>> arrayFactorySupplier)

The constructor is parameterized using the decimal, string, struct and array factories. If a specific type is not supported, the factory supplier can raise an UnsupportedOperationException.

Method Details

getVectorAccessor

public ArrowVectorAccessor<DecimalT,Utf8StringT,ArrayT,ChildVectorT> getVectorAccessor(VectorHolder holder)