Class VectorizedArrowReader

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description
      static class  VectorizedArrowReader.ConstantVectorReader<T>
      A Dummy Vector Reader which doesn't actually read files, instead it returns a dummy VectorHolder which indicates the constant value which should be used for this column.
    • Constructor Summary

      Constructor Description
      VectorizedArrowReader​(org.apache.parquet.column.ColumnDescriptor desc, Types.NestedField icebergField, org.apache.arrow.memory.BufferAllocator ra, boolean setArrowValidityVector)  
    • Constructor Detail

      • VectorizedArrowReader

        public VectorizedArrowReader​(org.apache.parquet.column.ColumnDescriptor desc,
                                     Types.NestedField icebergField,
                                     org.apache.arrow.memory.BufferAllocator ra,
                                     boolean setArrowValidityVector)
    • Method Detail

      • read

        public VectorHolder read​(VectorHolder reuse,
                                 int numValsToRead)
        Description copied from interface: VectorizedReader
        Reads a batch of type @param <T> and of size numRows
        Specified by:
        read in interface VectorizedReader<VectorHolder>
        reuse - container for the last batch to be reused for next batch
        numValsToRead - number of rows to read
        batch of records of type @param <T>
      • setRowGroupInfo

        public void setRowGroupInfo​( source,
                                    java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,​org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata,
                                    long rowPosition)
        Description copied from interface: VectorizedReader
        Sets the row group information to be used with this reader
        Specified by:
        setRowGroupInfo in interface VectorizedReader<VectorHolder>
        source - row group information for all the columns
        metadata - map of ColumnPath -> ColumnChunkMetaData for the row group
        rowPosition - the row group's row offset in the parquet file
      • toString

        public java.lang.String toString()
        toString in class java.lang.Object