Package org.apache.iceberg.pig

Class IcebergStorage

java.lang.Object
org.apache.pig.LoadFunc
org.apache.iceberg.pig.IcebergStorage
All Implemented Interfaces:
org.apache.pig.LoadMetadata, org.apache.pig.LoadPredicatePushdown, org.apache.pig.LoadPushDown
public class IcebergStorage extends org.apache.pig.LoadFunc implements org.apache.pig.LoadMetadata, org.apache.pig.LoadPredicatePushdown, org.apache.pig.LoadPushDown

  • Nested Class Summary

    Nested classes/interfaces inherited from interface org.apache.pig.LoadPushDown

    org.apache.pig.LoadPushDown.OperatorSet, org.apache.pig.LoadPushDown.RequiredField, org.apache.pig.LoadPushDown.RequiredFieldList, org.apache.pig.LoadPushDown.RequiredFieldResponse

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final String
    PIG_ICEBERG_TABLES_IMPL
     

  • Constructor Summary

    Constructors
    Constructor
    Description
    IcebergStorage()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    List<org.apache.pig.LoadPushDown.OperatorSet>
    getFeatures()
     
    org.apache.hadoop.mapreduce.InputFormat
    getInputFormat()
     
    org.apache.pig.data.Tuple
    getNext()
     
    String[]
    getPartitionKeys(String location, org.apache.hadoop.mapreduce.Job job)
     
    List<String>
    getPredicateFields(String location, org.apache.hadoop.mapreduce.Job job)
     
    org.apache.pig.ResourceSchema
    getSchema(String location, org.apache.hadoop.mapreduce.Job job)
     
    org.apache.pig.ResourceStatistics
    getStatistics(String location, org.apache.hadoop.mapreduce.Job job)
     
    org.apache.iceberg.relocated.com.google.common.collect.ImmutableList<org.apache.pig.Expression.OpType>
    getSupportedExpressionTypes()
     
    void
    prepareToRead(org.apache.hadoop.mapreduce.RecordReader newReader, org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSplit split)
     
    org.apache.pig.LoadPushDown.RequiredFieldResponse
    pushProjection(org.apache.pig.LoadPushDown.RequiredFieldList requiredFieldList)
     
    String
    relativeToAbsolutePath(String location, org.apache.hadoop.fs.Path curDir)
     
    void
    setLocation(String location, org.apache.hadoop.mapreduce.Job job)
     
    void
    setPartitionFilter(org.apache.pig.Expression partitionFilter)
     
    void
    setPushdownPredicate(org.apache.pig.Expression predicate)
     
    void
    setUDFContextSignature(String newSignature)
     

    Methods inherited from class org.apache.pig.LoadFunc

    getAbsolutePath, getCacheFiles, getLoadCaster, getPathStrings, getShipFiles, join, warn

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Field Details

  • Constructor Details

    • IcebergStorage

      public IcebergStorage()

  • Method Details

    • setLocation

      public void setLocation(String location, org.apache.hadoop.mapreduce.Job job)
      Specified by:
      setLocation in class org.apache.pig.LoadFunc

    • getInputFormat

      public org.apache.hadoop.mapreduce.InputFormat getInputFormat()
      Specified by:
      getInputFormat in class org.apache.pig.LoadFunc

    • getNext

      public org.apache.pig.data.Tuple getNext() throws IOException
      Specified by:
      getNext in class org.apache.pig.LoadFunc
      Throws:
      IOException

    • prepareToRead

      public void prepareToRead(org.apache.hadoop.mapreduce.RecordReader newReader, org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSplit split)
      Specified by:
      prepareToRead in class org.apache.pig.LoadFunc

    • getSchema

      public org.apache.pig.ResourceSchema getSchema(String location, org.apache.hadoop.mapreduce.Job job) throws IOException
      Specified by:
      getSchema in interface org.apache.pig.LoadMetadata
      Throws:
      IOException

    • getStatistics

      public org.apache.pig.ResourceStatistics getStatistics(String location, org.apache.hadoop.mapreduce.Job job)
      Specified by:
      getStatistics in interface org.apache.pig.LoadMetadata

    • getPartitionKeys

      public String[] getPartitionKeys(String location, org.apache.hadoop.mapreduce.Job job)
      Specified by:
      getPartitionKeys in interface org.apache.pig.LoadMetadata

    • setPartitionFilter

      public void setPartitionFilter(org.apache.pig.Expression partitionFilter)
      Specified by:
      setPartitionFilter in interface org.apache.pig.LoadMetadata

    • getPredicateFields

      public List<String> getPredicateFields(String location, org.apache.hadoop.mapreduce.Job job) throws IOException
      Specified by:
      getPredicateFields in interface org.apache.pig.LoadPredicatePushdown
      Throws:
      IOException

    • getSupportedExpressionTypes

      public org.apache.iceberg.relocated.com.google.common.collect.ImmutableList<org.apache.pig.Expression.OpType> getSupportedExpressionTypes()
      Specified by:
      getSupportedExpressionTypes in interface org.apache.pig.LoadPredicatePushdown

    • setPushdownPredicate

      public void setPushdownPredicate(org.apache.pig.Expression predicate) throws IOException
      Specified by:
      setPushdownPredicate in interface org.apache.pig.LoadPredicatePushdown
      Throws:
      IOException

    • getFeatures

      public List<org.apache.pig.LoadPushDown.OperatorSet> getFeatures()
      Specified by:
      getFeatures in interface org.apache.pig.LoadPushDown

    • pushProjection

      public org.apache.pig.LoadPushDown.RequiredFieldResponse pushProjection(org.apache.pig.LoadPushDown.RequiredFieldList requiredFieldList)
      Specified by:
      pushProjection in interface org.apache.pig.LoadPushDown

    • setUDFContextSignature

      public void setUDFContextSignature(String newSignature)
      Overrides:
      setUDFContextSignature in class org.apache.pig.LoadFunc

    • relativeToAbsolutePath

      public String relativeToAbsolutePath(String location, org.apache.hadoop.fs.Path curDir) throws IOException
      Overrides:
      relativeToAbsolutePath in class org.apache.pig.LoadFunc
      Throws:
      IOException