Package org.apache.iceberg.spark.actions

Class ManifestFileBean

java.lang.Object
org.apache.iceberg.spark.actions.ManifestFileBean
All Implemented Interfaces:
Serializable, ManifestFile
public class ManifestFileBean extends Object implements ManifestFile, Serializable
A serializable bean that contains a bare minimum to read a manifest.
See Also:

  • Field Details

    • ENCODER

      public static final org.apache.spark.sql.Encoder<ManifestFileBean> ENCODER

  • Constructor Details

    • ManifestFileBean

      public ManifestFileBean()

  • Method Details

    • fromManifest

      public static ManifestFileBean fromManifest(ManifestFile manifest)

    • getPath

      public String getPath()

    • setPath

      public void setPath(String path)

    • getLength

      public Long getLength()

    • setLength

      public void setLength(Long length)

    • getPartitionSpecId

      public Integer getPartitionSpecId()

    • setPartitionSpecId

      public void setPartitionSpecId(Integer partitionSpecId)

    • getAddedSnapshotId

      public Long getAddedSnapshotId()

    • setAddedSnapshotId

      public void setAddedSnapshotId(Long addedSnapshotId)

    • getContent

      public Integer getContent()

    • setContent

      public void setContent(Integer content)

    • getSequenceNumber

      public Long getSequenceNumber()

    • setSequenceNumber

      public void setSequenceNumber(Long sequenceNumber)

    • setFirstRowId

      public void setFirstRowId(Long firstRowId)

    • path

      public String path()
      Description copied from interface: ManifestFile
      Returns fully qualified path to the file, suitable for constructing a Hadoop Path.
      Specified by:
      path in interface ManifestFile

    • length

      public long length()
      Description copied from interface: ManifestFile
      Returns length of the manifest file.
      Specified by:
      length in interface ManifestFile

    • partitionSpecId

      public int partitionSpecId()
      Description copied from interface: ManifestFile
      Returns iD of the PartitionSpec used to write the manifest file.
      Specified by:
      partitionSpecId in interface ManifestFile

    • content

      public ManifestContent content()
      Description copied from interface: ManifestFile
      Returns the content stored in the manifest; either DATA or DELETES.
      Specified by:
      content in interface ManifestFile

    • sequenceNumber

      public long sequenceNumber()
      Description copied from interface: ManifestFile
      Returns the sequence number of the commit that added the manifest file.
      Specified by:
      sequenceNumber in interface ManifestFile

    • minSequenceNumber

      public long minSequenceNumber()
      Description copied from interface: ManifestFile
      Returns the lowest data sequence number of any live file in the manifest.
      Specified by:
      minSequenceNumber in interface ManifestFile

    • snapshotId

      public Long snapshotId()
      Description copied from interface: ManifestFile
      Returns iD of the snapshot that added the manifest file to table metadata.
      Specified by:
      snapshotId in interface ManifestFile

    • addedFilesCount

      public Integer addedFilesCount()
      Description copied from interface: ManifestFile
      Returns the number of files with status ADDED in the manifest file.
      Specified by:
      addedFilesCount in interface ManifestFile

    • addedRowsCount

      public Long addedRowsCount()
      Description copied from interface: ManifestFile
      Returns the total number of rows in all files with status ADDED in the manifest file.
      Specified by:
      addedRowsCount in interface ManifestFile

    • existingFilesCount

      public Integer existingFilesCount()
      Description copied from interface: ManifestFile
      Returns the number of files with status EXISTING in the manifest file.
      Specified by:
      existingFilesCount in interface ManifestFile

    • existingRowsCount

      public Long existingRowsCount()
      Description copied from interface: ManifestFile
      Returns the total number of rows in all files with status EXISTING in the manifest file.
      Specified by:
      existingRowsCount in interface ManifestFile

    • deletedFilesCount

      public Integer deletedFilesCount()
      Description copied from interface: ManifestFile
      Returns the number of files with status DELETED in the manifest file.
      Specified by:
      deletedFilesCount in interface ManifestFile

    • deletedRowsCount

      public Long deletedRowsCount()
      Description copied from interface: ManifestFile
      Returns the total number of rows in all files with status DELETED in the manifest file.
      Specified by:
      deletedRowsCount in interface ManifestFile

    • partitions

      public List<ManifestFile.PartitionFieldSummary> partitions()
      Description copied from interface: ManifestFile
      Returns a list of partition field summaries.

      Each summary corresponds to a field in the manifest file's partition spec, by ordinal. For example, the partition spec [ ts_day=date(ts), type=identity(type) ] will have 2 summaries. The first summary is for the ts_day partition field and the second is for the type partition field.

      Specified by:
      partitions in interface ManifestFile
      Returns:
      a list of partition field summaries, one for each field in the manifest's spec

    • keyMetadata

      public ByteBuffer keyMetadata()
      Description copied from interface: ManifestFile
      Returns metadata about how this manifest file is encrypted, or null if the file is stored in plain text.
      Specified by:
      keyMetadata in interface ManifestFile

    • firstRowId

      public Long firstRowId()
      Description copied from interface: ManifestFile
      Returns the starting row ID to assign to new rows in ADDED data files.
      Specified by:
      firstRowId in interface ManifestFile

    • copy

      public ManifestFile copy()
      Description copied from interface: ManifestFile
      Copies this manifest file. Readers can reuse manifest file instances; use this method to make defensive copies.
      Specified by:
      copy in interface ManifestFile
      Returns:
      a copy of this manifest file