Class StatisticsOrRecord

java.lang.Object
org.apache.iceberg.flink.sink.shuffle.StatisticsOrRecord
All Implemented Interfaces:
Serializable

@Internal public class StatisticsOrRecord extends Object implements Serializable
The wrapper class for data statistics and record. It is the only way for data statistics operator to send global data statistics to custom partitioner to distribute data based on statistics

DataStatisticsOrRecord contains either data statistics(globally aggregated) or a record. It is sent from DataStatisticsOperator to partitioner. Once partitioner receives the data statistics, it will use that to decide the coming record should send to which writer subtask. After shuffling, a filter and mapper are required to filter out the data distribution weight, unwrap the object and extract the original record type T.

See Also:
  • Method Details

    • hasRecord

      public boolean hasRecord()
    • record

      public org.apache.flink.table.data.RowData record()
    • toString

      public String toString()
      Overrides:
      toString in class Object