Class StatisticsOrRecord
java.lang.Object
org.apache.iceberg.flink.sink.shuffle.StatisticsOrRecord
- All Implemented Interfaces:
Serializable
The wrapper class for data statistics and record. It is the only way for data statistics operator
to send global data statistics to custom partitioner to distribute data based on statistics
DataStatisticsOrRecord contains either data statistics(globally aggregated) or a record. It is
sent from DataStatisticsOperator
to partitioner. Once partitioner receives the data
statistics, it will use that to decide the coming record should send to which writer subtask.
After shuffling, a filter and mapper are required to filter out the data distribution weight,
unwrap the object and extract the original record type T.
- See Also:
-
Method Summary