Package org.apache.iceberg.flink.source.enumerator

Class StaticIcebergEnumerator

  • All Implemented Interfaces:
    java.lang.AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,​IcebergEnumeratorState>, org.apache.flink.api.connector.source.SupportsHandleExecutionAttemptSourceEvent
    @Internal
public class StaticIcebergEnumerator
extends java.lang.Object
    One-time split enumeration at the start-up for batch execution

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void addReader​(int subtaskId)  
      void addSplitsBack​(java.util.List<IcebergSourceSplit> splits, int subtaskId)  
      void close()  
      void handleSourceEvent​(int subTaskId, int attemptNumber, org.apache.flink.api.connector.source.SourceEvent sourceEvent)  
      void handleSourceEvent​(int subtaskId, org.apache.flink.api.connector.source.SourceEvent sourceEvent)  
      void handleSplitRequest​(int subtaskId, java.lang.String requesterHostname)  
      protected boolean shouldWaitForMoreSplits()
      return true if enumerator should wait for splits like in the continuous enumerator case
      IcebergEnumeratorState snapshotState​(long checkpointId)  
      void start()  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

      • Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

        notifyCheckpointAborted

      • Methods inherited from interface org.apache.flink.api.connector.source.SplitEnumerator

        notifyCheckpointComplete

    • Constructor Detail

      • StaticIcebergEnumerator

        public StaticIcebergEnumerator​(org.apache.flink.api.connector.source.SplitEnumeratorContext<IcebergSourceSplit> enumeratorContext,
                               SplitAssigner assigner)

    • Method Detail

      • shouldWaitForMoreSplits

        protected boolean shouldWaitForMoreSplits()
        return true if enumerator should wait for splits like in the continuous enumerator case

      • close

        public void close()
           throws java.io.IOException
        Specified by:
        close in interface java.lang.AutoCloseable
        Specified by:
        close in interface org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,​IcebergEnumeratorState>
        Throws:
        java.io.IOException

      • handleSplitRequest

        public void handleSplitRequest​(int subtaskId,
                               @Nullable
                               java.lang.String requesterHostname)
        Specified by:
        handleSplitRequest in interface org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,​IcebergEnumeratorState>

      • handleSourceEvent

        public void handleSourceEvent​(int subtaskId,
                              org.apache.flink.api.connector.source.SourceEvent sourceEvent)
        Specified by:
        handleSourceEvent in interface org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,​IcebergEnumeratorState>

      • handleSourceEvent

        public void handleSourceEvent​(int subTaskId,
                              int attemptNumber,
                              org.apache.flink.api.connector.source.SourceEvent sourceEvent)
        Specified by:
        handleSourceEvent in interface org.apache.flink.api.connector.source.SupportsHandleExecutionAttemptSourceEvent