Package org.apache.iceberg.flink.maintenance.operator

Class EqualityConvertReader

java.lang.Object
org.apache.flink.api.common.functions.AbstractRichFunction
org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>
org.apache.iceberg.flink.maintenance.operator.EqualityConvertReader
All Implemented Interfaces:
Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction
@Internal public class EqualityConvertReader extends org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>
Parallel reader that processes ReadCommands from the planner and emits IndexCommands. Dispatches on the wrapped ContentScanTask subtype: FileScanTask (data file) emits ADD_DATA_ROW per row, our equality-delete task emits RESOLVE_DELETE per row.
See Also:

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

    org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final org.apache.flink.util.OutputTag<DVPosition>
    READER_ABORT_STREAM
     

  • Constructor Summary

    Constructors
    Constructor
    Description
    EqualityConvertReader(TableLoader tableLoader, Set<Integer> eqFieldIds, boolean stagingOnTargetBranch)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    close()
     
    void
    open(org.apache.flink.api.common.functions.OpenContext openContext)
     
    void
    processElement(ReadCommand cmd, org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>.org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx, org.apache.flink.util.Collector<IndexCommand> out)
     

    Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

    onTimer

    Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

    getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.flink.api.common.functions.RichFunction

    useInterruptibleTimers

  • Field Details

    • READER_ABORT_STREAM

      public static final org.apache.flink.util.OutputTag<DVPosition> READER_ABORT_STREAM

  • Constructor Details

    • EqualityConvertReader

      public EqualityConvertReader(TableLoader tableLoader, Set<Integer> eqFieldIds, boolean stagingOnTargetBranch)

  • Method Details

    • open

      public void open(org.apache.flink.api.common.functions.OpenContext openContext) throws Exception
      Specified by:
      open in interface org.apache.flink.api.common.functions.RichFunction
      Overrides:
      open in class org.apache.flink.api.common.functions.AbstractRichFunction
      Throws:
      Exception

    • processElement

      public void processElement(ReadCommand cmd, org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>.org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx, org.apache.flink.util.Collector<IndexCommand> out) throws Exception
      Specified by:
      processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>
      Throws:
      Exception

    • close

      public void close() throws Exception
      Specified by:
      close in interface org.apache.flink.api.common.functions.RichFunction
      Overrides:
      close in class org.apache.flink.api.common.functions.AbstractRichFunction
      Throws:
      Exception