Package org.apache.iceberg.flink.maintenance.operator

Class ExpireSnapshotsProcessor

java.lang.Object
org.apache.flink.api.common.functions.AbstractRichFunction
org.apache.flink.streaming.api.functions.ProcessFunction<Trigger,TaskResult>
org.apache.iceberg.flink.maintenance.operator.ExpireSnapshotsProcessor
All Implemented Interfaces:
Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction
@Internal public class ExpireSnapshotsProcessor extends org.apache.flink.streaming.api.functions.ProcessFunction<Trigger,TaskResult>
Calls the ExpireSnapshots to remove the old snapshots and emits the filenames which could be removed in the DELETE_STREAM side output.
See Also:

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

    org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final org.apache.flink.util.OutputTag<String>
    DELETE_STREAM
     

  • Constructor Summary

    Constructors
    Constructor
    Description
    ExpireSnapshotsProcessor(TableLoader tableLoader, Long maxSnapshotAgeMs, Integer numSnapshots, Integer plannerPoolSize)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    close()
     
    void
    open(org.apache.flink.configuration.Configuration parameters)
     
    void
    processElement(Trigger trigger, org.apache.flink.streaming.api.functions.ProcessFunction<Trigger,TaskResult>.org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx, org.apache.flink.util.Collector<TaskResult> out)
     

    Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

    onTimer

    Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

    getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.flink.api.common.functions.RichFunction

    open

  • Field Details

    • DELETE_STREAM

      public static final org.apache.flink.util.OutputTag<String> DELETE_STREAM

  • Constructor Details

    • ExpireSnapshotsProcessor

      public ExpireSnapshotsProcessor(TableLoader tableLoader, Long maxSnapshotAgeMs, Integer numSnapshots, Integer plannerPoolSize)

  • Method Details

    • open

      public void open(org.apache.flink.configuration.Configuration parameters) throws Exception
      Specified by:
      open in interface org.apache.flink.api.common.functions.RichFunction
      Overrides:
      open in class org.apache.flink.api.common.functions.AbstractRichFunction
      Throws:
      Exception

    • processElement

      public void processElement(Trigger trigger, org.apache.flink.streaming.api.functions.ProcessFunction<Trigger,TaskResult>.org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx, org.apache.flink.util.Collector<TaskResult> out) throws Exception
      Specified by:
      processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<Trigger,TaskResult>
      Throws:
      Exception

    • close

      public void close() throws Exception
      Specified by:
      close in interface org.apache.flink.api.common.functions.RichFunction
      Overrides:
      close in class org.apache.flink.api.common.functions.AbstractRichFunction
      Throws:
      Exception