Class Deletes


  • public class Deletes
    extends java.lang.Object
    • Method Detail

      • markDeleted

        public static <T> CloseableIterable<T> markDeleted​(CloseableIterable<T> rows,
                                                           java.util.function.Predicate<T> isDeleted,
                                                           java.util.function.Consumer<T> deleteMarker)
        Returns the same rows that are input, while marking the deleted ones.
        Parameters:
        rows - the rows to process
        isDeleted - a predicate that determines if a row is deleted
        deleteMarker - a function that marks a row as deleted
        Returns:
        the processed rows
      • filterDeleted

        public static <T> CloseableIterable<T> filterDeleted​(CloseableIterable<T> rows,
                                                             java.util.function.Predicate<T> isDeleted,
                                                             DeleteCounter counter)
        Returns the remaining rows (the ones that are not deleted), while counting the deleted ones.
        Parameters:
        rows - the rows to process
        isDeleted - a predicate that determines if a row is deleted
        counter - a counter that counts deleted rows
        Returns:
        the processed rows
      • toPositionIndexes

        public static <T extends StructLikeCharSequenceMap<PositionDeleteIndex> toPositionIndexes​(CloseableIterable<T> posDeletes,
                                                                                                    DeleteFile file)
        Builds a map of position delete indexes by path.

        Unlike toPositionIndex(CharSequence, List), this method builds a position delete index for each referenced data file and does not filter deletes. This can be useful when the entire delete file content is needed (e.g. caching).

        Parameters:
        posDeletes - position deletes
        file - the source delete file for the deletes
        Returns:
        the map of position delete indexes by path
      • toPositionIndex

        @Deprecated
        public static <T extends StructLikePositionDeleteIndex toPositionIndex​(java.lang.CharSequence dataLocation,
                                                                                 java.util.List<CloseableIterable<T>> deleteFiles)
        Deprecated.
        since 1.7.0, will be removed in 1.8.0; use delete loaders.
      • toPositionIndex

        @Deprecated
        public static <T extends StructLikePositionDeleteIndex toPositionIndex​(java.lang.CharSequence dataLocation,
                                                                                 java.util.List<CloseableIterable<T>> deleteFiles,
                                                                                 java.util.concurrent.ExecutorService deleteWorkerPool)
        Deprecated.
        since 1.7.0, will be removed in 1.8.0; use delete loaders.
      • streamingFilter

        @Deprecated
        public static <T> CloseableIterable<T> streamingFilter​(CloseableIterable<T> rows,
                                                               java.util.function.Function<T,​java.lang.Long> rowToPosition,
                                                               CloseableIterable<java.lang.Long> posDeletes)
        Deprecated.
        since 1.7.0, will be removed in 1.8.0.
      • streamingMarker

        @Deprecated
        public static <T> CloseableIterable<T> streamingMarker​(CloseableIterable<T> rows,
                                                               java.util.function.Function<T,​java.lang.Long> rowToPosition,
                                                               CloseableIterable<java.lang.Long> posDeletes,
                                                               java.util.function.Consumer<T> markRowDeleted)
        Deprecated.
        since 1.7.0, will be removed in 1.8.0.