Package org.apache.iceberg.util
Class TableScanUtil
java.lang.Object
org.apache.iceberg.util.TableScanUtil
-
Method Summary
Modifier and TypeMethodDescriptionstatic longadjustSplitSize(long scanSize, int parallelism, long splitSize) static booleanhasDeletes(CombinedScanTask task) static booleanhasDeletes(FileScanTask task) static booleanhasEqDeletes(CombinedScanTask task) This is temporarily introduced since we plan to support pos-delete vectorized read first, then get to the equality-delete support.mergeTasks(List<T> tasks) static <T extends ScanTask>
List<ScanTaskGroup<T>>planTaskGroups(List<T> tasks, long splitSize, int lookback, long openFileCost) static <T extends PartitionScanTask>
List<ScanTaskGroup<T>>planTaskGroups(List<T> tasks, long splitSize, int lookback, long openFileCost, Types.StructType groupingKeyType) static <T extends ScanTask>
CloseableIterable<ScanTaskGroup<T>>planTaskGroups(CloseableIterable<T> tasks, long splitSize, int lookback, long openFileCost) static CloseableIterable<CombinedScanTask>planTasks(CloseableIterable<FileScanTask> splitFiles, long splitSize, int lookback, long openFileCost) static CloseableIterable<FileScanTask>splitFiles(CloseableIterable<FileScanTask> tasks, long splitSize)
-
Method Details
-
hasDeletes
-
hasEqDeletes
This is temporarily introduced since we plan to support pos-delete vectorized read first, then get to the equality-delete support. We will remove this method once both are supported. -
hasDeletes
-
splitFiles
public static CloseableIterable<FileScanTask> splitFiles(CloseableIterable<FileScanTask> tasks, long splitSize) -
planTasks
public static CloseableIterable<CombinedScanTask> planTasks(CloseableIterable<FileScanTask> splitFiles, long splitSize, int lookback, long openFileCost) -
planTaskGroups
public static <T extends ScanTask> List<ScanTaskGroup<T>> planTaskGroups(List<T> tasks, long splitSize, int lookback, long openFileCost) -
planTaskGroups
public static <T extends ScanTask> CloseableIterable<ScanTaskGroup<T>> planTaskGroups(CloseableIterable<T> tasks, long splitSize, int lookback, long openFileCost) -
planTaskGroups
public static <T extends PartitionScanTask> List<ScanTaskGroup<T>> planTaskGroups(List<T> tasks, long splitSize, int lookback, long openFileCost, Types.StructType groupingKeyType) -
mergeTasks
-
adjustSplitSize
public static long adjustSplitSize(long scanSize, int parallelism, long splitSize)
-