Package org.apache.iceberg.spark.actions

Class SparkActions

java.lang.Object

org.apache.iceberg.spark.actions.SparkActions

All Implemented Interfaces:

ActionsProvider

public class SparkActions
extends Object
implements ActionsProvider

An implementation of ActionsProvider for Spark.

This class is the primary API for interacting with actions in Spark that users should use to instantiate particular actions.

Method Summary

Modifier and Type	Method	Description
ComputePartitionStats	computePartitionStats(Table table)	Instantiates an action to compute partition stats.
ComputeTableStats	computeTableStats(Table table)	Instantiates an action to compute table stats.
DeleteOrphanFilesSparkAction	deleteOrphanFiles(Table table)	Instantiates an action to delete orphan files.
DeleteReachableFilesSparkAction	deleteReachableFiles(String metadataLocation)	Instantiates an action to delete all the files reachable from given metadata location.
ExpireSnapshotsSparkAction	expireSnapshots(Table table)	Instantiates an action to expire snapshots.
static SparkActions	get()
static SparkActions	get(org.apache.spark.sql.SparkSession spark)
MigrateTableSparkAction	migrateTable(String tableIdent)	Instantiates an action to migrate an existing table to Iceberg.
RemoveDanglingDeleteFiles	removeDanglingDeleteFiles(Table table)	Instantiates an action to remove dangling delete files from current snapshot.
RewriteDataFilesSparkAction	rewriteDataFiles(Table table)	Instantiates an action to rewrite data files.
RewriteManifestsSparkAction	rewriteManifests(Table table)	Instantiates an action to rewrite manifests.
RewritePositionDeleteFilesSparkAction	rewritePositionDeletes(Table table)	Instantiates an action to rewrite position delete files
RewriteTablePathSparkAction	rewriteTablePath(Table table)	Instantiates an action to rewrite all absolute paths in table metadata.
SnapshotTableSparkAction	snapshotTable(String tableIdent)	Instantiates an action to snapshot an existing table as a new Iceberg table.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

get

public static SparkActions get(org.apache.spark.sql.SparkSession spark)

get

public static SparkActions get()

snapshotTable

public SnapshotTableSparkAction snapshotTable(String tableIdent)

Description copied from interface: ActionsProvider

Instantiates an action to snapshot an existing table as a new Iceberg table.

Specified by:

snapshotTable in interface ActionsProvider

migrateTable

public MigrateTableSparkAction migrateTable(String tableIdent)

Description copied from interface: ActionsProvider

Instantiates an action to migrate an existing table to Iceberg.

Specified by:

migrateTable in interface ActionsProvider

rewriteDataFiles

public RewriteDataFilesSparkAction rewriteDataFiles(Table table)

Description copied from interface: ActionsProvider

Instantiates an action to rewrite data files.

Specified by:

rewriteDataFiles in interface ActionsProvider

deleteOrphanFiles

public DeleteOrphanFilesSparkAction deleteOrphanFiles(Table table)

Description copied from interface: ActionsProvider

Instantiates an action to delete orphan files.

Specified by:

deleteOrphanFiles in interface ActionsProvider

rewriteManifests

public RewriteManifestsSparkAction rewriteManifests(Table table)

Description copied from interface: ActionsProvider

Instantiates an action to rewrite manifests.

Specified by:

rewriteManifests in interface ActionsProvider

expireSnapshots

public ExpireSnapshotsSparkAction expireSnapshots(Table table)

Description copied from interface: ActionsProvider

Instantiates an action to expire snapshots.

Specified by:

expireSnapshots in interface ActionsProvider

deleteReachableFiles

public DeleteReachableFilesSparkAction deleteReachableFiles(String metadataLocation)

Description copied from interface: ActionsProvider

Instantiates an action to delete all the files reachable from given metadata location.

Specified by:

deleteReachableFiles in interface ActionsProvider

rewritePositionDeletes

public RewritePositionDeleteFilesSparkAction rewritePositionDeletes(Table table)

Description copied from interface: ActionsProvider

Instantiates an action to rewrite position delete files

Specified by:

rewritePositionDeletes in interface ActionsProvider

computeTableStats

public ComputeTableStats computeTableStats(Table table)

Description copied from interface: ActionsProvider

Instantiates an action to compute table stats.

Specified by:

computeTableStats in interface ActionsProvider

computePartitionStats

public ComputePartitionStats computePartitionStats(Table table)

Description copied from interface: ActionsProvider

Instantiates an action to compute partition stats.

Specified by:

computePartitionStats in interface ActionsProvider

removeDanglingDeleteFiles

public RemoveDanglingDeleteFiles removeDanglingDeleteFiles(Table table)

Description copied from interface: ActionsProvider

Instantiates an action to remove dangling delete files from current snapshot.

Specified by:

removeDanglingDeleteFiles in interface ActionsProvider

rewriteTablePath

public RewriteTablePathSparkAction rewriteTablePath(Table table)

Description copied from interface: ActionsProvider

Instantiates an action to rewrite all absolute paths in table metadata.

Specified by:

rewriteTablePath in interface ActionsProvider