Package org.apache.iceberg.hadoop

Class Util

java.lang.Object

org.apache.iceberg.hadoop.Util

public class Util
extends Object

Field Summary

Fields

Modifier and Type	Field	Description
static final String	VERSION_HINT_FILENAME

Method Summary

Modifier and Type	Method	Description
static String[]	blockLocations(CombinedScanTask task, org.apache.hadoop.conf.Configuration conf)	Deprecated. since 1.8.0, will be removed in 1.9.0; use blockLocations(ScanTaskGroup, Configuration) instead.
static String[]	blockLocations(FileIO io, ScanTaskGroup<?> taskGroup)
static String[]	blockLocations(ScanTaskGroup<FileScanTask> taskGroup, org.apache.hadoop.conf.Configuration conf)
static org.apache.hadoop.fs.FileSystem	getFs(org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration conf)
static boolean	mayHaveBlockLocations(FileIO io, String location)
static String	uriToString(URI uri)	From Apache Spark

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

VERSION_HINT_FILENAME

public static final String VERSION_HINT_FILENAME

See Also:

• Constant Field Values

Method Details

getFs

public static org.apache.hadoop.fs.FileSystem getFs(org.apache.hadoop.fs.Path path,
 org.apache.hadoop.conf.Configuration conf)

blockLocations

@Deprecated
public static String[] blockLocations(CombinedScanTask task,
 org.apache.hadoop.conf.Configuration conf)

Deprecated.

since 1.8.0, will be removed in 1.9.0; use blockLocations(ScanTaskGroup, Configuration) instead.

blockLocations

public static String[] blockLocations(ScanTaskGroup<FileScanTask> taskGroup,
 org.apache.hadoop.conf.Configuration conf)

blockLocations

public static String[] blockLocations(FileIO io,
 ScanTaskGroup<?> taskGroup)

mayHaveBlockLocations

public static boolean mayHaveBlockLocations(FileIO io,
 String location)

uriToString

public static String uriToString(URI uri)

From Apache Spark

Convert URI to String. Since URI.toString does not decode the uri, e.g. change '%25' to '%'. Here we create a hadoop Path with the given URI, and rely on Path.toString to decode the uri

Parameters:

uri - the URI of the path

Returns:

the String of the path