Package org.apache.iceberg.spark.source
Class SparkView
java.lang.Object
org.apache.iceberg.spark.source.SparkView
Converts Iceberg view metadata to Spark's
View representation.
Keeps this conversion in Iceberg instead of relying on Spark's built-in view handling so reserved properties and Iceberg defaults are exposed consistently to Spark commands.
-
Field Summary
Fields -
Method Summary
Modifier and TypeMethodDescriptionstatic org.apache.spark.sql.connector.catalog.View.BuilderapplyOptionalFields(org.apache.spark.sql.connector.catalog.View.Builder builder, String schemaMode, Map<String, String> sqlConfigs, org.apache.spark.sql.connector.catalog.DependencyList dependencies) Applies optional Spark view fields to a view builder when present.internalProperties(org.apache.spark.sql.connector.catalog.View view) Returns reserved properties that preserve Spark view metadata not represented by Iceberg view metadata fields.static booleanisReservedProperty(String property) static org.apache.spark.sql.connector.catalog.View
-
Field Details
-
PROP_CREATE_ENGINE_VERSION
- See Also:
-
PROP_ENGINE_VERSION
- See Also:
-
QUERY_COLUMN_NAMES
- See Also:
-
SQL_CONFIG_PREFIX
- See Also:
-
VIEW_SCHEMA_MODE
- See Also:
-
VIEW_DEPENDENCIES
- See Also:
-
-
Method Details
-
toView
-
applyOptionalFields
public static org.apache.spark.sql.connector.catalog.View.Builder applyOptionalFields(org.apache.spark.sql.connector.catalog.View.Builder builder, String schemaMode, Map<String, String> sqlConfigs, org.apache.spark.sql.connector.catalog.DependencyList dependencies) Applies optional Spark view fields to a view builder when present. -
internalProperties
public static Map<String,String> internalProperties(org.apache.spark.sql.connector.catalog.View view) Returns reserved properties that preserve Spark view metadata not represented by Iceberg view metadata fields. -
isReservedProperty
-