4.1.1 Environment

Back to Master

Runtime Information

NameValue
Java Home/opt/java/openjdk
Java Version21.0.11 (Eclipse Adoptium)
Scala Versionversion 2.13.17

Spark Properties

NameValue
spark.hadoop.fs.s3a.aws.credentials.provider*********(redacted)
spark.hadoop.fs.s3a.connection.ssl.enabledfalse
spark.hadoop.fs.s3a.endpointhttp://minio1:9000
spark.hadoop.fs.s3a.implorg.apache.hadoop.fs.s3a.S3AFileSystem
spark.hadoop.fs.s3a.path.style.accesstrue
spark.hadoop.fs.s3a.sts.endpointhttp://minio1:9000
spark.masterspark://spark-master:7077
spark.scheduler.mode
spark.sql.catalog.bronzeorg.apache.iceberg.spark.SparkCatalog
spark.sql.catalog.bronze.aws.credentials-provider.typeweb-identity
spark.sql.catalog.bronze.aws.credentials-provider.web-identity.role-arnarn:aws:iam::123456789012:role/authentik
spark.sql.catalog.bronze.aws.credentials-provider.web-identity.role-session-namespark-connect-session
spark.sql.catalog.bronze.aws.sts.endpointhttp://minio1:9000
spark.sql.catalog.bronze.catalog-implorg.apache.iceberg.rest.RESTCatalog
spark.sql.catalog.bronze.header.X-Polaris-Realmdefault-realm
spark.sql.catalog.bronze.io-implorg.apache.iceberg.aws.s3.S3FileIO
spark.sql.catalog.bronze.s3.endpointhttp://minio1:9000
spark.sql.catalog.bronze.s3.path-style-accesstrue
spark.sql.catalog.bronze.urihttp://polaris:8181/api/catalog
spark.sql.catalog.bronze.warehousebronze
spark.sql.extensionsorg.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions

Hadoop Properties

System Properties

Metrics Properties

Classpath Entries

Environment Variables