Ashwin07 opened a new issue, #9562:
URL: https://github.com/apache/iceberg/issues/9562
I have created the below Apache Iceberg table in Nessie.
Nessie version: 0.58.1
Spark version: 3.3
Apache Iceberg version: 1.3.0
Table Name: gold_layer.CORP_DRM_PKG.PHYS_GEO_HIER
Location:
s3a://gold-layer-bkt/nessie_poc/metadata/CORP_DRM_PKG/PHYS_GEO_HIER_4d18ae58-9ffd-42e2-a18e-602950842f22
Table Properties
[current-snapshot-id=7015122799097017057,format=iceberg/parquet,format-version=1,gc.enabled=false,nessie.commit.id=b446261a6ad9d65e76edf6ab0bfc7b3147305b9f2e0d095751b2b92c9ad1a39d,option.write.spark.accept-any-schema=true,write.spark.accept-any-schema=true]
gc.enabled property is set to false by default, the alter statements or
create statements does not seem to overwrite it,
Alter statement:
spark.sql("""ALTER TABLE gold_layer.CORP_DRM_PKG.PHYS_GEO_HIER SET
TBLPROPERTIES ('gc.enabled' = 'true')""")
Create statement:
spark.sql("""CREATE TABLE gold_layer.CORP_DRM_PKG.PHYS_GEO_HIER ( BU_ID
DECIMAL(15, 0), EFF_STRT_DTTM TIMESTAMP NOT NULL, RGN_CODE STRING, RGN_DESC
STRING, RGN_ABBR STRING, SUB_RGN_CODE STRING, SUB_RGN_DESC STRING, SUB_RGN_ABBR
STRING, AREA_CODE STRING, AREA_DESC STRING, AREA_ABBR STRING, CTRY_CODE STRING,
CTRY_DESC STRING, CTRY_ABBR STRING, BU_DESC STRING, ISO_CTRY_CODE_3 STRING,
ISO_CTRY_CODE_2 STRING, EFF_END_DTTM TIMESTAMP, DW_CURR_FLAG STRING, EXTRC_DTTM
TIMESTAMP ) USING iceberg TBLPROPERTIES ('gc.enabled' = 'true')""")
I would like to test the feature of expire snapshots for this Iceberg table,
but the fact that gc.enabled flag set to false, does not allow snapshot
expiration with the below exception,
org.apache.iceberg.exceptions.ValidationException: Cannot expire snapshots:
GC is disabled (deleting files may corrupt other tables)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
