cosen-wu opened a new issue, #12078:
URL: https://github.com/apache/iceberg/issues/12078
### Query engine
hive,flink,spark
### Question
> create iceberg table in hive:
`create table test.iceberg_v1(
a int,
b string,
c string,
d string
)
partitioned by (par_dt string)
STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
TBLPROPERTIES (
'format-version'='1'
);`
> add properties:
`alter table test.iceberg_v1 SET
TBLPROPERTIES('history.expire.max-snapshot-age-ms'='7200000');`
> check TBLPROPERTIES:
`show TBLPROPERTIES test.iceberg_v1;
+-------------------------------------+----------------------------------------------------+
| prpt_name | prpt_value
|
+-------------------------------------+----------------------------------------------------+
| current-schema |
{"type":"struct","schema-id":0,"fields":[{"id":1,"name":"a","required":false,"type":"int"},{"id":2,"name":"b","required":false,"type":"string"},{"id":3,"name":"c","required":false,"type":"string"},{"id":4,"name":"d","required":false,"type":"string"},{"id":5,"name":"par_dt","required":false,"type":"string"}]}
|
| default-partition-spec |
{"spec-id":0,"fields":[{"name":"par_dt","transform":"identity","source-id":5,"field-id":1000}]}
|
| engine.hive.enabled | true
|
| external.table.purge | TRUE
|
| format-version | 1
|
| history.expire.max-snapshot-age-ms | 7200000
|
| last_modified_by | impala
|
| last_modified_time | 1737685889
|
| metadata_location |
hdfs://xxxxxx/usr/hive/warehouse/test.db/iceberg_v1/metadata/00000-e634e661-3978-4259-b737-fbb81c35d5a3.metadata.json
|
| snapshot-count | 0
|
| storage_handler |
org.apache.iceberg.mr.hive.HiveIcebergStorageHandler |
| table_type | ICEBERG
|
| transient_lastDdlTime | 1737685889
|
| uuid | 9cec09d8-3b72-4568-b70b-2aeed8db96cd
|
+-------------------------------------+----------------------------------------------------+
`
1.write new file and create new metadata.json with flink, the properties of
metadata file is also without property: 'history.expire.max-snapshot-age-ms'.
2.execute spark expireSnapshots,but it seems that
'history.expire.max-snapshot-age-ms' is not work.i find action get table
properties from metadata.json,that is normal？why not from hms?
iceberg version：1.2.1
flink version: 1.14.5
spark version: 3.3.2
hive version: 3.1.3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
