Re: [PR] Build: Bump nessie from 0.104.1 to 0.104.2 [iceberg]

2025-06-15 Thread via GitHub
manuzhang commented on PR #13314: URL: https://github.com/apache/iceberg/pull/13314#issuecomment-2975287702 It looks nessie 0.104.2 requires at least jdk17 to compile https://github.com/projectnessie/nessie/releases/tag/nessie-0.104.2. @snazy Can you please confirm? -- This is an automat

Re: [PR] Spark 3.5: Add query runner in test module [iceberg]

2025-06-15 Thread via GitHub
ebyhr commented on PR #11758: URL: https://github.com/apache/iceberg/pull/11758#issuecomment-2975172723 This code works as far as I tested: ```sql show schemas; create schema iceberg125; create table iceberg125.foobar (id int, data string) using iceberg; insert into iceberg

Re: [PR] Build and test hive-metastore with Hive 2, 3 and 4 with a single source set [iceberg]

2025-06-15 Thread via GitHub
pan3793 commented on PR #12721: URL: https://github.com/apache/iceberg/pull/12721#issuecomment-2975254298 > Even if we handle the StructTypeInfo issue, it doesn't mean that there aren't other issues that just haven't manifested because our unit tests don't surface them. @wypoon Given

Re: [PR] feat(transaction): Implement TransactionAction for updata_loc, update_props, and upgrade_format [iceberg-rust]

2025-06-15 Thread via GitHub
liurenjie1024 commented on code in PR #1433: URL: https://github.com/apache/iceberg-rust/pull/1433#discussion_r2149057838 ## crates/iceberg/src/transaction/mod.rs: ## @@ -104,32 +110,13 @@ impl Transaction { } /// Sets table to a new version. -pub fn upgrade_tabl

Re: [I] Add docs for Table Maintenance in Flink [iceberg]

2025-06-15 Thread via GitHub
pvary commented on issue #13307: URL: https://github.com/apache/iceberg/issues/13307#issuecomment-2975106708 > So if it’s okay, I’d like to take full responsibility for this PR and continue working on it myself. @JeonDaehong: Do so, and ping us if you need any help. -- This is an a

Re: [PR] feat: delete orphaned files [iceberg-python]

2025-06-15 Thread via GitHub
Anton-Tarazi commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2148996540 ## pyiceberg/table/maintenance.py: ## @@ -0,0 +1,117 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreeme

Re: [PR] chore(deps): Bump serde_with from 3.12.0 to 3.13.0 [iceberg-rust]

2025-06-15 Thread via GitHub
liurenjie1024 merged PR #1446: URL: https://github.com/apache/iceberg-rust/pull/1446 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [PR] Spark: Iceberg_Spark Add delegation token for HiveCatalog [iceberg]

2025-06-15 Thread via GitHub
pan3793 commented on PR #13187: URL: https://github.com/apache/iceberg/pull/13187#issuecomment-2975002317 > @pan3793 I have now added metastoreUri for token as a service does it solve your query? Not yet, if you do a real test, you will find it does not work. -- This is an automate

Re: [I] Add docs for Table Maintenance in Flink [iceberg]

2025-06-15 Thread via GitHub
JeonDaehong commented on issue #13307: URL: https://github.com/apache/iceberg/issues/13307#issuecomment-2975000695 > I also suggest that the documentation should be more user-focused, as the architecture documentation is a bit too detailed on development aspects. > > 1. How to properl

Re: [PR] chore(deps): Bump aws-config from 1.6.2 to 1.6.3 [iceberg-rust]

2025-06-15 Thread via GitHub
liurenjie1024 merged PR #1447: URL: https://github.com/apache/iceberg-rust/pull/1447 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [I] Add docs for Table Maintenance in Flink [iceberg]

2025-06-15 Thread via GitHub
Guosmilesmile commented on issue #13307: URL: https://github.com/apache/iceberg/issues/13307#issuecomment-2974949937 I also suggest that the documentation should be more user-focused, as the architecture documentation is a bit too detailed on development aspects. 1. How to properly co

[I] Core: `GenericDeleteFile` constructor missing `dataSequenceNumber` field [iceberg]

2025-06-15 Thread via GitHub
chenjian2664 opened a new issue, #13320: URL: https://github.com/apache/iceberg/issues/13320 ### Apache Iceberg version 1.9.0 ### Query engine None ### Please describe the bug 🐞 The `GenericDeleteFile` constructor is missing the `dataSequenceNumber` field.

Re: [I] How can we better collect and manage Iceberg table metadata? [iceberg]

2025-06-15 Thread via GitHub
slfan1989 commented on issue #13311: URL: https://github.com/apache/iceberg/issues/13311#issuecomment-2974910450 > [@slfan1989](https://github.com/slfan1989): The features you are looking for are the concerns of the catalogs. You should check the available catalog implementations and featur

Re: [PR] Spark: Iceberg_Spark Add delegation token for HiveCatalog [iceberg]

2025-06-15 Thread via GitHub
zhangwl9 commented on PR #13187: URL: https://github.com/apache/iceberg/pull/13187#issuecomment-2974855935 > @zhangwl9 keep the original commit history, and stop squashing unless you are requested, otherwise reviewers have no idea what your change is after each round of reviewing. Also, pro

Re: [PR] chore(deps): Bump ordered-float from 2.10.1 to 4.6.0 [iceberg-rust]

2025-06-15 Thread via GitHub
liurenjie1024 merged PR #1445: URL: https://github.com/apache/iceberg-rust/pull/1445 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [PR] Add support for update_table() function in Sql Catalog [iceberg-rust]

2025-06-15 Thread via GitHub
kyteware commented on PR #1356: URL: https://github.com/apache/iceberg-rust/pull/1356#issuecomment-2974820501 @gsoundar Sorry I didn't see this! I believe this is still the status on `update_table` implementations. https://github.com/apache/iceberg-rust/pull/1002#pullrequestreview-263907204

Re: [PR] Spec: clarify that bounds of variant field must not have bounds for mixed types [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on PR #13073: URL: https://github.com/apache/iceberg/pull/13073#issuecomment-2974789057 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Core: support pass storage credential to HadoopFileIO [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on PR #13062: URL: https://github.com/apache/iceberg/pull/13062#issuecomment-2974789012 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Generic Serializer and DeSerializer for control topic consumers and producers [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on PR #12583: URL: https://github.com/apache/iceberg/pull/12583#issuecomment-297476 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Spark, Avro: Add support for row lineage in Avro reader [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on PR #13070: URL: https://github.com/apache/iceberg/pull/13070#issuecomment-2974789034 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Core: validate file format compatibility with v3 [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on PR #13060: URL: https://github.com/apache/iceberg/pull/13060#issuecomment-2974788982 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [I] correct sequence for running maintenance steps on an iceberg table [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on issue #11804: URL: https://github.com/apache/iceberg/issues/11804#issuecomment-2974788811 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [PR] Remove time logical information from connect schema for spark compatibility [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on PR #12724: URL: https://github.com/apache/iceberg/pull/12724#issuecomment-2974788918 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [I] Sink-managed consumer group expires after 7 days of no activity in the topic [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on issue #11805: URL: https://github.com/apache/iceberg/issues/11805#issuecomment-2974788840 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] how to pass where clause predicate to rewrite_data_files which uses year of a timestamp column [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on issue #11789: URL: https://github.com/apache/iceberg/issues/11789#issuecomment-2974788797 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] expire-snapshots isn't removing data files after DELETE + expire [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on issue #11695: URL: https://github.com/apache/iceberg/issues/11695#issuecomment-2974788717 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] [Bug] Iceberg tables break when they're named any of the metadata table names (e.g. `files`, `history`, `manifests`) [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on issue #10550: URL: https://github.com/apache/iceberg/issues/10550#issuecomment-2974788634 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] [Parquet] When reading struct-type data without an id in iceberg-parquet, it returns null values. [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] commented on issue #11214: URL: https://github.com/apache/iceberg/issues/11214#issuecomment-2974788679 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] [Parquet] When reading struct-type data without an id in iceberg-parquet, it returns null values. [iceberg]

2025-06-15 Thread via GitHub
github-actions[bot] closed issue #11214: [Parquet] When reading struct-type data without an id in iceberg-parquet, it returns null values. URL: https://github.com/apache/iceberg/issues/11214 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] feat(transaction): Implement TransactionAction for updata_loc, update_props, and upgrade_format [iceberg-rust]

2025-06-15 Thread via GitHub
CTTY commented on code in PR #1433: URL: https://github.com/apache/iceberg-rust/pull/1433#discussion_r2148863363 ## crates/iceberg/src/transaction/mod.rs: ## @@ -104,32 +110,13 @@ impl Transaction { } /// Sets table to a new version. -pub fn upgrade_table_version

Re: [PR] feat(transaction): Implement TransactionAction for updata_loc, update_props, and upgrade_format [iceberg-rust]

2025-06-15 Thread via GitHub
CTTY commented on code in PR #1433: URL: https://github.com/apache/iceberg-rust/pull/1433#discussion_r2148863363 ## crates/iceberg/src/transaction/mod.rs: ## @@ -104,32 +110,13 @@ impl Transaction { } /// Sets table to a new version. -pub fn upgrade_table_version

Re: [PR] feat(transaction): Implement TransactionAction for updata_loc, update_props, and upgrade_format [iceberg-rust]

2025-06-15 Thread via GitHub
dentiny commented on code in PR #1433: URL: https://github.com/apache/iceberg-rust/pull/1433#discussion_r2148861764 ## crates/iceberg/src/transaction/mod.rs: ## @@ -104,32 +110,13 @@ impl Transaction { } /// Sets table to a new version. -pub fn upgrade_table_vers

Re: [PR] feat(transaction): Implement TransactionAction for updata_loc, update_props, and upgrade_format [iceberg-rust]

2025-06-15 Thread via GitHub
dentiny commented on code in PR #1433: URL: https://github.com/apache/iceberg-rust/pull/1433#discussion_r2148861764 ## crates/iceberg/src/transaction/mod.rs: ## @@ -104,32 +110,13 @@ impl Transaction { } /// Sets table to a new version. -pub fn upgrade_table_vers

Re: [PR] feat(transaction): Implement TransactionAction for updata_loc, update_props, and upgrade_format [iceberg-rust]

2025-06-15 Thread via GitHub
dentiny commented on code in PR #1433: URL: https://github.com/apache/iceberg-rust/pull/1433#discussion_r2148861528 ## crates/iceberg/src/transaction/mod.rs: ## @@ -104,32 +110,13 @@ impl Transaction { } /// Sets table to a new version. -pub fn upgrade_table_vers

Re: [PR] feat(transaction): Implement TransactionAction for updata_loc, update_props, and upgrade_format [iceberg-rust]

2025-06-15 Thread via GitHub
CTTY commented on code in PR #1433: URL: https://github.com/apache/iceberg-rust/pull/1433#discussion_r2148859441 ## crates/iceberg/src/transaction/mod.rs: ## @@ -104,32 +110,13 @@ impl Transaction { } /// Sets table to a new version. -pub fn upgrade_table_version

Re: [I] Add docs for Table Maintenance in Flink [iceberg]

2025-06-15 Thread via GitHub
JeonDaehong commented on issue #13307: URL: https://github.com/apache/iceberg/issues/13307#issuecomment-2974732403 > CC: @Guosmilesmile, as she is working on these features. > > I would recommend a more user focused documentation. The linked doc contains many development related detai

Re: [PR] maint: use `URI` constant instead of 'uri' strings [iceberg-python]

2025-06-15 Thread via GitHub
kevinjqliu merged PR #2094: URL: https://github.com/apache/iceberg-python/pull/2094 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [I] How can we better collect and manage Iceberg table metadata? [iceberg]

2025-06-15 Thread via GitHub
pvary commented on issue #13311: URL: https://github.com/apache/iceberg/issues/13311#issuecomment-2974676176 @slfan1989: The features you are looking for are the concerns of the catalogs. You should check the available catalog implementations and features to understand the possibilities.

Re: [I] Add docs for Table Maintenance in Flink [iceberg]

2025-06-15 Thread via GitHub
pvary commented on issue #13307: URL: https://github.com/apache/iceberg/issues/13307#issuecomment-2974674246 CC: @Guosmilesmile, as she is working on these features. I would recommend a more user focused documentation. The linked doc contains many development related details which are

[PR] maint: use `URI` constant instead of 'uri' strings [iceberg-python]

2025-06-15 Thread via GitHub
jayceslesar opened a new pull request, #2094: URL: https://github.com/apache/iceberg-python/pull/2094 Noticed a few more places we can be using the constant instead of the string! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] maint: catalog implementation roundtripping tests [iceberg-python]

2025-06-15 Thread via GitHub
jayceslesar commented on PR #2090: URL: https://github.com/apache/iceberg-python/pull/2090#issuecomment-2973977809 Ok check out the latest commit. All integration tests. Looks like unable to run locally because im missing `AWS_TEST_BUCKET`... Possible to use minio for that? -- This is an

[PR] chore(deps): Bump aws-config from 1.6.2 to 1.6.3 [iceberg-rust]

2025-06-15 Thread via GitHub
dependabot[bot] opened a new pull request, #1447: URL: https://github.com/apache/iceberg-rust/pull/1447 Bumps [aws-config](https://github.com/smithy-lang/smithy-rs) from 1.6.2 to 1.6.3. Commits See full diff in https://github.com/smithy-lang/smithy-rs/commits";>compare view

[PR] chore(deps): Bump serde_with from 3.12.0 to 3.13.0 [iceberg-rust]

2025-06-15 Thread via GitHub
dependabot[bot] opened a new pull request, #1446: URL: https://github.com/apache/iceberg-rust/pull/1446 Bumps [serde_with](https://github.com/jonasbb/serde_with) from 3.12.0 to 3.13.0. Release notes Sourced from https://github.com/jonasbb/serde_with/releases";>serde_with's release

[PR] chore(deps): Bump ordered-float from 2.10.1 to 4.6.0 [iceberg-rust]

2025-06-15 Thread via GitHub
dependabot[bot] opened a new pull request, #1445: URL: https://github.com/apache/iceberg-rust/pull/1445 Bumps [ordered-float](https://github.com/reem/rust-ordered-float) from 2.10.1 to 4.6.0. Release notes Sourced from https://github.com/reem/rust-ordered-float/releases";>ordered-f

[PR] build(deps): bump the gomod_updates group with 15 updates [iceberg-go]

2025-06-15 Thread via GitHub
dependabot[bot] opened a new pull request, #462: URL: https://github.com/apache/iceberg-go/pull/462 Bumps the gomod_updates group with 15 updates: | Package | From | To | | --- | --- | --- | | [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) | `1.36.3` | `1.3

Re: [PR] Build: Fix errorprone warnings [iceberg]

2025-06-15 Thread via GitHub
CuteChuanChuan commented on PR #13217: URL: https://github.com/apache/iceberg/pull/13217#issuecomment-2973565388 Hi @ajantha-bhat, I've resolved the conflicts and rebased against the latest upstream-main. There is no error prone warning in build. PTAL when you have a chance. Thanks

Re: [PR] Build: Bump jackson-bom from 2.19.0 to 2.19.1 [iceberg]

2025-06-15 Thread via GitHub
Fokko merged PR #13315: URL: https://github.com/apache/iceberg/pull/13315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] Build: Bump org.xerial:sqlite-jdbc from 3.49.1.0 to 3.50.1.0 [iceberg]

2025-06-15 Thread via GitHub
Fokko merged PR #13318: URL: https://github.com/apache/iceberg/pull/13318 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] Build: Bump datamodel-code-generator from 0.30.2 to 0.31.0 [iceberg]

2025-06-15 Thread via GitHub
Fokko merged PR #13319: URL: https://github.com/apache/iceberg/pull/13319 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa