[PR] Build: Bump com.aliyun.oss:aliyun-sdk-oss from 3.10.2 to 3.18.3 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] opened a new pull request, #13473: URL: https://github.com/apache/iceberg/pull/13473 Bumps [com.aliyun.oss:aliyun-sdk-oss](https://github.com/aliyun/aliyun-oss-java-sdk) from 3.10.2 to 3.18.3. Release notes Sourced from https://github.com/aliyun/aliyun-oss-java-sdk

[PR] Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.7 to 8.3.8 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] opened a new pull request, #13476: URL: https://github.com/apache/iceberg/pull/13476 Bumps [com.gradleup.shadow:shadow-gradle-plugin](https://github.com/GradleUp/shadow) from 8.3.7 to 8.3.8. Release notes Sourced from https://github.com/GradleUp/shadow/releases";>c

[PR] Build: Bump software.amazon.awssdk:bom from 2.31.73 to 2.31.77 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] opened a new pull request, #13475: URL: https://github.com/apache/iceberg/pull/13475 Bumps software.amazon.awssdk:bom from 2.31.73 to 2.31.77. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=soft

[PR] Build: Bump com.azure:azure-sdk-bom from 1.2.35 to 1.2.36 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] opened a new pull request, #13474: URL: https://github.com/apache/iceberg/pull/13474 Bumps [com.azure:azure-sdk-bom](https://github.com/azure/azure-sdk-for-java) from 1.2.35 to 1.2.36. Commits https://github.com/Azure/azure-sdk-for-java/commit/665f932cc8124cb68f

Re: [PR] Build: Bump junit from 5.12.2 to 5.13.2 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] closed pull request #13415: Build: Bump junit from 5.12.2 to 5.13.2 URL: https://github.com/apache/iceberg/pull/13415 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] Build: Bump junit from 5.12.2 to 5.13.2 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] commented on PR #13415: URL: https://github.com/apache/iceberg/pull/13415#issuecomment-3040872537 Superseded by #13469. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] Build: Bump junit-platform from 1.12.2 to 1.13.2 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] commented on PR #13418: URL: https://github.com/apache/iceberg/pull/13418#issuecomment-3040874924 Superseded by #13471. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] Build: Bump junit-platform from 1.12.2 to 1.13.2 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] closed pull request #13418: Build: Bump junit-platform from 1.12.2 to 1.13.2 URL: https://github.com/apache/iceberg/pull/13418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[PR] Build: Bump junit-platform from 1.12.2 to 1.13.3 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] opened a new pull request, #13471: URL: https://github.com/apache/iceberg/pull/13471 Bumps `junit-platform` from 1.12.2 to 1.13.3. Updates `org.junit.platform:junit-platform-launcher` from 1.12.2 to 1.13.3 Commits See full diff in https://github.com/junit-team

[PR] Build: Bump junit from 5.12.2 to 5.13.3 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] opened a new pull request, #13469: URL: https://github.com/apache/iceberg/pull/13469 Bumps `junit` from 5.12.2 to 5.13.3. Updates `org.junit.jupiter:junit-jupiter` from 5.12.2 to 5.13.3 Release notes Sourced from https://github.com/junit-team/junit-framework/relea

[PR] Build: Bump org.xerial:sqlite-jdbc from 3.50.1.0 to 3.50.2.0 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] opened a new pull request, #13468: URL: https://github.com/apache/iceberg/pull/13468 Bumps [org.xerial:sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.50.1.0 to 3.50.2.0. Release notes Sourced from https://github.com/xerial/sqlite-jdbc/releases";>org.xeri

[PR] Build: Bump com.google.cloud:libraries-bom from 26.62.0 to 26.63.0 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] opened a new pull request, #13472: URL: https://github.com/apache/iceberg/pull/13472 Bumps [com.google.cloud:libraries-bom](https://github.com/googleapis/java-cloud-bom) from 26.62.0 to 26.63.0. Release notes Sourced from https://github.com/googleapis/java-cloud-bo

[PR] Build: Bump orc from 1.9.6 to 1.9.7 [iceberg]

2025-07-05 Thread via GitHub
dependabot[bot] opened a new pull request, #13470: URL: https://github.com/apache/iceberg/pull/13470 Bumps `orc` from 1.9.6 to 1.9.7. Updates `org.apache.orc:orc-core` from 1.9.6 to 1.9.7 Updates `org.apache.orc:orc-tools` from 1.9.6 to 1.9.7 Dependabot will resolve any c

Re: [I] Add ability to pickle a `Table` [iceberg-python]

2025-07-05 Thread via GitHub
github-actions[bot] commented on issue #513: URL: https://github.com/apache/iceberg-python/issues/513#issuecomment-3040478102 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity oc

Re: [PR] Catalogs: consistently handle non-existent identifiers when loading tables/views [iceberg]

2025-07-05 Thread via GitHub
github-actions[bot] commented on PR #13223: URL: https://github.com/apache/iceberg/pull/13223#issuecomment-3040476905 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Fix(catalog): Only remove metadata files if TableOp created a new one [iceberg]

2025-07-05 Thread via GitHub
github-actions[bot] closed pull request #13169: Fix(catalog): Only remove metadata files if TableOp created a new one URL: https://github.com/apache/iceberg/pull/13169 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [PR] Fix(catalog): Only remove metadata files if TableOp created a new one [iceberg]

2025-07-05 Thread via GitHub
github-actions[bot] commented on PR #13169: URL: https://github.com/apache/iceberg/pull/13169#issuecomment-3040476894 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Build: Run SPARK CI on include path patterns [iceberg]

2025-07-05 Thread via GitHub
github-actions[bot] commented on PR #13033: URL: https://github.com/apache/iceberg/pull/13033#issuecomment-3040476879 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Implement error handling mechanism for DataException [iceberg]

2025-07-05 Thread via GitHub
github-actions[bot] commented on PR #12973: URL: https://github.com/apache/iceberg/pull/12973#issuecomment-3040476867 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Backward Compatibility Support with Field Deletion Handling [iceberg]

2025-07-05 Thread via GitHub
github-actions[bot] commented on PR #12954: URL: https://github.com/apache/iceberg/pull/12954#issuecomment-3040476850 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] pluggable routers [iceberg]

2025-07-05 Thread via GitHub
github-actions[bot] commented on PR #12859: URL: https://github.com/apache/iceberg/pull/12859#issuecomment-3040476834 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [I] Support `retainLast` and `setMinSnapshotsToKeep` Snapshot Retention Policies [iceberg-python]

2025-07-05 Thread via GitHub
ForeverAngry commented on issue #2150: URL: https://github.com/apache/iceberg-python/issues/2150#issuecomment-3040468035 @greenlaw take a look, let me know if missed anything you were looking for! -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] refactor: consolidate snapshot expiration into MaintenanceTable [iceberg-python]

2025-07-05 Thread via GitHub
ForeverAngry commented on PR #2143: URL: https://github.com/apache/iceberg-python/pull/2143#issuecomment-3040461353 @Fokko @jayceslesar, i wasn't sure when #1200 was going to be merged, and July tends to be pretty busy for me, so I thought i would use the framework for the `MaintenanceTable

[PR] feat (cli): Add Support CreateTableOpt with table properties, partition spec & sort order [iceberg-go]

2025-07-05 Thread via GitHub
dttung2905 opened a new pull request, #475: URL: https://github.com/apache/iceberg-go/pull/475 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] Added support for Bodo DataFrame [iceberg-python]

2025-07-05 Thread via GitHub
ehsantn commented on PR #2167: URL: https://github.com/apache/iceberg-python/pull/2167#issuecomment-3040304208 @kevinjqliu Thanks for the quick review. Bodo requires Python >=3.10 since Python 3.9 has been removed by some dependency packages quite a while ago. Do all optional dependencies o

Re: [PR] refactor: consolidate snapshot expiration into MaintenanceTable [iceberg-python]

2025-07-05 Thread via GitHub
ForeverAngry commented on code in PR #2143: URL: https://github.com/apache/iceberg-python/pull/2143#discussion_r2187692848 ## pyiceberg/table/maintenance.py: ## @@ -0,0 +1,399 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreeme

Re: [PR] Use short string in Variant when possible [iceberg]

2025-07-05 Thread via GitHub
aihuaxu commented on code in PR #13284: URL: https://github.com/apache/iceberg/pull/13284#discussion_r2187652979 ## core/src/main/java/org/apache/iceberg/variants/PrimitiveWrapper.java: ## @@ -53,6 +53,7 @@ class PrimitiveWrapper implements VariantPrimitive { private static f

Re: [PR] Support for TIME, TIMESTAMPNTZ_NANO, UUID types in Inclusive Metrics Evaluator [iceberg]

2025-07-05 Thread via GitHub
sfc-gh-aixu commented on code in PR #13195: URL: https://github.com/apache/iceberg/pull/13195#discussion_r2187649348 ## core/src/test/java/org/apache/iceberg/expressions/TestInclusiveMetricsEvaluatorWithExtract.java: ## @@ -683,4 +787,783 @@ public void testIntegerNotIn() {

Re: [PR] API: Follow up on adding Variant data type to implement sanitizing for Variant #11479 [iceberg]

2025-07-05 Thread via GitHub
aihuaxu commented on code in PR #13137: URL: https://github.com/apache/iceberg/pull/13137#discussion_r2187633611 ## api/src/main/java/org/apache/iceberg/expressions/ExpressionUtil.java: ## @@ -646,6 +655,88 @@ private static String sanitizeSimpleString(CharSequence value) {

Re: [PR] refactor: consolidate snapshot expiration into MaintenanceTable [iceberg-python]

2025-07-05 Thread via GitHub
jayceslesar commented on code in PR #2143: URL: https://github.com/apache/iceberg-python/pull/2143#discussion_r2187554718 ## pyiceberg/table/maintenance.py: ## @@ -0,0 +1,399 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreemen

Re: [PR] Added support for Bodo DataFrame [iceberg-python]

2025-07-05 Thread via GitHub
kevinjqliu commented on PR #2167: URL: https://github.com/apache/iceberg-python/pull/2167#issuecomment-3039528255 @ehsantn looks like theres an issue with the dependency resolution ``` poetry install --all-extras Installing dependencies from lock file The current project's sup

[PR] dev integration: add pyiceberg[pyarrow] to Dockerfile to resolve missing pyarrow import error [iceberg-python]

2025-07-05 Thread via GitHub
kevinjqliu opened a new pull request, #2174: URL: https://github.com/apache/iceberg-python/pull/2174 # Rationale for this change Adding `pyiceberg["pyarrow"]` dep to the Dockefile resolves these warning log lines: ``` Could not initialize FileIO: pyiceberg.io.pya

Re: [PR] Added catalog initialization at kafka connector start [iceberg]

2025-07-05 Thread via GitHub
kevinjqliu commented on PR #13357: URL: https://github.com/apache/iceberg/pull/13357#issuecomment-3039406763 Hey @Claudenw, thanks for the PR here! I want to verify my understanding of the underlying issue. It looks like we already fixed the underlying race condition when multiple c

Re: [I] Cannot create table named after metadata table in Spark using REST catalog [iceberg]

2025-07-05 Thread via GitHub
kevinjqliu commented on issue #13388: URL: https://github.com/apache/iceberg/issues/13388#issuecomment-3039357220 > `Running the above command fails with a BadRequestException: Malformed request: Bad Message 400reason: Ambiguous URI empty segment exception` Im curious to see what the

[PR] feat: add spdlog dependency to implement logging [iceberg-cpp]

2025-07-05 Thread via GitHub
wgtmac opened a new pull request, #140: URL: https://github.com/apache/iceberg-cpp/pull/140 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-m

Re: [PR] feat: add schema conversion from avro timestamp-millis [iceberg-python]

2025-07-05 Thread via GitHub
matthias-Q commented on PR #2173: URL: https://github.com/apache/iceberg-python/pull/2173#issuecomment-3039091062 Some notes: 1. UUID is also not 100% in line with the Avro Schema specification. But I saw, that there are other PRs pending that fixes UUID related issues. (#2007) 3.

[PR] feat: add schema conversion from avro timestamp-millis [iceberg-python]

2025-07-05 Thread via GitHub
matthias-Q opened a new pull request, #2173: URL: https://github.com/apache/iceberg-python/pull/2173 # Rationale for this change The schema coonversion util from avro schema to iceberg schema did ignore `timestamp-millis`. # Are these changes tested? Added tests for `timestamp-

Re: [PR] feat: adding schema update methods [iceberg-go]

2025-07-05 Thread via GitHub
Shreyas220 commented on PR #431: URL: https://github.com/apache/iceberg-go/pull/431#issuecomment-3039034423 > @Shreyas220 Hi, just wondering if there's any plan to continue with this PR? Hey, yes, sorry for the delay! I had addressed most of the feedback earlier, but realised I fo

Re: [PR] chore: bump C++ standard to 23 [iceberg-cpp]

2025-07-05 Thread via GitHub
zhjwpku commented on PR #139: URL: https://github.com/apache/iceberg-cpp/pull/139#issuecomment-3038879697 Waiting https://github.com/apache/arrow/issues/46998 to be resolved, but should be fine for review. -- This is an automated message from the Apache Git Service. To respond to the mess

[PR] chore: bump C++ standard to 23 [iceberg-cpp]

2025-07-05 Thread via GitHub
zhjwpku opened a new pull request, #139: URL: https://github.com/apache/iceberg-cpp/pull/139 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [PR] Build: Upgrade to Gradle 8.14.3 [iceberg]

2025-07-05 Thread via GitHub
Fokko merged PR #13465: URL: https://github.com/apache/iceberg/pull/13465 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [I] [Spec] filed path update for Variant array metadata [iceberg]

2025-07-05 Thread via GitHub
Tishj commented on issue #13462: URL: https://github.com/apache/iceberg/issues/13462#issuecomment-3038606920 Can you clarify this part: > the engines cannot prune the file containing the strings or arrays only with the lower/upper bounds, since both lower/upper bounds are represented as

[PR] Raymond/rename test classes to use test as prefix instead of suffix [iceberg]

2025-07-05 Thread via GitHub
CuteChuanChuan opened a new pull request, #13466: URL: https://github.com/apache/iceberg/pull/13466 Summary: Closes https://github.com/apache/iceberg/issues/13442 Details: - Add checkstyle rule to enforce test class naming conventions, using 'Test' as prefix - Rename