Re: [PR] feat: validate snapshot write compatibility [iceberg-python]

2025-03-08 Thread via GitHub
Fokko commented on code in PR #1772: URL: https://github.com/apache/iceberg-python/pull/1772#discussion_r1986237088 ## pyiceberg/utils/snapshot.py: ## @@ -0,0 +1,53 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See

Re: [PR] Build: Bump software.amazon.awssdk:bom from 2.30.26 to 2.30.31 [iceberg]

2025-03-08 Thread via GitHub
Fokko merged PR #12439: URL: https://github.com/apache/iceberg/pull/12439 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [I] --output json not supported? [iceberg-go]

2025-03-08 Thread via GitHub
ayush1009208 commented on issue #325: URL: https://github.com/apache/iceberg-go/issues/325#issuecomment-2708700821 @zeroshade i will work on this issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[PR] Build: Bump testcontainers from 1.20.5 to 1.20.6 [iceberg]

2025-03-08 Thread via GitHub
dependabot[bot] opened a new pull request, #12484: URL: https://github.com/apache/iceberg/pull/12484 Bumps `testcontainers` from 1.20.5 to 1.20.6. Updates `org.testcontainers:testcontainers` from 1.20.5 to 1.20.6 Release notes Sourced from https://github.com/testcontainers/testco

[PR] Build: Bump com.gorylenko.gradle-git-properties:gradle-git-properties from 2.4.2 to 2.5.0 [iceberg]

2025-03-08 Thread via GitHub
dependabot[bot] opened a new pull request, #12486: URL: https://github.com/apache/iceberg/pull/12486 Bumps com.gorylenko.gradle-git-properties:gradle-git-properties from 2.4.2 to 2.5.0. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibilit

Re: [PR] Build: Bump software.amazon.awssdk:bom from 2.30.26 to 2.30.31 [iceberg]

2025-03-08 Thread via GitHub
dependabot[bot] commented on PR #12439: URL: https://github.com/apache/iceberg/pull/12439#issuecomment-2708672618 A newer version of software.amazon.awssdk:bom exists, but since this PR has been edited by someone other than Dependabot I haven't updated it. You'll get a PR for the updated ve

[PR] Build: Bump com.google.cloud:libraries-bom from 26.55.0 to 26.56.0 [iceberg]

2025-03-08 Thread via GitHub
dependabot[bot] opened a new pull request, #12485: URL: https://github.com/apache/iceberg/pull/12485 Bumps [com.google.cloud:libraries-bom](https://github.com/googleapis/java-cloud-bom) from 26.55.0 to 26.56.0. Release notes Sourced from https://github.com/googleapis/java-cloud-bo

[PR] Build: Bump mkdocs-material from 9.6.6 to 9.6.7 [iceberg]

2025-03-08 Thread via GitHub
dependabot[bot] opened a new pull request, #12483: URL: https://github.com/apache/iceberg/pull/12483 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.6.6 to 9.6.7. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>mkdocs-

Re: [I] Extends Iceberg table stats API to allow publish data and stats atomically [iceberg]

2025-03-08 Thread via GitHub
github-actions[bot] closed issue #6442: Extends Iceberg table stats API to allow publish data and stats atomically URL: https://github.com/apache/iceberg/issues/6442 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Open-API: Fix compilation errors in generated Java classes due to mismatched return types [iceberg]

2025-03-08 Thread via GitHub
github-actions[bot] commented on PR #11806: URL: https://github.com/apache/iceberg/pull/11806#issuecomment-2708569896 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think thatโ€™s incorrect or this pul

Re: [I] Support Rest Catalog Metrics Endpoint [iceberg-python]

2025-03-08 Thread via GitHub
github-actions[bot] commented on issue #474: URL: https://github.com/apache/iceberg-python/issues/474#issuecomment-2708571265 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apac

Re: [I] Support Rest Catalog Metrics Endpoint [iceberg-python]

2025-03-08 Thread via GitHub
github-actions[bot] closed issue #474: Support Rest Catalog Metrics Endpoint URL: https://github.com/apache/iceberg-python/issues/474 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] Spark: DVs + Positional Deletes + Compaction [iceberg]

2025-03-08 Thread via GitHub
github-actions[bot] commented on PR #12181: URL: https://github.com/apache/iceberg/pull/12181#issuecomment-2708569948 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think thatโ€™s incorrect or this pul

Re: [PR] Spark: Action to remove missing files [iceberg]

2025-03-08 Thread via GitHub
github-actions[bot] commented on PR #12106: URL: https://github.com/apache/iceberg/pull/12106#issuecomment-2708569935 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Spark: Action to remove missing files [iceberg]

2025-03-08 Thread via GitHub
github-actions[bot] closed pull request #12106: Spark: Action to remove missing files URL: https://github.com/apache/iceberg/pull/12106 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] WIP generic reader [iceberg]

2025-03-08 Thread via GitHub
github-actions[bot] commented on PR #12069: URL: https://github.com/apache/iceberg/pull/12069#issuecomment-2708569913 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] WIP generic reader [iceberg]

2025-03-08 Thread via GitHub
github-actions[bot] closed pull request #12069: WIP generic reader URL: https://github.com/apache/iceberg/pull/12069 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [I] Iceberg Glue Concurrent Update can result in missing metadata_location [iceberg]

2025-03-08 Thread via GitHub
github-actions[bot] commented on issue #9411: URL: https://github.com/apache/iceberg/issues/9411#issuecomment-2708569811 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] com.esotericsoftware.kryo.KryoException: java.lang.ClassCastException: java.lang.Integer cannot be cast to java.nio.ByteBuffer [iceberg]

2025-03-08 Thread via GitHub
github-actions[bot] commented on issue #9738: URL: https://github.com/apache/iceberg/issues/9738#issuecomment-2708569826 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Support for REPLACE TABLE operation [iceberg-python]

2025-03-08 Thread via GitHub
srilman commented on PR #433: URL: https://github.com/apache/iceberg-python/pull/433#issuecomment-2708554806 @anupam-saini Are you still working on this PR? For context, we are doing some _interesting_ (and probably wrong) stuff to mimic Iceberg Java's REPLACE TABLE in https://github.com/b

[I] Apply Filter on Top-Level Struct Columns [iceberg-python]

2025-03-08 Thread via GitHub
srilman opened a new issue, #1778: URL: https://github.com/apache/iceberg-python/issues/1778 ### Apache Iceberg version 0.9.0 (latest release) ### Please describe the bug ๐Ÿž When attempting to apply filter to top-level struct columns, such as null / not-null, an error occ

Re: [PR] Support Spark Column Stats [iceberg]

2025-03-08 Thread via GitHub
wypoon commented on code in PR #10659: URL: https://github.com/apache/iceberg/pull/10659#discussion_r1986161732 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/source/SparkScan.java: ## @@ -175,7 +186,43 @@ public Statistics estimateStatistics() { protected Statist

Re: [PR] Spark: Use correct statistics file in SparkScan::estimateStatistics(Snapshot) [iceberg]

2025-03-08 Thread via GitHub
wypoon commented on code in PR #12482: URL: https://github.com/apache/iceberg/pull/12482#discussion_r1986150146 ## spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/source/TestSparkScan.java: ## @@ -279,12 +268,50 @@ public void testTableWithOneColStats() throws NoSuchTab

[PR] Add pull-request template [iceberg-python]

2025-03-08 Thread via GitHub
Fokko opened a new pull request, #1777: URL: https://github.com/apache/iceberg-python/pull/1777 While @kevinjqliu did an amazing job summarizing the new stuff in 0.9.0 in the GitHub release (https://github.com/apache/iceberg-python/releases/tag/pyiceberg-0.9.0), I think it would be good to

Re: [PR] [docs] Update "how to release" doc [iceberg-python]

2025-03-08 Thread via GitHub
Fokko commented on code in PR #1700: URL: https://github.com/apache/iceberg-python/pull/1700#discussion_r1986139682 ## mkdocs/docs/how-to-release.md: ## @@ -407,5 +409,12 @@ cd icebergsvn echo "" >> KEYS # append a newline gpg --list-sigs >> KEYS # append signatures gpg --ar

Re: [PR] [docs] Update "how to release" doc [iceberg-python]

2025-03-08 Thread via GitHub
Fokko commented on code in PR #1700: URL: https://github.com/apache/iceberg-python/pull/1700#discussion_r1986139647 ## mkdocs/docs/how-to-release.md: ## @@ -407,5 +409,12 @@ cd icebergsvn echo "" >> KEYS # append a newline gpg --list-sigs >> KEYS # append signatures gpg --ar

Re: [PR] [docs] Update "how to release" doc [iceberg-python]

2025-03-08 Thread via GitHub
Fokko commented on code in PR #1700: URL: https://github.com/apache/iceberg-python/pull/1700#discussion_r1986139626 ## mkdocs/docs/how-to-release.md: ## @@ -29,7 +29,9 @@ This guide outlines the process for releasing PyIceberg in accordance with the [ ## Requirements -* A

Re: [PR] Docs: fix typo in rest-catalog-open-api.yaml. [iceberg]

2025-03-08 Thread via GitHub
Fokko merged PR #12480: URL: https://github.com/apache/iceberg/pull/12480 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] Azure: Support vended credentials refresh in ADLSFileIO. [iceberg]

2025-03-08 Thread via GitHub
ChaladiMohanVamsi commented on code in PR #11577: URL: https://github.com/apache/iceberg/pull/11577#discussion_r1986138213 ## azure/src/main/java/org/apache/iceberg/azure/adlsv2/AzureSasCredentialRefresher.java: ## @@ -0,0 +1,69 @@ +/* + * Licensed to the Apache Software Foundat

Re: [I] --output json not supported? [iceberg-go]

2025-03-08 Thread via GitHub
zeroshade commented on issue #325: URL: https://github.com/apache/iceberg-go/issues/325#issuecomment-2708452053 @knoguchi correct, it's planned but not yet implemented. @ayush1009208 it would be great if could contribute an implementation of the json output ๐Ÿ˜„ -- This is an automa

Re: [PR] FIX: retry REST catalog on 401 UnauthorizedError with refresh token [iceberg-python]

2025-03-08 Thread via GitHub
sungwy commented on PR #1517: URL: https://github.com/apache/iceberg-python/pull/1517#issuecomment-2708419952 Hi @MChamberlin thanks for following up! This PR was recently merged to introduce the fix following the decision to deprecate the 419 status code in the catalog community. Could you

Re: [PR] feat: add support for azure blob with connection string/sas token/account key [iceberg-go]

2025-03-08 Thread via GitHub
xuhui-lu commented on code in PR #313: URL: https://github.com/apache/iceberg-go/pull/313#discussion_r1986122282 ## io/azure.go: ## @@ -0,0 +1,104 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See the NOTICE file +

Re: [PR] FIX: retry REST catalog on 401 UnauthorizedError with refresh token [iceberg-python]

2025-03-08 Thread via GitHub
MChamberlin commented on PR #1517: URL: https://github.com/apache/iceberg-python/pull/1517#issuecomment-2708369228 @kevinjqliu @sungwy Given the decision on https://github.com/apache/polaris/issues/791, I am re-opening this PR. -- This is an automated message from the Apache Git Service.

[PR] FIX: retry REST catalog on 401 UnauthorizedError with refresh token [iceberg-python]

2025-03-08 Thread via GitHub
MChamberlin opened a new pull request, #1517: URL: https://github.com/apache/iceberg-python/pull/1517 Some REST catalog implementations (including the Snowflake Polaris catalog) return a 401 when a token is expired, raising an `UnauthorizedError` within pyiceberg. Refreshing the token, as i

Re: [I] Support for S3 catalog to work with S3 Tables [iceberg-python]

2025-03-08 Thread via GitHub
felixscherz commented on issue #1404: URL: https://github.com/apache/iceberg-python/issues/1404#issuecomment-2708367315 Hi, the PR for this feature is done and in review at the moment: https://github.com/apache/iceberg-python/pull/1429 :) -- This is an automated message from the Apache G

Re: [I] Issue during Upsert [iceberg-python]

2025-03-08 Thread via GitHub
heman026 commented on issue #1759: URL: https://github.com/apache/iceberg-python/issues/1759#issuecomment-2702980670 ### Full stack trace of the issue: **Exception has occurred: RecursionError** > maximum recursion depth exceeded > AttributeError: '_thread._local' object has no

[PR] feat: validate snapshot write compatibility [iceberg-python]

2025-03-08 Thread via GitHub
kaushiksrini opened a new pull request, #1772: URL: https://github.com/apache/iceberg-python/pull/1772 ## Description - This PR checks snapshot write compatibility and validates no conflicting concurrent operations have been written that can clash. - Added Snapshot util file that i

Re: [PR] feat: nan_value_counts support [iceberg-rust]

2025-03-08 Thread via GitHub
feniljain commented on PR #907: URL: https://github.com/apache/iceberg-rust/pull/907#issuecomment-2708274803 Hey @liurenjie1024 ๐Ÿ‘‹๐Ÿป Thanks for being patient, I think this time I have covered all the cases properly, there's a small discussion around `LargeList` and `FixedSizeList` whic

Re: [PR] refine: make commit more general [iceberg-rust]

2025-03-08 Thread via GitHub
liurenjie1024 merged PR #1048: URL: https://github.com/apache/iceberg-rust/pull/1048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [I] RUSTSEC-2024-0436: paste - no longer maintained [iceberg-rust]

2025-03-08 Thread via GitHub
liurenjie1024 commented on issue #1053: URL: https://github.com/apache/iceberg-rust/issues/1053#issuecomment-2708156233 Seems no alternatives provided, close for now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] feat: support strict projection [iceberg-rust]

2025-03-08 Thread via GitHub
sdd commented on code in PR #946: URL: https://github.com/apache/iceberg-rust/pull/946#discussion_r1983907055 ## crates/iceberg/src/expr/visitors/strict_projection.rs: ## @@ -0,0 +1,3231 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor li

Re: [I] RUSTSEC-2024-0436: paste - no longer maintained [iceberg-rust]

2025-03-08 Thread via GitHub
liurenjie1024 closed issue #1053: RUSTSEC-2024-0436: paste - no longer maintained URL: https://github.com/apache/iceberg-rust/issues/1053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] --output json not supported? [iceberg-go]

2025-03-08 Thread via GitHub
ayush1009208 commented on issue #325: URL: https://github.com/apache/iceberg-go/issues/325#issuecomment-2708162456 I am here to contribute on this issue please explain -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [I] --output json not supported? [iceberg-go]

2025-03-08 Thread via GitHub
knoguchi commented on issue #325: URL: https://github.com/apache/iceberg-go/issues/325#issuecomment-2708132269 Is the json output type planned but never implemented? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th