Re: [PR] Build: Bump software.amazon.s3.analyticsaccelerator:analyticsaccelerator-s3 from 1.0.0 to 1.2.0 [iceberg]

dependabot[bot] commented on PR #13417: URL: https://github.com/apache/iceberg/pull/13417#issuecomment-3066565694 Superseded by #13545. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] Build: Bump software.amazon.s3.analyticsaccelerator:analyticsaccelerator-s3 from 1.0.0 to 1.2.0 [iceberg]

dependabot[bot] closed pull request #13417: Build: Bump software.amazon.s3.analyticsaccelerator:analyticsaccelerator-s3 from 1.0.0 to 1.2.0 URL: https://github.com/apache/iceberg/pull/13417 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[PR] Build: Bump com.gorylenko.gradle-git-properties:gradle-git-properties from 2.5.0 to 2.5.2 [iceberg]

dependabot[bot] opened a new pull request, #13544: URL: https://github.com/apache/iceberg/pull/13544 Bumps com.gorylenko.gradle-git-properties:gradle-git-properties from 2.5.0 to 2.5.2. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibilit

[PR] Build: Bump net.snowflake:snowflake-jdbc from 3.24.2 to 3.25.0 [iceberg]

dependabot[bot] opened a new pull request, #13546: URL: https://github.com/apache/iceberg/pull/13546 Bumps [net.snowflake:snowflake-jdbc](https://github.com/snowflakedb/snowflake-jdbc) from 3.24.2 to 3.25.0. Release notes Sourced from https://github.com/snowflakedb/snowflake-jdbc/

[PR] Build: Bump software.amazon.s3.analyticsaccelerator:analyticsaccelerator-s3 from 1.0.0 to 1.2.1 [iceberg]

dependabot[bot] opened a new pull request, #13545: URL: https://github.com/apache/iceberg/pull/13545 Bumps [software.amazon.s3.analyticsaccelerator:analyticsaccelerator-s3](https://github.com/awslabs/analytics-accelerator-s3) from 1.0.0 to 1.2.1. Release notes Sourced from https:/

[PR] Build: Bump software.amazon.awssdk:bom from 2.31.77 to 2.31.78 [iceberg]

dependabot[bot] opened a new pull request, #13543: URL: https://github.com/apache/iceberg/pull/13543 Bumps software.amazon.awssdk:bom from 2.31.77 to 2.31.78. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=soft

[PR] Build: Bump com.google.errorprone:error_prone_annotations from 2.39.0 to 2.40.0 [iceberg]

dependabot[bot] opened a new pull request, #13542: URL: https://github.com/apache/iceberg/pull/13542 Bumps [com.google.errorprone:error_prone_annotations](https://github.com/google/error-prone) from 2.39.0 to 2.40.0. Release notes Sourced from https://github.com/google/error-prone

[PR] Build: Bump nessie from 0.104.2 to 0.104.3 [iceberg]

dependabot[bot] opened a new pull request, #13541: URL: https://github.com/apache/iceberg/pull/13541 Bumps `nessie` from 0.104.2 to 0.104.3. Updates `org.projectnessie.nessie:nessie-client` from 0.104.2 to 0.104.3 Release notes Sourced from https://github.com/projectnessie/nessie

[PR] Feature/add files retry logic 2203 [iceberg-python]

ForeverAngry opened a new pull request, #2205: URL: https://github.com/apache/iceberg-python/pull/2205 ## ✨ Improvements & Features This PR introduces an enhancement to the existing `add_files` function here: https://github.com/apache/iceberg-python/blob/dc439402e33d642c9a0c3261f1

Re: [PR] Spark 4.0, 3.5: Add configuration to disable executor cache for delete files [iceberg]

anuragmantri commented on PR #12893: URL: https://github.com/apache/iceberg/pull/12893#issuecomment-3066302500 I added the same changes for Spark 4.0 since it is the current branch. I'm still working on a unit test to test these changes. -- This is an automated message from the Apache Git

Re: [PR] Core: Add manifest writer pool to avoid commit delays [iceberg]

github-actions[bot] commented on PR #13296: URL: https://github.com/apache/iceberg/pull/13296#issuecomment-3066292836 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Catalogs: consistently handle non-existent identifiers when loading tables/views [iceberg]

github-actions[bot] commented on PR #13223: URL: https://github.com/apache/iceberg/pull/13223#issuecomment-3066292820 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Spark: Custom snapshot property from session configuration [iceberg]

github-actions[bot] commented on PR #12999: URL: https://github.com/apache/iceberg/pull/12999#issuecomment-3066292789 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Build: Run SPARK CI on include path patterns [iceberg]

github-actions[bot] closed pull request #13033: Build: Run SPARK CI on include path patterns URL: https://github.com/apache/iceberg/pull/13033 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] More clarification needed for Avro to iceberg data type conversion for timestamp variants [iceberg]

github-actions[bot] commented on issue #11890: URL: https://github.com/apache/iceberg/issues/11890#issuecomment-3066292749 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] Atomic operation when writing to Icebergtables via flink [iceberg]

github-actions[bot] commented on issue #11944: URL: https://github.com/apache/iceberg/issues/11944#issuecomment-3066292769 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] More clarification needed for Avro to iceberg data type conversion for timestamp variants [iceberg]

github-actions[bot] closed issue #11890: More clarification needed for Avro to iceberg data type conversion for timestamp variants URL: https://github.com/apache/iceberg/issues/11890 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [PR] Catalogs: consistently handle non-existent identifiers when loading tables/views [iceberg]

github-actions[bot] closed pull request #13223: Catalogs: consistently handle non-existent identifiers when loading tables/views URL: https://github.com/apache/iceberg/pull/13223 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] Build: Run SPARK CI on include path patterns [iceberg]

github-actions[bot] commented on PR #13033: URL: https://github.com/apache/iceberg/pull/13033#issuecomment-3066292800 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [I] Iceberg Metadata for Variant Shredding [iceberg]

github-actions[bot] commented on issue #11958: URL: https://github.com/apache/iceberg/issues/11958#issuecomment-3066292776 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

[PR] fix a typo in TestDataFileIndexStatsFilters [iceberg]

hussein-awala opened a new pull request, #13540: URL: https://github.com/apache/iceberg/pull/13540 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

Re: [PR] Spark: Reordering partitions via partition evolution can disable SPJ [iceberg]

singhpk234 commented on code in PR #13534: URL: https://github.com/apache/iceberg/pull/13534#discussion_r2202926433 ## spark/v3.4/spark/src/test/java/org/apache/iceberg/spark/sql/TestStoragePartitionedJoins.java: ## @@ -370,6 +370,54 @@ public void testJoinsWithCompatibleSpecEvo

[PR] Add support for nested field partitioning [iceberg-python]

geruh opened a new pull request, #2204: URL: https://github.com/apache/iceberg-python/pull/2204 Closes #2095 # Rationale for this change Currently, we can only partition on top-level valid field types, but this PR adds support for partitioning on primitive fields in a struct type

[I] add_files retry logic [iceberg-python]

MrDerecho opened a new issue, #2203: URL: https://github.com/apache/iceberg-python/issues/2203 ### Feature Request / Improvement Is it possible to include support for retry logic upon exception due to "commit failed"? The situation is that I have multiple processes using add_files t

Re: [I] Duplicate File Remediation [iceberg-python]

ForeverAngry commented on issue #2130: URL: https://github.com/apache/iceberg-python/issues/2130#issuecomment-3065922985 @kevinjqliu can you assign me to this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] Merge snapshots into 1 under transaction of multiple operations [iceberg-python]

jayceslesar commented on issue #2201: URL: https://github.com/apache/iceberg-python/issues/2201#issuecomment-3065906417 https://github.com/apache/iceberg-python/issues/2152 related -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[PR] Fix Spark DDL Doc bug [iceberg]

davidyuan1223 opened a new pull request, #13539: URL: https://github.com/apache/iceberg/pull/13539 Issue: #13538 Fix the Spark Doc Bug about CREATE OR REPLACE VIEW -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[I] Spark DDL Doc Error [iceberg]

davidyuan1223 opened a new issue, #13538: URL: https://github.com/apache/iceberg/issues/13538 ### Apache Iceberg version 1.9.1 (latest release) ### Query engine Spark ### Please describe the bug 🐞 In the spark DDL doc, create or replace view, we use `

[PR] Part 2: Integrate Scan Planning to Core [iceberg]

singhpk234 opened a new pull request, #13400: URL: https://github.com/apache/iceberg/pull/13400 ### 🥞 Stacked PR Please use this [link](https://github.com/apache/iceberg/pull/13400/commits/c55e0e400a5c4102fdd40697d0e8f0e3aa0b0613) for viewing incremental changes. Current Stac

Re: [PR] Part 2: Integrate Scan Planning to Core [iceberg]

singhpk234 closed pull request #13400: Part 2: Integrate Scan Planning to Core URL: https://github.com/apache/iceberg/pull/13400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] Schema evolution tests with initial defaults [iceberg]

anoopj opened a new pull request, #13537: URL: https://github.com/apache/iceberg/pull/13537 Add a test case to the existing schema evolution test case to add new column with an initial default. -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] OpenAPI: Add missing schema field for TableMetadata [iceberg]

Bhargavkonidena commented on PR #13152: URL: https://github.com/apache/iceberg/pull/13152#issuecomment-3065677442 @nastra Shall I send request from another email ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] Merge snapshots into 1 under transaction of multiple operations [iceberg-python]

jim-ngoo commented on issue #2201: URL: https://github.com/apache/iceberg-python/issues/2201#issuecomment-3065580023 > Hi! There is! However, some of the approaches come to mind might require some changes to how you are looking to add data. So i can better help, do you plan only only ever

Re: [I] ALTER TABLE... WRITE LOCALLY ORDERED BY not properly setting the write.distribution-mode table property [iceberg]

manuzhang commented on issue #13526: URL: https://github.com/apache/iceberg/issues/13526#issuecomment-3065573880 It's after #10744 in 1.7.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] Merge snapshots into 1 under transaction of multiple operations [iceberg-python]

ForeverAngry commented on issue #2201: URL: https://github.com/apache/iceberg-python/issues/2201#issuecomment-3065570340 Hi! There is! However, some of the approaches come to mind might require some changes to how you are looking to add data. So i can better help, do you plan only only eve

Re: [PR] Enforce that test classes start with "Test" instead of suffix [iceberg]

CuteChuanChuan commented on PR #13466: URL: https://github.com/apache/iceberg/pull/13466#issuecomment-3065551314 Hi @amogh-jahagirdar , as suggested, the test class (`TestSmoke`) was renamed. PTAL. Thanks! -- This is an automated message from the Apache Git Service. To respond to th

Re: [I] Merge snapshots into 1 under transaction of multiple operations [iceberg-python]

jim-ngoo commented on issue #2201: URL: https://github.com/apache/iceberg-python/issues/2201#issuecomment-3065486606 > > ### Question > > For my use case, I have a daily cron job that batch process and append data but I only want a single snapshot record after the whole process. I tried

Re: [PR] Enforce that test classes start with "Test" instead of suffix [iceberg]

CuteChuanChuan commented on code in PR #13466: URL: https://github.com/apache/iceberg/pull/13466#discussion_r2202433968 ## spark/v4.0/spark-runtime/src/integration/java/org/apache/iceberg/spark/TestSmoke.java: ## @@ -31,7 +31,7 @@ import org.junit.jupiter.api.extension.ExtendWi

[I] Iceberg Kafka Connect sink ignores existing topic data on first run and delays initial commit [iceberg]

mohsenify opened a new issue, #13536: URL: https://github.com/apache/iceberg/issues/13536 ### Apache Iceberg version 1.9.1 (latest release) ### Query engine Kafka Connect ### Please describe the bug 🐞 I encountered two issues while using the Iceberg Kafka Co