Re: [PR] GCP: Add Iceberg Catalog for GCP BigQuery Metastore [iceberg]

brunsgaard commented on PR #11039: URL: https://github.com/apache/iceberg/pull/11039#issuecomment-2558261178 This issue is increasingly concerning for the community. GCP intends to introduce Iceberg as a first-class citizen, but it is perplexing that this initiative is continually being pos

Re: [PR] Spark: Relativize in-memory paths for data file and rewritable delete file locations [iceberg]

github-actions[bot] closed pull request #11525: Spark: Relativize in-memory paths for data file and rewritable delete file locations URL: https://github.com/apache/iceberg/pull/11525 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] Spark: Adding simple custom partition sort order option to RewriteManifests Spark Action [iceberg]

github-actions[bot] commented on PR #9731: URL: https://github.com/apache/iceberg/pull/9731#issuecomment-2558276855 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Config for deciding whether to use Iceberg Time type [iceberg]

github-actions[bot] commented on PR #11174: URL: https://github.com/apache/iceberg/pull/11174#issuecomment-2558276907 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [I] Iceberg bucket partitioning issue [iceberg]

github-actions[bot] commented on issue #10559: URL: https://github.com/apache/iceberg/issues/10559#issuecomment-2558276894 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [PR] Spark: Relativize in-memory paths for data file and rewritable delete file locations [iceberg]

github-actions[bot] commented on PR #11525: URL: https://github.com/apache/iceberg/pull/11525#issuecomment-2558276938 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Build: Bump calcite from 1.10.0 to 1.38.0 [iceberg]

github-actions[bot] commented on PR #11361: URL: https://github.com/apache/iceberg/pull/11361#issuecomment-2558276930 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Added support for evolving the partition of the table [iceberg]

github-actions[bot] commented on PR #11275: URL: https://github.com/apache/iceberg/pull/11275#issuecomment-2558276916 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Handling NO Coordinator Scenario and Data Loss in the current Design [iceberg]

github-actions[bot] commented on PR #11298: URL: https://github.com/apache/iceberg/pull/11298#issuecomment-2558276924 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] URL-encode partition field names in file locations [iceberg-python]

smaheshwar-pltr commented on code in PR #1457: URL: https://github.com/apache/iceberg-python/pull/1457#discussion_r1894677718 ## tests/integration/test_partitioning_key.py: ## @@ -722,6 +723,25 @@ (CAST('2023-01-01 11:55:59.99' AS TIMESTAMP), CAST('2023-01-01'

Re: [PR] Bump fastavro from 1.9.7 to 1.10.0 [iceberg-python]

Fokko merged PR #1460: URL: https://github.com/apache/iceberg-python/pull/1460 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceber

Re: [PR] Bump deptry from 0.21.1 to 0.21.2 [iceberg-python]

Fokko merged PR #1459: URL: https://github.com/apache/iceberg-python/pull/1459 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceber

Re: [PR] Build: Bump 3rd party deps [iceberg-python]

Fokko commented on PR #1454: URL: https://github.com/apache/iceberg-python/pull/1454#issuecomment-2558227430 Ray does not yet support Numpy 2.x -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] URL-encode partition field names in file locations [iceberg-python]

smaheshwar-pltr commented on code in PR #1457: URL: https://github.com/apache/iceberg-python/pull/1457#discussion_r1894677409 ## tests/integration/test_partitioning_key.py: ## @@ -722,6 +723,25 @@ (CAST('2023-01-01 11:55:59.99' AS TIMESTAMP), CAST('2023-01-01'

Re: [I] Field not found in source schema [iceberg]

stym06 commented on issue #11843: URL: https://github.com/apache/iceberg/issues/11843#issuecomment-2558104665 This is possibly due to hadoop-aws module not available in classpath that contains hdfs Implementation classes. you can import https://mvnrepository.com/artifact/org.apache.

Re: [PR] Azure: Support vended credentials refresh in ADLSFileIO. [iceberg]

ChaladiMohanVamsi commented on code in PR #11577: URL: https://github.com/apache/iceberg/pull/11577#discussion_r1894643565 ## azure/src/main/java/org/apache/iceberg/azure/adlsv2/VendedAdlsCredentialProvider.java: ## @@ -0,0 +1,197 @@ +/* + * Licensed to the Apache Software Found

Re: [PR] URL-encode partition field names in file locations [iceberg-python]

kevinjqliu commented on code in PR #1457: URL: https://github.com/apache/iceberg-python/pull/1457#discussion_r1894666959 ## tests/integration/test_partitioning_key.py: ## @@ -722,6 +723,25 @@ (CAST('2023-01-01 11:55:59.99' AS TIMESTAMP), CAST('2023-01-01' AS DA

Re: [PR] URL-encode partition field names in file locations [iceberg-python]

kevinjqliu commented on code in PR #1457: URL: https://github.com/apache/iceberg-python/pull/1457#discussion_r1894684487 ## tests/integration/test_partitioning_key.py: ## @@ -722,6 +723,25 @@ (CAST('2023-01-01 11:55:59.99' AS TIMESTAMP), CAST('2023-01-01' AS DA

Re: [PR] ci: add sccache to speed up ci build [iceberg-rust]

Fokko commented on PR #824: URL: https://github.com/apache/iceberg-rust/pull/824#issuecomment-2558233566 The downside is additional complexity and maintenance. The Windows job takes the most time, and after the change it takes even more, so the maximum runtime gets worse, just the average r

[PR] [infra] Update pyspark java iceberb library to 1.6.0 [iceberg-python]

kevinjqliu opened a new pull request, #1462: URL: https://github.com/apache/iceberg-python/pull/1462 Integration test dockerfile is using version `1.6.0` https://github.com/apache/iceberg-python/blob/325c8a55d455e479813bdfa831c450991f9c4d36/dev/Dockerfile#L39-L41 We should figure o

Re: [PR] URL-encode partition field names in file locations [iceberg-python]

kevinjqliu commented on code in PR #1457: URL: https://github.com/apache/iceberg-python/pull/1457#discussion_r1894684638 ## tests/integration/test_partitioning_key.py: ## @@ -722,6 +723,25 @@ (CAST('2023-01-01 11:55:59.99' AS TIMESTAMP), CAST('2023-01-01' AS DA

Re: [PR] Build: Bump 3rd party deps [iceberg-python]

kevinjqliu commented on code in PR #1454: URL: https://github.com/apache/iceberg-python/pull/1454#discussion_r1894684768 ## poetry.lock: ## @@ -1,4 +1,4 @@ -# This file is automatically @generated by Poetry 1.8.5 and should not be changed by hand. +# This file is automatically

Re: [PR] URL-encode partition field names in file locations [iceberg-python]

smaheshwar-pltr commented on code in PR #1457: URL: https://github.com/apache/iceberg-python/pull/1457#discussion_r1894687973 ## tests/integration/test_partitioning_key.py: ## @@ -722,6 +723,25 @@ (CAST('2023-01-01 11:55:59.99' AS TIMESTAMP), CAST('2023-01-01'

Re: [PR] URL-encode partition field names in file locations [iceberg-python]

kevinjqliu commented on code in PR #1457: URL: https://github.com/apache/iceberg-python/pull/1457#discussion_r1894689301 ## tests/integration/test_partitioning_key.py: ## @@ -722,6 +723,25 @@ (CAST('2023-01-01 11:55:59.99' AS TIMESTAMP), CAST('2023-01-01' AS DA

Re: [PR] URL-encode partition field names in file locations [iceberg-python]

smaheshwar-pltr commented on code in PR #1457: URL: https://github.com/apache/iceberg-python/pull/1457#discussion_r1894689633 ## tests/integration/test_partitioning_key.py: ## @@ -722,6 +723,25 @@ (CAST('2023-01-01 11:55:59.99' AS TIMESTAMP), CAST('2023-01-01'

[PR] Build: Bump guava from 33.3.1-jre to 33.4.0-jre [iceberg]

dependabot[bot] opened a new pull request, #11850: URL: https://github.com/apache/iceberg/pull/11850 Bumps `guava` from 33.3.1-jre to 33.4.0-jre. Updates `com.google.guava:guava` from 33.3.1-jre to 33.4.0-jre Release notes Sourced from https://github.com/google/guava/releases";>c

[PR] Build: Bump software.amazon.awssdk:bom from 2.29.34 to 2.29.39 [iceberg]

dependabot[bot] opened a new pull request, #11851: URL: https://github.com/apache/iceberg/pull/11851 Bumps software.amazon.awssdk:bom from 2.29.34 to 2.29.39. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=soft

[PR] Build: Bump junit from 5.11.3 to 5.11.4 [iceberg]

dependabot[bot] opened a new pull request, #11849: URL: https://github.com/apache/iceberg/pull/11849 Bumps `junit` from 5.11.3 to 5.11.4. Updates `org.junit.jupiter:junit-jupiter` from 5.11.3 to 5.11.4 Release notes Sourced from https://github.com/junit-team/junit5/releases";>org

[PR] Build: Bump junit-platform from 1.11.3 to 1.11.4 [iceberg]

dependabot[bot] opened a new pull request, #11848: URL: https://github.com/apache/iceberg/pull/11848 Bumps `junit-platform` from 1.11.3 to 1.11.4. Updates `org.junit.platform:junit-platform-suite-api` from 1.11.3 to 1.11.4 Commits See full diff in https://github.com/junit-tea

[PR] Build: Bump nessie from 0.101.2 to 0.101.3 [iceberg]

dependabot[bot] opened a new pull request, #11852: URL: https://github.com/apache/iceberg/pull/11852 Bumps `nessie` from 0.101.2 to 0.101.3. Updates `org.projectnessie.nessie:nessie-client` from 0.101.2 to 0.101.3 Updates `org.projectnessie.nessie:nessie-jaxrs-testextension` from 0.

[PR] Build: Bump com.google.cloud:libraries-bom from 26.51.0 to 26.52.0 [iceberg]

dependabot[bot] opened a new pull request, #11846: URL: https://github.com/apache/iceberg/pull/11846 Bumps [com.google.cloud:libraries-bom](https://github.com/googleapis/java-cloud-bom) from 26.51.0 to 26.52.0. Release notes Sourced from https://github.com/googleapis/java-cloud-bo

[PR] Build: Bump org.assertj:assertj-core from 3.26.3 to 3.27.0 [iceberg]

dependabot[bot] opened a new pull request, #11847: URL: https://github.com/apache/iceberg/pull/11847 Bumps [org.assertj:assertj-core](https://github.com/assertj/assertj) from 3.26.3 to 3.27.0. Release notes Sourced from https://github.com/assertj/assertj/releases";>org.assertj:asse

[PR] Build: Bump io.netty:netty-buffer from 4.1.115.Final to 4.1.116.Final [iceberg]

dependabot[bot] opened a new pull request, #11853: URL: https://github.com/apache/iceberg/pull/11853 Bumps [io.netty:netty-buffer](https://github.com/netty/netty) from 4.1.115.Final to 4.1.116.Final. Commits https://github.com/netty/netty/commit/2a58b07dbb22eeca2c3517c6393bd039

[PR] [docs] Replace examples of Hadoop catalog with JDBC catalog [iceberg]

kevinjqliu opened a new pull request, #11845: URL: https://github.com/apache/iceberg/pull/11845 Closes #11284 This PR replaces examples of Hadoop catalog with the JDBC catalog [devlist discussion](https://lists.apache.org/thread/2too7vobf4f4h99qonbl2ok06slsww43) ## Testing

[PR] Build: Bump mkdocs-material from 9.5.48 to 9.5.49 [iceberg]

dependabot[bot] opened a new pull request, #11854: URL: https://github.com/apache/iceberg/pull/11854 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.5.48 to 9.5.49. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>mkdoc

[PR] Build: Bump datamodel-code-generator from 0.26.3 to 0.26.4 [iceberg]

dependabot[bot] opened a new pull request, #11856: URL: https://github.com/apache/iceberg/pull/11856 Bumps [datamodel-code-generator](https://github.com/koxudaxi/datamodel-code-generator) from 0.26.3 to 0.26.4. Release notes Sourced from https://github.com/koxudaxi/datamodel-code-

[PR] Build: Bump mkdocs-awesome-pages-plugin from 2.9.3 to 2.10.0 [iceberg]

dependabot[bot] opened a new pull request, #11855: URL: https://github.com/apache/iceberg/pull/11855 Bumps [mkdocs-awesome-pages-plugin](https://github.com/lukasgeiter/mkdocs-awesome-pages-plugin) from 2.9.3 to 2.10.0. Release notes Sourced from https://github.com/lukasgeiter/mkdo

Re: [PR] URL-encode partition field names in file locations [iceberg-python]

smaheshwar-pltr commented on code in PR #1457: URL: https://github.com/apache/iceberg-python/pull/1457#discussion_r1894687973 ## tests/integration/test_partitioning_key.py: ## @@ -722,6 +723,25 @@ (CAST('2023-01-01 11:55:59.99' AS TIMESTAMP), CAST('2023-01-01'

[I] Field not found in source schema [iceberg]

rohitanil opened a new issue, #11843: URL: https://github.com/apache/iceberg/issues/11843 ### Query engine Spark ### Question I am using a REST catalog and spark iceberg on docker to read from Kafka topic, make some transformations and write it out as iceberg tables. I a

Re: [I] NullPointerException after deleting old partition column [iceberg]

mgmarino commented on issue #10626: URL: https://github.com/apache/iceberg/issues/10626#issuecomment-2558070839 @anuragmantri nice, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] Auth Manager API part 3: OAuth2 Manager [iceberg]

adutra opened a new pull request, #11844: URL: https://github.com/apache/iceberg/pull/11844 3rd PR for the Auth Manager API. Previous ones: * #11809 * #11769 This PR introduces the `OAuth2Manager` along with session caching and credentials refreshing. It is still "unplugged