Re: [PR] fix: fix http custom headers for rest catalog [iceberg-rust]

2025-03-09 Thread via GitHub
Xuanwo commented on code in PR #1010: URL: https://github.com/apache/iceberg-rust/pull/1010#discussion_r1986611356 ## crates/catalog/rest/src/client.rs: ## @@ -214,7 +214,9 @@ impl HttpClient { #[inline] pub fn request(&self, method: Method, url: U) -> RequestBuilde

Re: [PR] fix: fix http custom headers for rest catalog [iceberg-rust]

2025-03-09 Thread via GitHub
liurenjie1024 commented on code in PR #1010: URL: https://github.com/apache/iceberg-rust/pull/1010#discussion_r1986608581 ## crates/catalog/rest/src/client.rs: ## @@ -214,7 +214,9 @@ impl HttpClient { #[inline] pub fn request(&self, method: Method, url: U) -> Reques

[I] Delete a row (primary key ID) from iceberg table [iceberg]

2025-03-09 Thread via GitHub
Shekharrajak opened a new issue, #12490: URL: https://github.com/apache/iceberg/issues/12490 ### Query engine _No response_ ### Question Can anyone help how we can remove a row from current snapshot and all the past snapshots ? -- This is an automated message from the

Re: [PR] feat: nan_value_counts support [iceberg-rust]

2025-03-09 Thread via GitHub
liurenjie1024 commented on code in PR #907: URL: https://github.com/apache/iceberg-rust/pull/907#discussion_r1986559287 ## crates/iceberg/src/writer/file_writer/parquet_writer.rs: ## @@ -509,6 +584,89 @@ impl ParquetWriter { Ok(builder) } + +fn transverse_bat

[I] Remove `paste` dependency. [iceberg-rust]

2025-03-09 Thread via GitHub
liurenjie1024 opened a new issue, #1064: URL: https://github.com/apache/iceberg-rust/issues/1064 ### Is your feature request related to a problem or challenge? As describen in #1053 , `paste` crate is no longer maintained. ### Describe the solution you'd like We need to

[PR] Ignore paste crate [iceberg-rust]

2025-03-09 Thread via GitHub
liurenjie1024 opened a new pull request, #1063: URL: https://github.com/apache/iceberg-rust/pull/1063 ## Which issue does this PR close? - Closes #1062 . ## What changes are included in this PR? A temporary workaround for #1053 . ## Are these change

[I] Ignore `paste` in audit check. [iceberg-rust]

2025-03-09 Thread via GitHub
liurenjie1024 opened a new issue, #1062: URL: https://github.com/apache/iceberg-rust/issues/1062 ### Is your feature request related to a problem or challenge? `paste` crate is no longer maintained, and the audit check failed for all prs. ### Describe the solution you'd like

Re: [PR] Build: Rename versions.spark.hive3* to versions.spark3* [iceberg]

2025-03-09 Thread via GitHub
pan3793 commented on PR #12489: URL: https://github.com/apache/iceberg/pull/12489#issuecomment-2709318730 cc @huaxingao @szehon-ho -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[PR] Build: Rename versions.spark.hive3* to versions.spark3* [iceberg]

2025-03-09 Thread via GitHub
pan3793 opened a new pull request, #12489: URL: https://github.com/apache/iceberg/pull/12489 `versions.spark.hive35` actually defines Spark version, though Iceberg only explicitly pulls `spark-hive_${scalaBinaryVersion}` -- This is an automated message from the Apache Git Service. To resp

[I] Add documentation for `arrow_schema_to_schema` method to clarify for requirements of field id. [iceberg-rust]

2025-03-09 Thread via GitHub
liurenjie1024 opened a new issue, #1061: URL: https://github.com/apache/iceberg-rust/issues/1061 ### Is your feature request related to a problem or challenge? See https://github.com/apache/iceberg-rust/discussions/1051 We should add documentation in arrow module to clarify requiremen

Re: [PR] Support for REPLACE TABLE operation [iceberg-python]

2025-03-09 Thread via GitHub
anupam-saini commented on PR #433: URL: https://github.com/apache/iceberg-python/pull/433#issuecomment-2709180688 > @anupam-saini Are you still working on this PR? For context, we are doing some _interesting_ (and probably wrong) stuff to mimic Iceberg Java's REPLACE TABLE in https://githu

Re: [PR] Support for REPLACE TABLE operation [iceberg-python]

2025-03-09 Thread via GitHub
anupam-saini commented on PR #433: URL: https://github.com/apache/iceberg-python/pull/433#issuecomment-2709181733 @srilman let me know if you would like to open a new PR. I can close this one -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] feat: support update for memory catalog [iceberg-rust]

2025-03-09 Thread via GitHub
ZENOTME commented on PR #1002: URL: https://github.com/apache/iceberg-rust/pull/1002#issuecomment-2703236791 > Thanks @ZENOTME for this pr. The reason we don't add update table support before is that currently the table transaction api is not complete yet, and we should not add this in cata

Re: [PR] Range distribution iceberg sink [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] commented on PR #12071: URL: https://github.com/apache/iceberg/pull/12071#issuecomment-2709153324 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] [docs] Replace examples of Hadoop catalog with JDBC & REST catalog [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] commented on PR #11845: URL: https://github.com/apache/iceberg/pull/11845#issuecomment-2709153287 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] [docs] Replace examples of Hadoop catalog with JDBC & REST catalog [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] closed pull request #11845: [docs] Replace examples of Hadoop catalog with JDBC & REST catalog URL: https://github.com/apache/iceberg/pull/11845 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] Type Promotion: Long to Timestamp [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] commented on issue #9065: URL: https://github.com/apache/iceberg/issues/9065#issuecomment-2709153149 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Kafka Connect: auto create with lowercase columns [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] commented on issue #11091: URL: https://github.com/apache/iceberg/issues/11091#issuecomment-2709153220 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [PR] [Docs] Update spark-getting-started docs page to make the example valid [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] closed pull request #11923: [Docs] Update spark-getting-started docs page to make the example valid URL: https://github.com/apache/iceberg/pull/11923 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [Docs] Update spark-getting-started docs page to make the example valid [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] commented on PR #11923: URL: https://github.com/apache/iceberg/pull/11923#issuecomment-2709153312 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Spark: DVs + Positional Deletes [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] closed pull request #11675: Spark: DVs + Positional Deletes URL: https://github.com/apache/iceberg/pull/11675 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Spark: DVs + Positional Deletes [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] commented on PR #11675: URL: https://github.com/apache/iceberg/pull/11675#issuecomment-2709153260 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [I] Type Promotion: Long to Timestamp [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] closed issue #9065: Type Promotion: Long to Timestamp URL: https://github.com/apache/iceberg/issues/9065 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Add unit test for AddFilesProcedure to check invalid column in partition filter [iceberg]

2025-03-09 Thread via GitHub
ebyhr commented on code in PR #12456: URL: https://github.com/apache/iceberg/pull/12456#discussion_r1986445605 ## spark/v3.5/spark-extensions/src/test/java/org/apache/iceberg/spark/extensions/TestAddFilesProcedure.java: ## @@ -830,6 +830,44 @@ public void invalidDataImportPartit

Re: [PR] Docs: Update Iceberg talks with recent Iceberg meetup sessions [iceberg]

2025-03-09 Thread via GitHub
ebyhr commented on code in PR #12481: URL: https://github.com/apache/iceberg/pull/12481#discussion_r1986445057 ## site/docs/talks.md: ## @@ -21,6 +21,86 @@ title: "Talks" ## Iceberg Talks Here is a list of talks and other videos related to Iceberg. +### [Supporting S3 Tables

Re: [PR] build(deps): bump the gomod_updates group with 15 updates [iceberg-go]

2025-03-09 Thread via GitHub
zeroshade merged PR #328: URL: https://github.com/apache/iceberg-go/pull/328 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [I] Iceberg with Dataproc Metastore: MERGE INTO TABLE is not supported temporarily [iceberg]

2025-03-09 Thread via GitHub
thealmightygrant commented on issue #6998: URL: https://github.com/apache/iceberg/issues/6998#issuecomment-2709061478 Thanks! Just wanted to say that @alhaiz313's solution worked for me here too. It's also in the docs [here](https://iceberg.apache.org/docs/1.5.2/spark-configuration/#sql-ext

Re: [I] Core: Add View support for Glue catalog [iceberg]

2025-03-09 Thread via GitHub
lawofcycles commented on issue #12488: URL: https://github.com/apache/iceberg/issues/12488#issuecomment-2708964447 I would like to contribute on this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[I] Core: Add View support for Glue catalog [iceberg]

2025-03-09 Thread via GitHub
lawofcycles opened a new issue, #12488: URL: https://github.com/apache/iceberg/issues/12488 ### Feature Request / Improvement Add capability for Glue Catalog to handle Views. AWS Glue has recently provided a REST Catalog endpoint. Since many users are still using the Glue Catalog

Re: [PR] refactor: REST `Catalog` implementation [iceberg-rust]

2025-03-09 Thread via GitHub
Xuanwo commented on PR #965: URL: https://github.com/apache/iceberg-rust/pull/965#issuecomment-2703297501 I'll merge this PR in three days if there are no further objections. I believe it's on the right track, and additional polish can be made on top of it. -- This is an automated message

[PR] chore(deps): Bump mockito from 1.6.1 to 1.7.0 [iceberg-rust]

2025-03-09 Thread via GitHub
dependabot[bot] opened a new pull request, #1056: URL: https://github.com/apache/iceberg-rust/pull/1056 Bumps [mockito](https://github.com/lipanski/mockito) from 1.6.1 to 1.7.0. Release notes Sourced from https://github.com/lipanski/mockito/releases";>mockito's releases. 1.7

Re: [PR] Build: Bump mkdocs-material from 9.6.6 to 9.6.7 [iceberg]

2025-03-09 Thread via GitHub
Fokko merged PR #12483: URL: https://github.com/apache/iceberg/pull/12483 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

[PR] chore(deps): Bump aws-sdk-glue from 1.82.0 to 1.84.0 [iceberg-rust]

2025-03-09 Thread via GitHub
dependabot[bot] opened a new pull request, #1057: URL: https://github.com/apache/iceberg-rust/pull/1057 Bumps [aws-sdk-glue](https://github.com/awslabs/aws-sdk-rust) from 1.82.0 to 1.84.0. Commits See full diff in https://github.com/awslabs/aws-sdk-rust/commits";>compare view

[PR] chore(deps): Bump either from 1.13.0 to 1.15.0 [iceberg-rust]

2025-03-09 Thread via GitHub
dependabot[bot] opened a new pull request, #1060: URL: https://github.com/apache/iceberg-rust/pull/1060 Bumps [either](https://github.com/rayon-rs/either) from 1.13.0 to 1.15.0. Commits https://github.com/rayon-rs/either/commit/59ae1fce0cec62c886fcd486e06b7e219bc7ce48";>59ae1fc

[PR] chore(deps): Bump tempfile from 3.17.1 to 3.18.0 [iceberg-rust]

2025-03-09 Thread via GitHub
dependabot[bot] opened a new pull request, #1059: URL: https://github.com/apache/iceberg-rust/pull/1059 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.17.1 to 3.18.0. Changelog Sourced from https://github.com/Stebalien/tempfile/blob/master/CHANGELOG.md";>tempfile's

[PR] chore(deps): Bump aws-sdk-s3tables from 1.10.0 to 1.12.0 [iceberg-rust]

2025-03-09 Thread via GitHub
dependabot[bot] opened a new pull request, #1055: URL: https://github.com/apache/iceberg-rust/pull/1055 Bumps [aws-sdk-s3tables](https://github.com/awslabs/aws-sdk-rust) from 1.10.0 to 1.12.0. Commits See full diff in https://github.com/awslabs/aws-sdk-rust/commits";>compare vi

[PR] chore(deps): Bump tokio from 1.43.0 to 1.44.0 [iceberg-rust]

2025-03-09 Thread via GitHub
dependabot[bot] opened a new pull request, #1058: URL: https://github.com/apache/iceberg-rust/pull/1058 Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.43.0 to 1.44.0. Release notes Sourced from https://github.com/tokio-rs/tokio/releases";>tokio's releases. Tokio v1.4

[PR] chore(deps): Bump crate-ci/typos from 1.30.0 to 1.30.1 [iceberg-rust]

2025-03-09 Thread via GitHub
dependabot[bot] opened a new pull request, #1054: URL: https://github.com/apache/iceberg-rust/pull/1054 Bumps [crate-ci/typos](https://github.com/crate-ci/typos) from 1.30.0 to 1.30.1. Release notes Sourced from https://github.com/crate-ci/typos/releases";>crate-ci/typos's release

[PR] Build: Bump com.azure:azure-sdk-bom from 1.2.31 to 1.2.32 [iceberg]

2025-03-09 Thread via GitHub
dependabot[bot] opened a new pull request, #12487: URL: https://github.com/apache/iceberg/pull/12487 Bumps [com.azure:azure-sdk-bom](https://github.com/azure/azure-sdk-for-java) from 1.2.31 to 1.2.32. Commits https://github.com/Azure/azure-sdk-for-java/commit/63382225ace94d902b

Re: [PR] Docs: fix typo in rest-catalog-open-api.yaml. [iceberg]

2025-03-09 Thread via GitHub
slfan1989 commented on PR #12480: URL: https://github.com/apache/iceberg/pull/12480#issuecomment-2708713540 > Nice one @slfan1989 thanks for fixing this 🚀 @Fokko Thanks for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [I] Spark Streaming Job with multiple queries MERGE INTO the same target table (Runtime file filtering is not possible) [iceberg]

2025-03-09 Thread via GitHub
github-actions[bot] commented on issue #11094: URL: https://github.com/apache/iceberg/issues/11094#issuecomment-2708569868 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

[PR] build(deps): bump the gomod_updates group with 15 updates [iceberg-go]

2025-03-09 Thread via GitHub
dependabot[bot] opened a new pull request, #328: URL: https://github.com/apache/iceberg-go/pull/328 Bumps the gomod_updates group with 15 updates: | Package | From | To | | --- | --- | --- | | [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) | `1.29.8