Re: [I] Iceberg-rust Write support [iceberg-rust]

flaneur2020 commented on issue #700: URL: https://github.com/apache/iceberg-rust/issues/700#issuecomment-2509617502 sorry came up late after a business trip, if there's still open task available, please assign to me 🙏 -- This is an automated message from the Apache Git Service. To respond

Re: [PR] Add basic CMake support for the iceberg library [iceberg-cpp]

Fokko commented on PR #3: URL: https://github.com/apache/iceberg-cpp/pull/3#issuecomment-2509612587 Thanks for kicking this off @wgtmac 🙌 I don't have a strong opinion on this, mostly due to my lack of C++ knowledge. I do think it would be good to add a small section to the `README.

Re: [PR] REST: Refactor docker image files [iceberg]

Fokko merged PR #11676: URL: https://github.com/apache/iceberg/pull/11676 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] REST: Refactor docker image files [iceberg]

Fokko commented on PR #11676: URL: https://github.com/apache/iceberg/pull/11676#issuecomment-2509608109 Let's move this forward. Once the [Infra](https://issues.apache.org/jira/browse/INFRA-26275) ticket is resolved, we can push this forward :) Thanks again @ajantha-bhat for fixing this, an

Re: [PR] Spark: Remove extra columns for ColumnBatch [iceberg]

huaxingao commented on code in PR #11551: URL: https://github.com/apache/iceberg/pull/11551#discussion_r1864760863 ## data/src/main/java/org/apache/iceberg/data/DeleteFilter.java: ## @@ -73,6 +74,7 @@ protected DeleteFilter( boolean needRowPosCol) { this.filePath = f

Re: [PR] Spark: Remove extra columns for ColumnBatch [iceberg]

huaxingao commented on code in PR #11551: URL: https://github.com/apache/iceberg/pull/11551#discussion_r1864760757 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/VectorizedSparkParquetReaders.java: ## @@ -125,4 +126,25 @@ protected VectorizedReader v

Re: [PR] Spark: Remove extra columns for ColumnBatch [iceberg]

huaxingao commented on code in PR #11551: URL: https://github.com/apache/iceberg/pull/11551#discussion_r1864760687 ## spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/source/TestSparkReaderDeletes.java: ## @@ -622,6 +624,41 @@ public void testPosDeletesOnParquetFileWithM

[PR] Build: Bump software.amazon.awssdk:bom from 2.29.20 to 2.29.23 [iceberg]

dependabot[bot] opened a new pull request, #11683: URL: https://github.com/apache/iceberg/pull/11683 Bumps software.amazon.awssdk:bom from 2.29.20 to 2.29.23. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=soft

[PR] Build: Bump org.xerial:sqlite-jdbc from 3.47.0.0 to 3.47.1.0 [iceberg]

dependabot[bot] opened a new pull request, #11682: URL: https://github.com/apache/iceberg/pull/11682 Bumps [org.xerial:sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.47.0.0 to 3.47.1.0. Release notes Sourced from https://github.com/xerial/sqlite-jdbc/releases";>org.xeri

[PR] Build: Bump jackson-bom from 2.18.1 to 2.18.2 [iceberg]

dependabot[bot] opened a new pull request, #11681: URL: https://github.com/apache/iceberg/pull/11681 Bumps `jackson-bom` from 2.18.1 to 2.18.2. Updates `com.fasterxml.jackson:jackson-bom` from 2.18.1 to 2.18.2 Commits https://github.com/FasterXML/jackson-bom/commit/55ff098b61

[PR] Build: Bump mkdocs-material from 9.5.45 to 9.5.46 [iceberg]

dependabot[bot] opened a new pull request, #11680: URL: https://github.com/apache/iceberg/pull/11680 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.5.45 to 9.5.46. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>mkdoc

Re: [PR] Bug Fix: Expose tableExists endpoint on RESTCatalogAdapter [iceberg]

ebyhr commented on PR #11678: URL: https://github.com/apache/iceberg/pull/11678#issuecomment-2509522534 This PR looks a duplicate of https://github.com/apache/iceberg/pull/10999 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] Core: Expose `added_rows_count`, `existing_rows_count` and `deleted_rows_count` fields in all_manifests and manifests tables [iceberg]

ebyhr opened a new pull request, #11679: URL: https://github.com/apache/iceberg/pull/11679 These fields are exposed in Trino Iceberg connector: https://trino.io/docs/current/connector/iceberg.html#manifests-table It would be nice to expose them in other query engines. -- This is a

Re: [I] ORC file format support [iceberg-python]

github-actions[bot] commented on issue #20: URL: https://github.com/apache/iceberg-python/issues/20#issuecomment-2509490853 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occu

Re: [I] The `between` keyword seems to be missing from pyiceberg expression [iceberg-python]

github-actions[bot] commented on issue #792: URL: https://github.com/apache/iceberg-python/issues/792#issuecomment-2509490830 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity oc

Re: [I] How do I find if there is residual in the table scan/plan files? [iceberg-python]

github-actions[bot] commented on issue #785: URL: https://github.com/apache/iceberg-python/issues/785#issuecomment-2509490839 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity oc

Re: [PR] Quick notes how to update docs and javadoc at release publication time. [iceberg]

github-actions[bot] commented on PR #10810: URL: https://github.com/apache/iceberg/pull/10810#issuecomment-2509489511 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Core: Fix drop partition field and schema field error [iceberg]

github-actions[bot] commented on PR #11387: URL: https://github.com/apache/iceberg/pull/11387#issuecomment-2509489562 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Add optional Glue Schema configuration to exclude Non-Current Fields [iceberg]

github-actions[bot] commented on PR #11334: URL: https://github.com/apache/iceberg/pull/11334#issuecomment-2509489529 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Core: add support to add custom schemes via properties in ResolvingFileIO [iceberg]

github-actions[bot] commented on PR #9884: URL: https://github.com/apache/iceberg/pull/9884#issuecomment-2509489456 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Flink Support for TIMESTAMP_NANOS [iceberg]

github-actions[bot] closed pull request #11348: Flink Support for TIMESTAMP_NANOS URL: https://github.com/apache/iceberg/pull/11348 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] Flink Support for TIMESTAMP_NANOS [iceberg]

github-actions[bot] commented on PR #11348: URL: https://github.com/apache/iceberg/pull/11348#issuecomment-2509489537 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Core: add support to add custom schemes via properties in ResolvingFileIO [iceberg]

github-actions[bot] closed pull request #9884: Core: add support to add custom schemes via properties in ResolvingFileIO URL: https://github.com/apache/iceberg/pull/9884 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] (AWS) Docs: List all AWS S3 properties from all language impl. [iceberg]

github-actions[bot] commented on PR #11383: URL: https://github.com/apache/iceberg/pull/11383#issuecomment-2509489546 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Core: Fix drop partition field and schema field error [iceberg]

github-actions[bot] closed pull request #11387: Core: Fix drop partition field and schema field error URL: https://github.com/apache/iceberg/pull/11387 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] Quick notes how to update docs and javadoc at release publication time. [iceberg]

github-actions[bot] closed pull request #10810: Quick notes how to update docs and javadoc at release publication time. URL: https://github.com/apache/iceberg/pull/10810 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Add optional Glue Schema configuration to exclude Non-Current Fields [iceberg]

github-actions[bot] closed pull request #11334: Add optional Glue Schema configuration to exclude Non-Current Fields URL: https://github.com/apache/iceberg/pull/11334 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] SQL UDFs in Iceberg [iceberg]

github-actions[bot] commented on issue #10432: URL: https://github.com/apache/iceberg/issues/10432#issuecomment-2509489491 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] Iceberg-rust Puffin support [iceberg-rust]

fqaiser94 commented on issue #744: URL: https://github.com/apache/iceberg-rust/issues/744#issuecomment-2509456490 Can someone assign this ticket to me to avoid confusion? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[I] Iceberg-rust Puffin support [iceberg-rust]

fqaiser94 opened a new issue, #744: URL: https://github.com/apache/iceberg-rust/issues/744 There is increased interest in [Iceberg Puffin file format](https://iceberg.apache.org/puffin-spec/) recently e.g. Iceberg V3 spec adds [support for deletion vectors](https://github.com/apache/iceber

[PR] feat(puffin): Add Puffin crate and CompressionCodec [iceberg-rust]

fqaiser94 opened a new pull request, #745: URL: https://github.com/apache/iceberg-rust/pull/745 Changes summary: - Add Puffin crate - Add `CompressionCodec` For more information/context, see https://github.com/apache/iceberg-rust/issues/744 -- This is an automated message fr

Re: [PR] REST: Refactor docker image files [iceberg]

kevinjqliu commented on code in PR #11676: URL: https://github.com/apache/iceberg/pull/11676#discussion_r1864452782 ## .github/workflows/publish-iceberg-rest-fixture-docker.yml: ## @@ -28,6 +28,7 @@ on: env: DOCKER_IMAGE_TAG: iceberg-rest-fixture DOCKER_IMAGE_VERSION: lat

Re: [PR] Add basic CMake support for the iceberg library [iceberg-cpp]

wgtmac commented on PR #3: URL: https://github.com/apache/iceberg-cpp/pull/3#issuecomment-2509019014 This is the first effort to make sure the project can build successfully before providing concrete PoC implementations. Please take a look and provide your feedback. Thanks! @Fokko @Xuanwo @

[PR] Add basic CMake support for the iceberg library [iceberg-cpp]

wgtmac opened a new pull request, #3: URL: https://github.com/apache/iceberg-cpp/pull/3 Added basic CMake files for a toy iceberg library. This is a start point for following PoC implementations. I have assumed the minimum CMake version is 3.20 and C++ version is C++20. They are subject to

[I] Support table maintenance operations [iceberg-rust]

TennyZhuang opened a new issue, #743: URL: https://github.com/apache/iceberg-rust/issues/743 Reference: https://iceberg.apache.org/docs/1.5.1/maintenance/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[PR] test: append partition data file [iceberg-rust]

feniljain opened a new pull request, #742: URL: https://github.com/apache/iceberg-rust/pull/742 ## Issue Resolved Closes #720 ## Description - Have added test case for base partition data file addition - Added a test case where different "type" of partition field is s

Re: [I] Generation of Snapshot Summaries [iceberg-rust]

c-thiel commented on issue #724: URL: https://github.com/apache/iceberg-rust/issues/724#issuecomment-2508917605 @barronw gladly! Assigned the issue to you :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] Why shouldn't we return an `UnboundPartitionSpec` instead? [iceberg-rust]

c-thiel commented on issue #694: URL: https://github.com/apache/iceberg-rust/issues/694#issuecomment-2508913593 @liurenjie1024, @Xuanwo, @Fokko may I ask for another round of Feedback for this? I believe if we decide to not introduce a `SchemalessPartitionSpec`, we should do so before `0

Re: [I] Tracking issues of iceberg rust v0.4.0 Release [iceberg-rust]

c-thiel commented on issue #739: URL: https://github.com/apache/iceberg-rust/issues/739#issuecomment-2508913423 @sungwy I think we should add https://github.com/apache/iceberg-rust/issues/694 to the blockers as well. If we decide to not introduce a `SchemalessPartitionSpec`, we shouldn't

Re: [PR] Spark-3.5: make `where` sql case sensitive setting alterable in rewrite data files procedure [iceberg]

ludlows commented on PR #11439: URL: https://github.com/apache/iceberg/pull/11439#issuecomment-2508880983 @huaxingao I think the test method `testFilterCaseSensitivityBeforeChange()` (leading to validation exception) has shown the bug exists before the PR. -- This is an automated me