[PR] Build: Bump nessie from 0.100.2 to 0.101.0 [iceberg]

dependabot[bot] opened a new pull request, #11722: URL: https://github.com/apache/iceberg/pull/11722 Bumps `nessie` from 0.100.2 to 0.101.0. Updates `org.projectnessie.nessie:nessie-client` from 0.100.2 to 0.101.0 Updates `org.projectnessie.nessie:nessie-jaxrs-testextension` from 0.

[PR] Build: Bump com.azure:azure-sdk-bom from 1.2.29 to 1.2.30 [iceberg]

dependabot[bot] opened a new pull request, #11725: URL: https://github.com/apache/iceberg/pull/11725 Bumps [com.azure:azure-sdk-bom](https://github.com/azure/azure-sdk-for-java) from 1.2.29 to 1.2.30. Release notes Sourced from https://github.com/azure/azure-sdk-for-java/releases";

[PR] Build: Bump com.google.cloud:libraries-bom from 26.50.0 to 26.51.0 [iceberg]

dependabot[bot] opened a new pull request, #11724: URL: https://github.com/apache/iceberg/pull/11724 Bumps [com.google.cloud:libraries-bom](https://github.com/googleapis/java-cloud-bom) from 26.50.0 to 26.51.0. Release notes Sourced from https://github.com/googleapis/java-cloud-bo

[PR] Build: Bump software.amazon.awssdk:bom from 2.29.23 to 2.29.29 [iceberg]

dependabot[bot] opened a new pull request, #11723: URL: https://github.com/apache/iceberg/pull/11723 Bumps software.amazon.awssdk:bom from 2.29.23 to 2.29.29. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=soft

Re: [PR] Add iceberg_arrow library [iceberg-cpp]

wgtmac commented on code in PR #6: URL: https://github.com/apache/iceberg-cpp/pull/6#discussion_r1874613441 ## src/arrow/CMakeLists.txt: ## @@ -0,0 +1,66 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE f

Re: [I] table_exists error raisng 400 error code [iceberg-python]

dongsupkim-onepredict commented on issue #1378: URL: https://github.com/apache/iceberg-python/issues/1378#issuecomment-2525449672 @sungwy Thanks for help, But unfortunately it lacks postgres driver for catalog internal database that I'm using instead of default sqliteDB. Don't you have any

Re: [PR] Add iceberg_arrow library [iceberg-cpp]

wgtmac commented on PR #6: URL: https://github.com/apache/iceberg-cpp/pull/6#issuecomment-2525419398 I have added a `iceberg-arrow` library to opt in an Arrow-backed implementation in the future. I follow a similar pattern of arrow-cpp to manage third-party libraries. Let me know what you t

[PR] Build: Bump mkdocs-material from 9.5.46 to 9.5.47 [iceberg]

dependabot[bot] opened a new pull request, #11726: URL: https://github.com/apache/iceberg/pull/11726 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.5.46 to 9.5.47. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>mkdoc

Re: [I] Support different JDBC backend in the `JdbcCatalog` [iceberg]

github-actions[bot] commented on issue #9733: URL: https://github.com/apache/iceberg/issues/9733#issuecomment-2525354002 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Using the Iceberg catalog in your file system [iceberg]

github-actions[bot] closed issue #10326: Using the Iceberg catalog in your file system URL: https://github.com/apache/iceberg/issues/10326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [I] Introduce a parameter to control whether the flink writer is linked with the previous operator [iceberg]

github-actions[bot] closed issue #10371: Introduce a parameter to control whether the flink writer is linked with the previous operator URL: https://github.com/apache/iceberg/issues/10371 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] Support different JDBC backend in the `JdbcCatalog` [iceberg]

github-actions[bot] closed issue #9733: Support different JDBC backend in the `JdbcCatalog` URL: https://github.com/apache/iceberg/issues/9733 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] Introduce a parameter to control whether the flink writer is linked with the previous operator [iceberg]

github-actions[bot] commented on issue #10371: URL: https://github.com/apache/iceberg/issues/10371#issuecomment-2525354017 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] Using the Iceberg catalog in your file system [iceberg]

github-actions[bot] commented on issue #10326: URL: https://github.com/apache/iceberg/issues/10326#issuecomment-2525354009 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [PR] Add clang format [iceberg-cpp]

Fokko commented on code in PR #4: URL: https://github.com/apache/iceberg-cpp/pull/4#discussion_r1874545852 ## .clang-format: ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distr

Re: [PR] 0.8.1 post release [iceberg-python]

Fokko merged PR #1410: URL: https://github.com/apache/iceberg-python/pull/1410 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceber

Re: [I] Add new poetry extras for rest sigv4 [iceberg-python]

Fokko commented on issue #1405: URL: https://github.com/apache/iceberg-python/issues/1405#issuecomment-2525276017 Ah, this is a great catch! Boto comes with S3FS, and if you don't use that, you have to install it separately. -- This is an automated message from the Apache Git Service. T

Re: [PR] Add poetry extra for rest-sigv4 dependencies (boto3) [iceberg-python]

Fokko commented on PR #1415: URL: https://github.com/apache/iceberg-python/pull/1415#issuecomment-2525276734 @paulmech Thanks for raising this PR, this looks good. Could you also add it [to the table](https://py.iceberg.apache.org/#installation) of extras? -- This is an automated message

Re: [PR] Docs: Add Javadocs for 1.7.1 release [iceberg]

bryanck commented on PR #11718: URL: https://github.com/apache/iceberg/pull/11718#issuecomment-2525205231 Thanks @Fokko ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Docs: Add Javadocs for 1.7.1 release [iceberg]

bryanck merged PR #11718: URL: https://github.com/apache/iceberg/pull/11718 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.a

[I] Questions of using flink to update iceberg table partial columns and delete [iceberg]

jtfang opened a new issue, #11720: URL: https://github.com/apache/iceberg/issues/11720 Hi team I am working on an EMR (6.15) environment using Flink (1.17.1) Streaming API to write data into an Iceberg (1.4.0) table, but I have encountered some issues. It would be appreciated if you

[PR] Add Spark for integration tests [iceberg-rust]

Fokko opened a new pull request, #766: URL: https://github.com/apache/iceberg-rust/pull/766 I think it would be good to add Spark to easily generate cases for integration tests. This way we can create tables with positional deletes, branches/tags, deletion vectors, etc. Maybe we coul

Re: [I] [Investigate] Whether `data_files` metadata table requires both pyarrow and s3fs [iceberg-python]

jiakai-li commented on issue #1317: URL: https://github.com/apache/iceberg-python/issues/1317#issuecomment-2525310075 I was trying to identify the issue, but I can't seem to reproduce it, not sure if I've done it wrong (sorry that I'm very new to the community and this is the second issue

Re: [PR] feat(puffin): Parse Puffin FileMetadata [iceberg-rust]

fqaiser94 commented on code in PR #765: URL: https://github.com/apache/iceberg-rust/pull/765#discussion_r1874212744 ## crates/puffin/src/lib.rs: ## @@ -23,3 +23,8 @@ mod compression; pub use compression::CompressionCodec; + +mod metadata; Review Comment: Note that I have

[PR] Add iceberg_arrow library [iceberg-cpp]

wgtmac opened a new pull request, #6: URL: https://github.com/apache/iceberg-cpp/pull/6 - Add a new library iceberg_arrow to leverage arrow-backed implementations (e.g. filesystem and parquet). - Add Apache Arrow 18.1.0 as a third-party dependency to libiceberg_arrow. -- This is an aut

[PR] Remove deprecation warnings in test [iceberg-python]

kevinjqliu opened a new pull request, #1416: URL: https://github.com/apache/iceberg-python/pull/1416 Fix these errors in `make-test`: * tests/table/test_name_mapping.py::test_mapping_lookup_by_name `Call to find, deprecated in 0.8.0, will be removed in 0.9.0. Please use `apply_name_map

Re: [PR] Remove deprecation warnings in test [iceberg-python]

kevinjqliu commented on code in PR #1416: URL: https://github.com/apache/iceberg-python/pull/1416#discussion_r1874539222 ## pyiceberg/utils/deprecated.py: ## @@ -56,7 +56,6 @@ def deprecation_message(deprecated_in: str, removed_in: str, help_message: Optio def _deprecation_w

Re: [PR] Core: Unimplement Map from CharSequenceMap to obey contract [iceberg]

findepi commented on code in PR #11704: URL: https://github.com/apache/iceberg/pull/11704#discussion_r1874508285 ## .palantir/revapi.yml: ## @@ -1145,6 +1145,134 @@ acceptedBreaks: new: "method org.apache.iceberg.BaseMetastoreOperations.CommitStatus org.apache.iceberg.Ba

Re: [PR] Add clang format [iceberg-cpp]

zhjwpku commented on code in PR #4: URL: https://github.com/apache/iceberg-cpp/pull/4#discussion_r1874500601 ## .clang-format: ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# dis

Re: [PR] Add clang format [iceberg-cpp]

zhjwpku commented on code in PR #4: URL: https://github.com/apache/iceberg-cpp/pull/4#discussion_r1874499101 ## .clang-format: ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one Review Comment: pre-commit or cpp-linter-action will be integrate

Re: [PR] feat(puffin): Parse Puffin FileMetadata [iceberg-rust]

fqaiser94 commented on code in PR #765: URL: https://github.com/apache/iceberg-rust/pull/765#discussion_r1874212744 ## crates/puffin/src/lib.rs: ## @@ -23,3 +23,8 @@ mod compression; pub use compression::CompressionCodec; + +mod metadata; Review Comment: Note that I have

Re: [I] make to_duckdb accept multiple tables [iceberg-python]

ischwart1 commented on issue #408: URL: https://github.com/apache/iceberg-python/issues/408#issuecomment-2525291565 @djouallah Apparently you can pass a duckdb connection to `to_duckdb()`, that way you can chain many table together: ```python with ( catalog.load_

Re: [PR] Core: Add Variant implementation to read serialized objects [iceberg]

aihuaxu commented on code in PR #11415: URL: https://github.com/apache/iceberg/pull/11415#discussion_r1874556912 ## core/src/main/java/org/apache/iceberg/variants/SerializedObject.java: ## @@ -0,0 +1,200 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * o

Re: [PR] Add clang format [iceberg-cpp]

zhjwpku commented on code in PR #4: URL: https://github.com/apache/iceberg-cpp/pull/4#discussion_r1874597692 ## .clang-format: ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# dis

Re: [PR] Add iceberg_arrow library [iceberg-cpp]

zhjwpku commented on code in PR #6: URL: https://github.com/apache/iceberg-cpp/pull/6#discussion_r1874599187 ## src/arrow/CMakeLists.txt: ## @@ -0,0 +1,66 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE

Re: [PR] Add clang format [iceberg-cpp]

gaborkaszab commented on code in PR #4: URL: https://github.com/apache/iceberg-cpp/pull/4#discussion_r1874358635 ## .clang-format: ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +#

Re: [PR] Update `tabulario/iceberg-rest` to `apache/iceberg-rest-fixture` [iceberg-go]

Fokko merged PR #222: URL: https://github.com/apache/iceberg-go/pull/222 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

Re: [PR] Bump getdaft from 0.3.14 to 0.3.15 [iceberg-python]

Fokko commented on PR #1397: URL: https://github.com/apache/iceberg-python/pull/1397#issuecomment-2525024473 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] Bump pandas from 2.0.3 to 2.2.3 [iceberg-python]

Fokko commented on PR #1282: URL: https://github.com/apache/iceberg-python/pull/1282#issuecomment-2525024453 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] Bump pandas from 2.0.3 to 2.2.3 [iceberg-python]

dependabot[bot] closed pull request #1282: Bump pandas from 2.0.3 to 2.2.3 URL: https://github.com/apache/iceberg-python/pull/1282 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] Bump getdaft from 0.3.14 to 0.3.15 [iceberg-python]

dependabot[bot] commented on PR #1397: URL: https://github.com/apache/iceberg-python/pull/1397#issuecomment-2525024738 Looks like getdaft is up-to-date now, so this is no longer needed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] Bump getdaft from 0.3.14 to 0.3.15 [iceberg-python]

dependabot[bot] closed pull request #1397: Bump getdaft from 0.3.14 to 0.3.15 URL: https://github.com/apache/iceberg-python/pull/1397 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] Bump pandas from 2.0.3 to 2.2.3 [iceberg-python]

dependabot[bot] commented on PR #1282: URL: https://github.com/apache/iceberg-python/pull/1282#issuecomment-2525024720 Looks like pandas is up-to-date now, so this is no longer needed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] tests failed due to the warnings from dependencies [iceberg-python]

Fokko closed issue #1409: tests failed due to the warnings from dependencies URL: https://github.com/apache/iceberg-python/issues/1409 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] fix warnings from newer versions of dependencies [iceberg-python]

Fokko merged PR #1414: URL: https://github.com/apache/iceberg-python/pull/1414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceber

Re: [PR] Bump coverage from 7.6.8 to 7.6.9 [iceberg-python]

Fokko merged PR #1413: URL: https://github.com/apache/iceberg-python/pull/1413 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceber

Re: [I] Failed to get `files` metadata from specified branch [iceberg]

ebyhr commented on issue #11701: URL: https://github.com/apache/iceberg/issues/11701#issuecomment-2525106640 I confirmed this issue still happens on `main` branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[PR] Core: Fix failure when reading files table with branch [iceberg]

ebyhr opened a new pull request, #11719: URL: https://github.com/apache/iceberg/pull/11719 Fixes #11701 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma