[PR] build(deps): bump github.com/aws/aws-sdk-go-v2/service/glue from 1.80.1 to 1.80.3 [iceberg-go]

2024-05-19 Thread via GitHub
dependabot[bot] opened a new pull request, #84: URL: https://github.com/apache/iceberg-go/pull/84 Bumps [github.com/aws/aws-sdk-go-v2/service/glue](https://github.com/aws/aws-sdk-go-v2) from 1.80.1 to 1.80.3. Commits https://github.com/aws/aws-sdk-go-v2/commit/728f21ff766e27bf

[PR] build(deps): bump github.com/hamba/avro/v2 from 2.21.1 to 2.22.0 [iceberg-go]

2024-05-19 Thread via GitHub
dependabot[bot] opened a new pull request, #85: URL: https://github.com/apache/iceberg-go/pull/85 Bumps [github.com/hamba/avro/v2](https://github.com/hamba/avro) from 2.21.1 to 2.22.0. Release notes Sourced from https://github.com/hamba/avro/releases";>github.com/hamba/avro/v2's r

[PR] build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.26.6 to 1.27.15 [iceberg-go]

2024-05-19 Thread via GitHub
dependabot[bot] opened a new pull request, #86: URL: https://github.com/apache/iceberg-go/pull/86 Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.26.6 to 1.27.15. Commits https://github.com/aws/aws-sdk-go-v2/commit/728f21ff766e27bf28e6f

Re: [PR] Fix: Table-Exists if Server returns 204 [iceberg-python]

2024-05-19 Thread via GitHub
c-thiel commented on PR #739: URL: https://github.com/apache/iceberg-python/pull/739#issuecomment-2119193589 @amogh-jahagirdar I added the test. Let me know if something else is missing! -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [PR] Update fsspec.py to respect s3.signer.uri property [iceberg-python]

2024-05-19 Thread via GitHub
c-thiel commented on PR #741: URL: https://github.com/apache/iceberg-python/pull/741#issuecomment-2119193916 @amogh-jahagirdar any thoughts about this PR? Would this be OK to incorporate? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[PR] chore(deps): Update itertools requirement from 0.12 to 0.13 [iceberg-rust]

2024-05-19 Thread via GitHub
dependabot[bot] opened a new pull request, #376: URL: https://github.com/apache/iceberg-rust/pull/376 Updates the requirements on [itertools](https://github.com/rust-itertools/itertools) to permit the latest version. Changelog Sourced from https://github.com/rust-itertools/itertoo

Re: [PR] chore(deps): Update itertools requirement from 0.12 to 0.13 [iceberg-rust]

2024-05-19 Thread via GitHub
Fokko merged PR #376: URL: https://github.com/apache/iceberg-rust/pull/376 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [I] Tracking issues of OpenDAL API changes [iceberg-rust]

2024-05-19 Thread via GitHub
Xuanwo closed issue #356: Tracking issues of OpenDAL API changes URL: https://github.com/apache/iceberg-rust/issues/356 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [I] Tracking issues of OpenDAL API changes [iceberg-rust]

2024-05-19 Thread via GitHub
Xuanwo commented on issue #356: URL: https://github.com/apache/iceberg-rust/issues/356#issuecomment-2119260654 Closing now. I thought we would have huge breaking API changes, but it turned out to be a simple, small PR. I'll track the optimization in other issues instead. -- This is an au

Re: [PR] Add `InclusiveMetricsEvaluator` [iceberg-rust]

2024-05-19 Thread via GitHub
liurenjie1024 commented on code in PR #347: URL: https://github.com/apache/iceberg-rust/pull/347#discussion_r1606044600 ## crates/iceberg/src/expr/visitors/inclusive_metrics_evaluator.rs: ## @@ -0,0 +1,2255 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or

Re: [PR] Add `InclusiveMetricsEvaluator` [iceberg-rust]

2024-05-19 Thread via GitHub
liurenjie1024 merged PR #347: URL: https://github.com/apache/iceberg-rust/pull/347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ic

Re: [PR] Add Files metadata table [iceberg-python]

2024-05-19 Thread via GitHub
geruh commented on code in PR #614: URL: https://github.com/apache/iceberg-python/pull/614#discussion_r1606127345 ## pyiceberg/table/__init__.py: ## @@ -3537,6 +3537,106 @@ def update_partitions_map( schema=table_schema, ) +def files(self, snapshot_id

Re: [PR] Add Files metadata table [iceberg-python]

2024-05-19 Thread via GitHub
geruh commented on code in PR #614: URL: https://github.com/apache/iceberg-python/pull/614#discussion_r1606127794 ## pyiceberg/table/__init__.py: ## @@ -3537,6 +3537,106 @@ def update_partitions_map( schema=table_schema, ) +def files(self, snapshot_id

Re: [PR] Spark: Coerce shorts and bytes into ints in Parquet Writer [iceberg]

2024-05-19 Thread via GitHub
shardulm94 merged PR #10349: URL: https://github.com/apache/iceberg/pull/10349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceber

Re: [I] byte and short types in spark no longer auto coerce to int32 [iceberg]

2024-05-19 Thread via GitHub
shardulm94 closed issue #10225: byte and short types in spark no longer auto coerce to int32 URL: https://github.com/apache/iceberg/issues/10225 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] Add Files metadata table [iceberg-python]

2024-05-19 Thread via GitHub
geruh commented on code in PR #614: URL: https://github.com/apache/iceberg-python/pull/614#discussion_r1606127794 ## pyiceberg/table/__init__.py: ## @@ -3537,6 +3537,106 @@ def update_partitions_map( schema=table_schema, ) +def files(self, snapshot_id

Re: [PR] Core: Introduce AuthConfig [iceberg]

2024-05-19 Thread via GitHub
amogh-jahagirdar commented on code in PR #10161: URL: https://github.com/apache/iceberg/pull/10161#discussion_r1606204569 ## core/src/main/java/org/apache/iceberg/rest/auth/OAuth2Util.java: ## @@ -458,32 +458,11 @@ public static class AuthSession { private static final long

[I] Flaky Test `TestIcebergSourceFailover > testBoundedWithSavepoint` [iceberg]

2024-05-19 Thread via GitHub
manuzhang opened a new issue, #10356: URL: https://github.com/apache/iceberg/issues/10356 ### Apache Iceberg version main (development) ### Query engine Flink ### Please describe the bug 🐞 ``` TestIcebergSourceFailover > testBoundedWithSavepoint FAILED

Re: [PR] Build: Bump nessie from 0.81.1 to 0.82.0 [iceberg]

2024-05-19 Thread via GitHub
manuzhang commented on PR #10318: URL: https://github.com/apache/iceberg/pull/10318#issuecomment-2119662766 I've created https://github.com/apache/iceberg/issues/10356 to track the flaky test. -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] AWS: Retain Glue Catalog column comment after updating Iceberg table [iceberg]

2024-05-19 Thread via GitHub
geruh commented on code in PR #10276: URL: https://github.com/apache/iceberg/pull/10276#discussion_r1606272619 ## aws/src/main/java/org/apache/iceberg/aws/glue/IcebergToGlueConverter.java: ## @@ -234,8 +259,26 @@ static void setTableInputInformation( Optional.ofNullable(p

Re: [PR] AWS: Retain Glue Catalog column comment after updating Iceberg table [iceberg]

2024-05-19 Thread via GitHub
geruh commented on code in PR #10276: URL: https://github.com/apache/iceberg/pull/10276#discussion_r1606278195 ## aws/src/integration/java/org/apache/iceberg/aws/glue/TestGlueCatalogTable.java: ## @@ -501,6 +501,97 @@ public void testColumnCommentsAndParameters() { assertTh