[I] ClassNotFoundException when using the flinksql to write iceberg table [iceberg]

2023-10-29 Thread via GitHub
xzwDavid opened a new issue, #8947: URL: https://github.com/apache/iceberg/issues/8947 ### Apache Iceberg version 1.4.1 (latest release) ### Query engine Flink ### Please describe the bug 🐞 I create a iceberg catalog in flinksql and create a simple table and

[PR] build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.18.44 to 1.19.1 [iceberg-go]

2023-10-29 Thread via GitHub
dependabot[bot] opened a new pull request, #26: URL: https://github.com/apache/iceberg-go/pull/26 Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.18.44 to 1.19.1. Changelog Sourced from https://github.com/aws/aws-sdk-go-v2/blob/v1.19.1/CHAN

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.18.44 to 1.19.0 [iceberg-go]

2023-10-29 Thread via GitHub
dependabot[bot] commented on PR #25: URL: https://github.com/apache/iceberg-go/pull/25#issuecomment-1784030461 Superseded by #26. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.18.44 to 1.19.0 [iceberg-go]

2023-10-29 Thread via GitHub
dependabot[bot] closed pull request #25: build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.18.44 to 1.19.0 URL: https://github.com/apache/iceberg-go/pull/25 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[PR] Spark 3.5: Remove usage of assertHelpers [iceberg]

2023-10-29 Thread via GitHub
coded9 opened a new pull request, #8948: URL: https://github.com/apache/iceberg/pull/8948 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[PR] chore(deps): Update typed-builder requirement from ^0.17 to ^0.18 [iceberg-rust]

2023-10-29 Thread via GitHub
dependabot[bot] opened a new pull request, #87: URL: https://github.com/apache/iceberg-rust/pull/87 Updates the requirements on [typed-builder](https://github.com/idanarye/rust-typed-builder) to permit the latest version. Changelog Sourced from https://github.com/idanarye/rust-typ

[PR] Build: Bump moto from 4.2.6 to 4.2.7 [iceberg-python]

2023-10-29 Thread via GitHub
dependabot[bot] opened a new pull request, #110: URL: https://github.com/apache/iceberg-python/pull/110 Bumps [moto](https://github.com/getmoto/moto) from 4.2.6 to 4.2.7. Changelog Sourced from https://github.com/getmoto/moto/blob/master/CHANGELOG.md";>moto's changelog. 4.2.

[PR] Build: Bump mkdocs-material from 9.4.6 to 9.4.7 [iceberg-python]

2023-10-29 Thread via GitHub
dependabot[bot] opened a new pull request, #111: URL: https://github.com/apache/iceberg-python/pull/111 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.4.6 to 9.4.7. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>mkdo

[PR] Build: Bump pytest from 7.4.2 to 7.4.3 [iceberg-python]

2023-10-29 Thread via GitHub
dependabot[bot] opened a new pull request, #112: URL: https://github.com/apache/iceberg-python/pull/112 Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.4.2 to 7.4.3. Release notes Sourced from https://github.com/pytest-dev/pytest/releases";>pytest's releases. pyt

[PR] Build: Bump pre-commit from 3.4.0 to 3.5.0 [iceberg-python]

2023-10-29 Thread via GitHub
dependabot[bot] opened a new pull request, #113: URL: https://github.com/apache/iceberg-python/pull/113 Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 3.4.0 to 3.5.0. Release notes Sourced from https://github.com/pre-commit/pre-commit/releases";>pre-commit's rel

[PR] Build: Bump duckdb from 0.9.0 to 0.9.1 [iceberg-python]

2023-10-29 Thread via GitHub
dependabot[bot] opened a new pull request, #114: URL: https://github.com/apache/iceberg-python/pull/114 Bumps [duckdb](https://github.com/duckdb/duckdb) from 0.9.0 to 0.9.1. Release notes Sourced from https://github.com/duckdb/duckdb/releases";>duckdb's releases. 0.9.1 Bugfix

Re: [I] Pushdown min/max/count to partitions metadata table [iceberg]

2023-10-29 Thread via GitHub
github-actions[bot] closed issue #7365: Pushdown min/max/count to partitions metadata table URL: https://github.com/apache/iceberg/issues/7365 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] Consider publishing a BOM (bill of materials) [iceberg]

2023-10-29 Thread via GitHub
github-actions[bot] commented on issue #7371: URL: https://github.com/apache/iceberg/issues/7371#issuecomment-1784285812 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Pushdown min/max/count to partitions metadata table [iceberg]

2023-10-29 Thread via GitHub
github-actions[bot] commented on issue #7365: URL: https://github.com/apache/iceberg/issues/7365#issuecomment-1784285827 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [PR] chore(deps): Update typed-builder requirement from ^0.17 to ^0.18 [iceberg-rust]

2023-10-29 Thread via GitHub
liurenjie1024 commented on PR #87: URL: https://github.com/apache/iceberg-rust/pull/87#issuecomment-1784353336 cc @Fokko This is good to go. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] Long overflow when Iceberg reading INT96 timestamp column from Spark parquet table [iceberg]

2023-10-29 Thread via GitHub
manuzhang commented on issue #8949: URL: https://github.com/apache/iceberg/issues/8949#issuecomment-1784354151 @yabola @aokolnychyi @nastra please kindly advise. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] Spark write abort result in table miss metadata location file [iceberg]

2023-10-29 Thread via GitHub
ConeyLiu commented on issue #8927: URL: https://github.com/apache/iceberg/issues/8927#issuecomment-1784369261 Please try to latest version. I think this problem has been fixed by https://github.com/apache/iceberg/pull/7931 -- This is an automated message from the Apache Git Service. To re

Re: [I] Flink write iceberg bug(org.apache.iceberg.exceptions.NotFoundException) [iceberg]

2023-10-29 Thread via GitHub
chenwyi2 commented on issue #5846: URL: https://github.com/apache/iceberg/issues/5846#issuecomment-1784382828 @lirui-apache how about controling snapshot expiration with retain_last or older_than parameter? We can keep some snapshots and read max committed checkpoint id in this way. --

Re: [PR] Spark 3.5: Honor Spark conf spark.sql.files.maxPartitionBytes in read split [iceberg]

2023-10-29 Thread via GitHub
jzhuge commented on PR #8922: URL: https://github.com/apache/iceberg/pull/8922#issuecomment-1784547459 @rdblue When we migrate users from Hive tables to Iceberg tables, some jobs hit executor OOM, as they were tuned for Hive tables with `spark.sql.files.maxPartitionBytes`. Although we told

[I] Partitions metadata table returns inconsistent results size between 1.3.1 and 1.4.1 [iceberg]

2023-10-29 Thread via GitHub
zhangbutao opened a new issue, #8951: URL: https://github.com/apache/iceberg/issues/8951 ### Apache Iceberg version 1.4.1 (latest release) ### Query engine Spark ### Please describe the bug 🐞 - I write a UT in `org.apache.iceberg.spark.extensions.TestMetada

Re: [PR] Nessie: Support views for NessieCatalog [iceberg]

2023-10-29 Thread via GitHub
ajantha-bhat commented on code in PR #8909: URL: https://github.com/apache/iceberg/pull/8909#discussion_r1375740559 ## nessie/src/main/java/org/apache/iceberg/nessie/NessieIcebergClient.java: ## @@ -540,4 +630,72 @@ public void close() { api.close(); } } + + publ

Re: [PR] Nessie: Support views for NessieCatalog [iceberg]

2023-10-29 Thread via GitHub
ajantha-bhat commented on code in PR #8909: URL: https://github.com/apache/iceberg/pull/8909#discussion_r1375742493 ## nessie/src/main/java/org/apache/iceberg/nessie/UpdateableReference.java: ## @@ -62,7 +62,7 @@ public Reference getReference() { public void checkMutable()

Re: [PR] Nessie: Support views for NessieCatalog [iceberg]

2023-10-29 Thread via GitHub
ajantha-bhat commented on code in PR #8909: URL: https://github.com/apache/iceberg/pull/8909#discussion_r1375744766 ## nessie/src/main/java/org/apache/iceberg/nessie/NessieViewOperations.java: ## @@ -0,0 +1,153 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on