Re: [PR] Add Files metadata table [iceberg-python]

2024-04-20 Thread via GitHub
Gowthami03B commented on code in PR #614: URL: https://github.com/apache/iceberg-python/pull/614#discussion_r1573309559 ## tests/conftest.py: ## @@ -2060,7 +2060,7 @@ def spark() -> "SparkSession": .config("spark.sql.catalog.hive.warehouse", "s3://warehouse/hive/")

Re: [PR] Views, Spark: Add support for Materialized Views; Integrate with Spark SQL [iceberg]

2024-04-20 Thread via GitHub
singhpk234 commented on code in PR #9830: URL: https://github.com/apache/iceberg/pull/9830#discussion_r1573356599 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/SparkCatalog.java: ## @@ -557,6 +568,88 @@ public View loadView(Identifier ident) throws NoSuchViewExcept

Re: [PR] Views, Spark: Add support for Materialized Views; Integrate with Spark SQL [iceberg]

2024-04-20 Thread via GitHub
singhpk234 commented on code in PR #9830: URL: https://github.com/apache/iceberg/pull/9830#discussion_r1573359207 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/SparkCatalog.java: ## @@ -746,11 +839,26 @@ private static void checkNotPathIdentifier(Identifier identif

Re: [PR] Views, Spark: Add support for Materialized Views; Integrate with Spark SQL [iceberg]

2024-04-20 Thread via GitHub
singhpk234 commented on code in PR #9830: URL: https://github.com/apache/iceberg/pull/9830#discussion_r1573359207 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/SparkCatalog.java: ## @@ -746,11 +839,26 @@ private static void checkNotPathIdentifier(Identifier identif

[PR] Remove hard-coded release version [iceberg-python]

2024-04-20 Thread via GitHub
danielcweeks opened a new pull request, #643: URL: https://github.com/apache/iceberg-python/pull/643 Improves the verification steps to: - not include a hard coded version (could result in users verifying the wrong version) - use distinct paths so that the verification directory isn't

[PR] Change suggestions to PyArrow [iceberg-python]

2024-04-20 Thread via GitHub
Fokko opened a new pull request, #644: URL: https://github.com/apache/iceberg-python/pull/644 PyIceberg first started with s3fs as the default FileIO implementation because it is more lightweight. At some point we've changed the default to PyArrow since it is more feature rich. We've

Re: [PR] Views, Spark: Add support for Materialized Views; Integrate with Spark SQL [iceberg]

2024-04-20 Thread via GitHub
wmoustafa commented on PR #9830: URL: https://github.com/apache/iceberg/pull/9830#issuecomment-2067798780 > > However, if the materialized view is stale, the method simply returns to allow SparkCatalog's loadView to run. In turn, loadView returns the metadata for the virtual view itself, tr

Re: [PR] Verify release quality of life improvements [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #626: URL: https://github.com/apache/iceberg-python/pull/626 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] CI: Update provision.py without rebuilding the integration-test image [iceberg-python]

2024-04-20 Thread via GitHub
HonahX commented on PR #632: URL: https://github.com/apache/iceberg-python/pull/632#issuecomment-2067812969 Thanks for the improvement! This adds a lot of convenience when developing the integration tests One small request: Could you please also add the `docker cp` to test-coverage o

Re: [PR] Change suggestions to PyArrow [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #644: URL: https://github.com/apache/iceberg-python/pull/644 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] Build: Bump pytest from 7.4.4 to 8.1.1 [iceberg-python]

2024-04-20 Thread via GitHub
HonahX commented on PR #639: URL: https://github.com/apache/iceberg-python/pull/639#issuecomment-2067813722 Due to https://github.com/apache/iceberg-python/pull/393, there will be some additional work to do before updating pytest to 8.x -- This is an automated message from the Apache Git

Re: [PR] Build: Bump pytest from 7.4.4 to 8.1.1 [iceberg-python]

2024-04-20 Thread via GitHub
HonahX commented on PR #639: URL: https://github.com/apache/iceberg-python/pull/639#issuecomment-2067813752 @dependabot ignore this major version -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] Build: Bump pytest from 7.4.4 to 8.1.1 [iceberg-python]

2024-04-20 Thread via GitHub
dependabot[bot] closed pull request #639: Build: Bump pytest from 7.4.4 to 8.1.1 URL: https://github.com/apache/iceberg-python/pull/639 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Build: Bump pytest from 7.4.4 to 8.1.1 [iceberg-python]

2024-04-20 Thread via GitHub
dependabot[bot] commented on PR #639: URL: https://github.com/apache/iceberg-python/pull/639#issuecomment-2067813760 OK, I won't notify you about version 8.x.x again, unless you re-open this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] Bump pyiceberg to 0.6.0 on integration tests [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #633: URL: https://github.com/apache/iceberg-python/pull/633 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [I] Bump integration tests to PyIceberg 0.6.0 [iceberg-python]

2024-04-20 Thread via GitHub
HonahX closed issue #625: Bump integration tests to PyIceberg 0.6.0 URL: https://github.com/apache/iceberg-python/issues/625 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Bump Spark to 3.5.0 on integration tests [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #635: URL: https://github.com/apache/iceberg-python/pull/635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [I] Bump integration tests to Spark 3.5.0 [iceberg-python]

2024-04-20 Thread via GitHub
HonahX closed issue #623: Bump integration tests to Spark 3.5.0 URL: https://github.com/apache/iceberg-python/issues/623 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [I] trino iceberg planning time so long [iceberg]

2024-04-20 Thread via GitHub
github-actions[bot] commented on issue #2619: URL: https://github.com/apache/iceberg/issues/2619#issuecomment-2067821785 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] UnsupportedOperationException: Byte-buffer read unsupported by input stream [iceberg]

2024-04-20 Thread via GitHub
github-actions[bot] commented on issue #2631: URL: https://github.com/apache/iceberg/issues/2631#issuecomment-2067821789 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Bug in emitted ScanEvent in BaseAllMetadataTableScan [iceberg]

2024-04-20 Thread via GitHub
github-actions[bot] commented on issue #2635: URL: https://github.com/apache/iceberg/issues/2635#issuecomment-2067821796 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Flink: The primary key name of the same iceberg table should be same during different queries [iceberg]

2024-04-20 Thread via GitHub
github-actions[bot] commented on issue #2644: URL: https://github.com/apache/iceberg/issues/2644#issuecomment-2067821802 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Shoud Flink Iceberg table source implement the LookupTableSource to support temporal table join for flink streaming task? [iceberg]

2024-04-20 Thread via GitHub
github-actions[bot] commented on issue #2645: URL: https://github.com/apache/iceberg/issues/2645#issuecomment-2067821806 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] flink cdc 2 iceberg0.11.1 [iceberg]

2024-04-20 Thread via GitHub
github-actions[bot] commented on issue #2650: URL: https://github.com/apache/iceberg/issues/2650#issuecomment-2067821808 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] CI: Update provision.py without rebuilding the integration-test image [iceberg-python]

2024-04-20 Thread via GitHub
frankliee commented on PR #632: URL: https://github.com/apache/iceberg-python/pull/632#issuecomment-2067872533 > Thanks for the improvement! This adds a lot of convenience when developing the integration tests > > One small request: Could you please also add the `docker cp` to test-c

Re: [PR] CI: Update provision.py without rebuilding the integration-test image [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #632: URL: https://github.com/apache/iceberg-python/pull/632 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

[PR] Build: Bump mkdocs-material from 9.5.17 to 9.5.18 [iceberg]

2024-04-20 Thread via GitHub
dependabot[bot] opened a new pull request, #10189: URL: https://github.com/apache/iceberg/pull/10189 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.5.17 to 9.5.18. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>mkdoc

Re: [I] Bump integration tests to Iceberg to 1.5.0 [iceberg-python]

2024-04-20 Thread via GitHub
HonahX closed issue #624: Bump integration tests to Iceberg to 1.5.0 URL: https://github.com/apache/iceberg-python/issues/624 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Bump Iceberg to 1.5.0 on integration tests [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #634: URL: https://github.com/apache/iceberg-python/pull/634 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

[PR] Build: Bump org.roaringbitmap:RoaringBitmap from 1.0.5 to 1.0.6 [iceberg]

2024-04-20 Thread via GitHub
dependabot[bot] opened a new pull request, #10190: URL: https://github.com/apache/iceberg/pull/10190 Bumps [org.roaringbitmap:RoaringBitmap](https://github.com/RoaringBitmap/RoaringBitmap) from 1.0.5 to 1.0.6. Release notes Sourced from https://github.com/RoaringBitmap/RoaringBitm

[PR] Build: Bump io.netty:netty-buffer from 4.1.108.Final to 4.1.109.Final [iceberg]

2024-04-20 Thread via GitHub
dependabot[bot] opened a new pull request, #10191: URL: https://github.com/apache/iceberg/pull/10191 Bumps [io.netty:netty-buffer](https://github.com/netty/netty) from 4.1.108.Final to 4.1.109.Final. Commits https://github.com/netty/netty/commit/43455dfe98202b8dc63d89ac3f04027c

[PR] Build: Bump software.amazon.awssdk:bom from 2.25.31 to 2.25.35 [iceberg]

2024-04-20 Thread via GitHub
dependabot[bot] opened a new pull request, #10192: URL: https://github.com/apache/iceberg/pull/10192 Bumps software.amazon.awssdk:bom from 2.25.31 to 2.25.35. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=soft

[PR] Build: Bump gradle.plugin.io.morethan.jmhreport:gradle-jmh-report from 0.9.0 to 0.9.6 [iceberg]

2024-04-20 Thread via GitHub
dependabot[bot] opened a new pull request, #10193: URL: https://github.com/apache/iceberg/pull/10193 Bumps gradle.plugin.io.morethan.jmhreport:gradle-jmh-report from 0.9.0 to 0.9.6. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_sc

[PR] Build: Bump org.xerial:sqlite-jdbc from 3.45.2.0 to 3.45.3.0 [iceberg]

2024-04-20 Thread via GitHub
dependabot[bot] opened a new pull request, #10194: URL: https://github.com/apache/iceberg/pull/10194 Bumps [org.xerial:sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.45.2.0 to 3.45.3.0. Release notes Sourced from https://github.com/xerial/sqlite-jdbc/releases";>org.xeri

[PR] Build: Bump org.scala-lang.modules:scala-collection-compat_2.13 from 2.11.0 to 2.12.0 [iceberg]

2024-04-20 Thread via GitHub
dependabot[bot] opened a new pull request, #10195: URL: https://github.com/apache/iceberg/pull/10195 Bumps [org.scala-lang.modules:scala-collection-compat_2.13](https://github.com/scala/scala-collection-compat) from 2.11.0 to 2.12.0. Release notes Sourced from https://github.com/s

Re: [PR] Build: Bump pydantic from 2.6.1 to 2.7.0 [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #638: URL: https://github.com/apache/iceberg-python/pull/638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] Build: Bump coverage from 7.4.2 to 7.4.4 [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #640: URL: https://github.com/apache/iceberg-python/pull/640 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] Build: Bump boto3 from 1.34.34 to 1.34.69 [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #641: URL: https://github.com/apache/iceberg-python/pull/641 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] Build: Bump requests-mock from 1.11.0 to 1.12.1 [iceberg-python]

2024-04-20 Thread via GitHub
HonahX merged PR #642: URL: https://github.com/apache/iceberg-python/pull/642 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg