Re: [PR] Build: Bump nessie from 0.95.0 to 0.96.1 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] closed pull request #11136: Build: Bump nessie from 0.95.0 to 0.96.1 URL: https://github.com/apache/iceberg/pull/11136 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[PR] Build: Bump mkdocs-material from 9.5.34 to 9.5.36 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11190: URL: https://github.com/apache/iceberg/pull/11190 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.5.34 to 9.5.36. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>mkdoc

[PR] Build: Bump mkdocs-macros-plugin from 1.0.5 to 1.2.0 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11189: URL: https://github.com/apache/iceberg/pull/11189 Bumps [mkdocs-macros-plugin](https://github.com/fralau/mkdocs_macros_plugin) from 1.0.5 to 1.2.0. Changelog Sourced from https://github.com/fralau/mkdocs-macros-plugin/blob/master/C

Re: [I] Support deletion in Apache Flink [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8718: URL: https://github.com/apache/iceberg/issues/8718#issuecomment-2365374220 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Null support in Apache Flink [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8720: URL: https://github.com/apache/iceberg/issues/8720#issuecomment-2365374234 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Spec: Clarify spec_id field in Data File [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on PR #8730: URL: https://github.com/apache/iceberg/pull/8730#issuecomment-2365374241 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] AWS: Add retry logic for S3InputStream and S3OutputStream [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] closed pull request #8221: AWS: Add retry logic for S3InputStream and S3OutputStream URL: https://github.com/apache/iceberg/pull/8221 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] AWS: Add retry logic for S3InputStream and S3OutputStream [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on PR #8221: URL: https://github.com/apache/iceberg/pull/8221#issuecomment-2365374092 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [I] Flaky test/env TestFlinkParquetReader, TestFlinkParquetWriter, TestIcebergSourceBoundedSql [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8761: URL: https://github.com/apache/iceberg/issues/8761#issuecomment-2365374280 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] is there anyway to rewrite onto a specific branch? [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8762: URL: https://github.com/apache/iceberg/issues/8762#issuecomment-2365374287 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Upsert support for keyless Apache Flink tables [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8719: URL: https://github.com/apache/iceberg/issues/8719#issuecomment-2365374227 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Add view support for Hive catalog [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8698: URL: https://github.com/apache/iceberg/issues/8698#issuecomment-2365374184 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Support Hudi `DeltaStreamer` compatible feature [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8724: URL: https://github.com/apache/iceberg/issues/8724#issuecomment-2365374235 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Spec: Add `141: spec_id` and `142: schema_id` to the spec [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8712: URL: https://github.com/apache/iceberg/issues/8712#issuecomment-2365374205 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Spec does not define which header fields to be present in ManifestLists [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8746: URL: https://github.com/apache/iceberg/issues/8746#issuecomment-2365374264 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Various fields in Manifest & ManifestList not written in accordance to the Spec [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8699: URL: https://github.com/apache/iceberg/issues/8699#issuecomment-2365374188 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Flink: Support batch modifications via copy-on-write [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on PR #8732: URL: https://github.com/apache/iceberg/pull/8732#issuecomment-2365374253 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Implementation does not write `schema-id` into Manifest Avro headers [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8745: URL: https://github.com/apache/iceberg/issues/8745#issuecomment-2365374258 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] core: initial support of multi-arg bucket [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on PR #8259: URL: https://github.com/apache/iceberg/pull/8259#issuecomment-2365374106 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] core: initial support of multi-arg bucket [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] closed pull request #8259: core: initial support of multi-arg bucket URL: https://github.com/apache/iceberg/pull/8259 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] spark read much volume of data from one source when storage partition join implemented [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8710: URL: https://github.com/apache/iceberg/issues/8710#issuecomment-2365374197 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] S3 compression Issue with Iceberg [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8713: URL: https://github.com/apache/iceberg/issues/8713#issuecomment-2365374210 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] TestIcebergSourceFailover fails when running with JDK17 [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8680: URL: https://github.com/apache/iceberg/issues/8680#issuecomment-2365374181 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] De-Duping Rows While Compacting [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8702: URL: https://github.com/apache/iceberg/issues/8702#issuecomment-2365374193 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Optimize metadata tables? [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8714: URL: https://github.com/apache/iceberg/issues/8714#issuecomment-2365374215 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Flakiness in TestMetadataTableReadableMetrics#testPrimitiveColumns() [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8679: URL: https://github.com/apache/iceberg/issues/8679#issuecomment-2365374179 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] How is iceberg compatible with hive's tez engine [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8757: URL: https://github.com/apache/iceberg/issues/8757#issuecomment-2365374276 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Core: Allows UnionByName To Insert New Elements in Order [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on PR #8731: URL: https://github.com/apache/iceberg/pull/8731#issuecomment-2365374246 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Cannot create a V1 table with `CREATE OR REPLACE TABLE` [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8756: URL: https://github.com/apache/iceberg/issues/8756#issuecomment-2365374270 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

[PR] Build: Bump software.amazon.awssdk:bom from 2.28.5 to 2.28.6 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11181: URL: https://github.com/apache/iceberg/pull/11181 Bumps software.amazon.awssdk:bom from 2.28.5 to 2.28.6. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=softwa

Re: [PR] Build: Bump com.google.cloud:libraries-bom from 26.44.0 to 26.45.0 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] closed pull request #11060: Build: Bump com.google.cloud:libraries-bom from 26.44.0 to 26.45.0 URL: https://github.com/apache/iceberg/pull/11060 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[PR] Build: Bump com.google.cloud:libraries-bom from 26.44.0 to 26.47.0 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11185: URL: https://github.com/apache/iceberg/pull/11185 Bumps [com.google.cloud:libraries-bom](https://github.com/googleapis/java-cloud-bom) from 26.44.0 to 26.47.0. Release notes Sourced from https://github.com/googleapis/java-cloud-bo

[PR] Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11186: URL: https://github.com/apache/iceberg/pull/11186 Bumps [org.apache.httpcomponents.client5:httpclient5](https://github.com/apache/httpcomponents-client) from 5.3.1 to 5.4. Changelog Sourced from https://github.com/apache/httpcompo

[PR] Build: Bump org.eclipse.microprofile.openapi:microprofile-openapi-api from 3.1.1 to 3.1.2 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11182: URL: https://github.com/apache/iceberg/pull/11182 Bumps [org.eclipse.microprofile.openapi:microprofile-openapi-api](https://github.com/eclipse/microprofile-open-api) from 3.1.1 to 3.1.2. Release notes Sourced from https://github.c

[PR] Build: Bump nessie from 0.95.0 to 0.97.1 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11184: URL: https://github.com/apache/iceberg/pull/11184 Bumps `nessie` from 0.95.0 to 0.97.1. Updates `org.projectnessie.nessie:nessie-client` from 0.95.0 to 0.97.1 Updates `org.projectnessie.nessie:nessie-jaxrs-testextension` from 0.95.0

[PR] Build: Bump tez010 from 0.10.3 to 0.10.4 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11183: URL: https://github.com/apache/iceberg/pull/11183 Bumps `tez010` from 0.10.3 to 0.10.4. Updates `org.apache.tez:tez-dag` from 0.10.3 to 0.10.4 Updates `org.apache.tez:tez-mapreduce` from 0.10.3 to 0.10.4 Dependabot will r

Re: [PR] Build: Bump com.google.cloud:libraries-bom from 26.44.0 to 26.45.0 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] commented on PR #11060: URL: https://github.com/apache/iceberg/pull/11060#issuecomment-2365454384 Superseded by #11185. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[PR] Build: Bump org.roaringbitmap:RoaringBitmap from 1.2.1 to 1.3.0 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11187: URL: https://github.com/apache/iceberg/pull/11187 Bumps [org.roaringbitmap:RoaringBitmap](https://github.com/RoaringBitmap/RoaringBitmap) from 1.2.1 to 1.3.0. Release notes Sourced from https://github.com/RoaringBitmap/RoaringBitm

Re: [PR] Build: Bump com.palantir.baseline:gradle-baseline-java from 5.61.0 to 5.66.0 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] commented on PR #11141: URL: https://github.com/apache/iceberg/pull/11141#issuecomment-2365454458 Superseded by #11188. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[PR] Build: Bump com.palantir.baseline:gradle-baseline-java from 5.61.0 to 5.68.0 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] opened a new pull request, #11188: URL: https://github.com/apache/iceberg/pull/11188 Bumps [com.palantir.baseline:gradle-baseline-java](https://github.com/palantir/gradle-baseline) from 5.61.0 to 5.68.0. Release notes Sourced from https://github.com/palantir/gradle

Re: [PR] Build: Bump com.palantir.baseline:gradle-baseline-java from 5.61.0 to 5.66.0 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] closed pull request #11141: Build: Bump com.palantir.baseline:gradle-baseline-java from 5.61.0 to 5.66.0 URL: https://github.com/apache/iceberg/pull/11141 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] Build: Bump nessie from 0.95.0 to 0.96.1 [iceberg]

2024-09-21 Thread via GitHub
dependabot[bot] commented on PR #11136: URL: https://github.com/apache/iceberg/pull/11136#issuecomment-2365454333 Superseded by #11184. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] Core: Optimize MergingSnapshotProducer to use referenced manifests to determine if manifest needs to be rewritten [iceberg]

2024-09-21 Thread via GitHub
aokolnychyi commented on code in PR #11131: URL: https://github.com/apache/iceberg/pull/11131#discussion_r1769699649 ## core/src/main/java/org/apache/iceberg/ManifestFilterManager.java: ## @@ -81,6 +81,7 @@ public String partition() { // cache filtered manifests to avoid ex

Re: [PR] Core: Optimize MergingSnapshotProducer to use referenced manifests to determine if manifest needs to be rewritten [iceberg]

2024-09-21 Thread via GitHub
aokolnychyi commented on code in PR #11131: URL: https://github.com/apache/iceberg/pull/11131#discussion_r1769698492 ## core/src/jmh/java/org/apache/iceberg/ReplaceDeleteFilesBenchmark.java: ## @@ -104,27 +108,39 @@ private void dropTable() { TABLES.dropTable(TABLE_IDENT);

Re: [PR] Core: Optimize MergingSnapshotProducer to use referenced manifests to determine if manifest needs to be rewritten [iceberg]

2024-09-21 Thread via GitHub
aokolnychyi commented on code in PR #11131: URL: https://github.com/apache/iceberg/pull/11131#discussion_r1769698492 ## core/src/jmh/java/org/apache/iceberg/ReplaceDeleteFilesBenchmark.java: ## @@ -104,27 +108,39 @@ private void dropTable() { TABLES.dropTable(TABLE_IDENT);

Re: [PR] Core: Optimize MergingSnapshotProducer to use referenced manifests to determine if manifest needs to be rewritten [iceberg]

2024-09-21 Thread via GitHub
aokolnychyi commented on code in PR #11131: URL: https://github.com/apache/iceberg/pull/11131#discussion_r1769698152 ## core/src/jmh/java/org/apache/iceberg/ReplaceDeleteFilesBenchmark.java: ## @@ -73,11 +74,14 @@ public class ReplaceDeleteFilesBenchmark { private List delete

Re: [I] procedure add_files parallelism > 1 -> NotSerializableException [iceberg]

2024-09-21 Thread via GitHub
zzeekk commented on issue #11147: URL: https://github.com/apache/iceberg/issues/11147#issuecomment-2365041075 Thanks a lot @manuzhang, looks good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] Add integration tests with PostgreSQL DB backend [iceberg-python]

2024-09-21 Thread via GitHub
akashd11 commented on issue #1178: URL: https://github.com/apache/iceberg-python/issues/1178#issuecomment-2365079739 Hi @sungwy I am interested in this, would adding IT with python test-containers for postgres suffice for this issue. -- This is an automated message from the Apache Git Se