[PR] Build: Bump com.google.cloud:libraries-bom from 26.24.0 to 26.25.0 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] opened a new pull request, #8841: URL: https://github.com/apache/iceberg/pull/8841 Bumps [com.google.cloud:libraries-bom](https://github.com/googleapis/java-cloud-bom) from 26.24.0 to 26.25.0. Release notes Sourced from https://github.com/googleapis/java-cloud-bom/

Re: [PR] Build: Bump com.palantir.baseline:gradle-baseline-java from 4.42.0 to 5.24.0 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] commented on PR #8812: URL: https://github.com/apache/iceberg/pull/8812#issuecomment-1763268107 Superseded by #8840. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] Build: Bump com.palantir.baseline:gradle-baseline-java from 4.42.0 to 5.24.0 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] closed pull request #8812: Build: Bump com.palantir.baseline:gradle-baseline-java from 4.42.0 to 5.24.0 URL: https://github.com/apache/iceberg/pull/8812 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Build: Bump com.fasterxml.jackson.dataformat:jackson-dataformat-xml from 2.9.9 to 2.15.2 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] commented on PR #8789: URL: https://github.com/apache/iceberg/pull/8789#issuecomment-1763268099 Superseded by #8839. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[PR] Build: Bump com.palantir.baseline:gradle-baseline-java from 4.42.0 to 5.25.0 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] opened a new pull request, #8840: URL: https://github.com/apache/iceberg/pull/8840 Bumps [com.palantir.baseline:gradle-baseline-java](https://github.com/palantir/gradle-baseline) from 4.42.0 to 5.25.0. Release notes Sourced from https://github.com/palantir/gradle-b

Re: [PR] Build: Bump com.fasterxml.jackson.dataformat:jackson-dataformat-xml from 2.9.9 to 2.15.2 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] closed pull request #8789: Build: Bump com.fasterxml.jackson.dataformat:jackson-dataformat-xml from 2.9.9 to 2.15.2 URL: https://github.com/apache/iceberg/pull/8789 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] Build: Bump com.fasterxml.jackson.dataformat:jackson-dataformat-xml from 2.9.9 to 2.15.3 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] opened a new pull request, #8839: URL: https://github.com/apache/iceberg/pull/8839 Bumps [com.fasterxml.jackson.dataformat:jackson-dataformat-xml](https://github.com/FasterXML/jackson-dataformat-xml) from 2.9.9 to 2.15.3. Commits https://github.com/FasterXML/ja

[PR] Build: Bump software.amazon.awssdk:bom from 2.20.162 to 2.21.0 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] opened a new pull request, #8838: URL: https://github.com/apache/iceberg/pull/8838 Bumps software.amazon.awssdk:bom from 2.20.162 to 2.21.0. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=softwa

[PR] Build: Bump org.xerial:sqlite-jdbc from 3.43.0.0 to 3.43.2.0 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] opened a new pull request, #8837: URL: https://github.com/apache/iceberg/pull/8837 Bumps [org.xerial:sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.43.0.0 to 3.43.2.0. Release notes Sourced from https://github.com/xerial/sqlite-jdbc/releases";>org.xerial

[PR] Build: Bump com.fasterxml.jackson.core:jackson-annotations from 2.15.2 to 2.15.3 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] opened a new pull request, #8836: URL: https://github.com/apache/iceberg/pull/8836 Bumps [com.fasterxml.jackson.core:jackson-annotations](https://github.com/FasterXML/jackson) from 2.15.2 to 2.15.3. Commits See full diff in https://github.com/FasterXML/jackson/

[PR] Build: Bump nessie from 0.71.1 to 0.72.0 [iceberg]

2023-10-14 Thread via GitHub
dependabot[bot] opened a new pull request, #8835: URL: https://github.com/apache/iceberg/pull/8835 Bumps `nessie` from 0.71.1 to 0.72.0. Updates `org.projectnessie.nessie:nessie-client` from 0.71.1 to 0.72.0 Updates `org.projectnessie.nessie:nessie-jaxrs-testextension` from 0.71.1 t

Re: [I] rewrite_position_delete_files leads to error [iceberg]

2023-10-14 Thread via GitHub
atifiu commented on issue #8045: URL: https://github.com/apache/iceberg/issues/8045#issuecomment-1763254744 And we are still using spark 3.3.1 so is there any way to get around this issue without upgrading to spark 3.4 and iceberg 1.3.1. -- This is an automated message from the Apache Git

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359633367 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -476,7 +472,7 @@ long[] splitOffsetArray() { @Override public List equalityFieldIds() { -retur

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359632733 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -463,11 +463,7 @@ public ByteBuffer keyMetadata() { @Override public List splitOffsets() { -if

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359633367 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -476,7 +472,7 @@ long[] splitOffsetArray() { @Override public List equalityFieldIds() { -retur

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359632733 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -463,11 +463,7 @@ public ByteBuffer keyMetadata() { @Override public List splitOffsets() { -if

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359633367 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -476,7 +472,7 @@ long[] splitOffsetArray() { @Override public List equalityFieldIds() { -retur

Re: [I] Broken Unit tests on Windows OS [iceberg]

2023-10-14 Thread via GitHub
github-actions[bot] commented on issue #7287: URL: https://github.com/apache/iceberg/issues/7287#issuecomment-1763216102 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Pushdown min/max/count to partitions metadata table [iceberg]

2023-10-14 Thread via GitHub
github-actions[bot] commented on issue #7365: URL: https://github.com/apache/iceberg/issues/7365#issuecomment-1763216091 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on PR #8834: URL: https://github.com/apache/iceberg/pull/8834#issuecomment-1763214878 > I'm working on adding a test, but wanted to post this ASAP. I updated a test to cover this case. -- This is an automated message from the Apache Git Service. To respond to the m

Re: [PR] docs: Clarify some view issues [iceberg]

2023-10-14 Thread via GitHub
wmoustafa commented on code in PR #7504: URL: https://github.com/apache/iceberg/pull/7504#discussion_r1359640842 ## format/view-spec.md: ## @@ -328,3 +330,17 @@ s3://bucket/warehouse/default.db/event_agg/metadata/2-(uuid).metadata.json } ] } ``` + +## Appendix B: Well

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359639050 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -463,11 +463,7 @@ public ByteBuffer keyMetadata() { @Override public List splitOffsets() { -if

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
danielcweeks commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359638251 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -463,11 +463,7 @@ public ByteBuffer keyMetadata() { @Override public List splitOffsets() { -

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
danielcweeks commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359638251 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -463,11 +463,7 @@ public ByteBuffer keyMetadata() { @Override public List splitOffsets() { -

Re: [PR] Core: Simplify/improve View APIs [iceberg]

2023-10-14 Thread via GitHub
wmoustafa commented on PR #7992: URL: https://github.com/apache/iceberg/pull/7992#issuecomment-1763172619 > Also, I'm not convinced that you can/should have `field-aliases` and `field-comments` at the top-level. Some engines may support field aliases, but others do not so they don't apply e

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on PR #8834: URL: https://github.com/apache/iceberg/pull/8834#issuecomment-1763167751 I'm working on adding a test, but wanted to post this ASAP. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359633367 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -476,7 +472,7 @@ long[] splitOffsetArray() { @Override public List equalityFieldIds() { -retur

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359632733 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -463,11 +463,7 @@ public ByteBuffer keyMetadata() { @Override public List splitOffsets() { -if

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359632733 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -463,11 +463,7 @@ public ByteBuffer keyMetadata() { @Override public List splitOffsets() { -if

Re: [PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck commented on code in PR #8834: URL: https://github.com/apache/iceberg/pull/8834#discussion_r1359632733 ## core/src/main/java/org/apache/iceberg/BaseFile.java: ## @@ -463,11 +463,7 @@ public ByteBuffer keyMetadata() { @Override public List splitOffsets() { -if

[PR] Core: fix reading of split offsets in manifests [iceberg]

2023-10-14 Thread via GitHub
bryanck opened a new pull request, #8834: URL: https://github.com/apache/iceberg/pull/8834 This PR fixes a critical bug in reading split offsets from manifests. A change in https://github.com/apache/iceberg/pull/8336 added caching of the offsets collection in `BaseFile` to avoid reallocatio

Re: [PR] JDBC: JDBC Catalog should do exact namespace search for get namespace queries [iceberg]

2023-10-14 Thread via GitHub
amogh-jahagirdar commented on code in PR #8833: URL: https://github.com/apache/iceberg/pull/8833#discussion_r1359617907 ## core/src/main/java/org/apache/iceberg/jdbc/JdbcUtil.java: ## @@ -135,7 +135,7 @@ final class JdbcUtil { + CATALOG_NAME + " = ? AND "

Re: [I] [JdbcCatalog] Issue with Namespace Exists [iceberg]

2023-10-14 Thread via GitHub
amogh-jahagirdar commented on issue #8832: URL: https://github.com/apache/iceberg/issues/8832#issuecomment-1763151183 Thanks for reporting @haizhou-zhao , this is a surprising behavior. I put up a fix for this in #8833 to do exact search, let me know what you think. -- This is an automate

[PR] JDBC: JDBC Catalog should do exact namespace search for get namespace queries [iceberg]

2023-10-14 Thread via GitHub
amogh-jahagirdar opened a new pull request, #8833: URL: https://github.com/apache/iceberg/pull/8833 Fixes #8832 Currently the SQL query to get namespace does a regex based search + limit 1 , which is used during namespace existence checks. I believe this behavior is not correct, it s

Re: [PR] Spark 3.4: Fix issue when partitioning by UUID [iceberg]

2023-10-14 Thread via GitHub
singhpk234 commented on code in PR #8250: URL: https://github.com/apache/iceberg/pull/8250#discussion_r1359495723 ## spark/v3.3/spark/src/main/java/org/apache/iceberg/spark/source/InternalRowWrapper.java: ## @@ -71,8 +77,12 @@ public void set(int pos, T value) { row.update

Re: [PR] Bump version to 0.5.1 [iceberg-python]

2023-10-14 Thread via GitHub
Fokko merged PR #68: URL: https://github.com/apache/iceberg-python/pull/68 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Fix Arrow fixed type [iceberg-python]

2023-10-14 Thread via GitHub
Fokko merged PR #70: URL: https://github.com/apache/iceberg-python/pull/70 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Check for empty responses [iceberg-python]

2023-10-14 Thread via GitHub
Fokko merged PR #69: URL: https://github.com/apache/iceberg-python/pull/69 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap