[PR] Kafka Connect: Add config to route to tables using topic name [iceberg]

2024-10-13 Thread via GitHub
xiasongh opened a new pull request, #11313: URL: https://github.com/apache/iceberg/pull/11313 Add a new config `iceberg.tables.route-pattern` to dynamically route to Iceberg tables using Kafka topic name Closes #11163 -- This is an automated message from the Apache Git Service. To

Re: [PR] Kafka Connect: Add config to route to tables using topic name [iceberg]

2024-10-13 Thread via GitHub
xiasongh commented on code in PR #11313: URL: https://github.com/apache/iceberg/pull/11313#discussion_r1798594599 ## kafka-connect/kafka-connect/src/main/java/org/apache/iceberg/connect/data/SinkWriter.java: ## @@ -133,6 +145,20 @@ private String extractRouteValue(Object recordV

Re: [PR] Kafka Connect: Add config to route to tables using topic name [iceberg]

2024-10-13 Thread via GitHub
xiasongh commented on code in PR #11313: URL: https://github.com/apache/iceberg/pull/11313#discussion_r1798594599 ## kafka-connect/kafka-connect/src/main/java/org/apache/iceberg/connect/data/SinkWriter.java: ## @@ -133,6 +145,20 @@ private String extractRouteValue(Object recordV

Re: [PR] Kafka Connect: Add config to route to tables using topic name [iceberg]

2024-10-13 Thread via GitHub
xiasongh commented on code in PR #11313: URL: https://github.com/apache/iceberg/pull/11313#discussion_r1798594599 ## kafka-connect/kafka-connect/src/main/java/org/apache/iceberg/connect/data/SinkWriter.java: ## @@ -133,6 +145,20 @@ private String extractRouteValue(Object recordV

Re: [I] Kafka Connect: route to table using topic name [iceberg]

2024-10-13 Thread via GitHub
xiasongh commented on issue #11163: URL: https://github.com/apache/iceberg/issues/11163#issuecomment-2409142288 @bryanck Sorry for the delay, was able to give this a shot. Please have a look. I'm not at all familiar with Java so forgive me if I did anything silly. -- This is an automated

[I] Flink: Add RowConverter for Iceberg Source [iceberg]

2024-10-13 Thread via GitHub
abharath9 opened a new issue, #11312: URL: https://github.com/apache/iceberg/issues/11312 ### Feature Request / Improvement Currently we can't create views on top of IcebergSource DataStreams directly. We need to convert the RowData to Row explicitly using map function. I thought cre

Re: [I] Flink: Add RowConverter for Iceberg Source [iceberg]

2024-10-13 Thread via GitHub
abharath9 commented on issue #11312: URL: https://github.com/apache/iceberg/issues/11312#issuecomment-2409092087 Implemented this change and created a pr. Can i get a review on this? https://github.com/apache/iceberg/pull/11301 -- This is an automated message from the Apache Git Ser

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.61.2 to 1.65.2 [iceberg-go]

2024-10-13 Thread via GitHub
dependabot[bot] commented on PR #166: URL: https://github.com/apache/iceberg-go/pull/166#issuecomment-2408876440 Superseded by #170. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.61.2 to 1.65.2 [iceberg-go]

2024-10-13 Thread via GitHub
dependabot[bot] closed pull request #166: build(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.61.2 to 1.65.2 URL: https://github.com/apache/iceberg-go/pull/166 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[PR] build(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.61.2 to 1.65.3 [iceberg-go]

2024-10-13 Thread via GitHub
dependabot[bot] opened a new pull request, #170: URL: https://github.com/apache/iceberg-go/pull/170 Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.61.2 to 1.65.3. Commits https://github.com/aws/aws-sdk-go-v2/commit/071b493afc547a04

[PR] build(deps): bump github.com/aws/aws-sdk-go-v2/service/glue from 1.99.2 to 1.100.2 [iceberg-go]

2024-10-13 Thread via GitHub
dependabot[bot] opened a new pull request, #171: URL: https://github.com/apache/iceberg-go/pull/171 Bumps [github.com/aws/aws-sdk-go-v2/service/glue](https://github.com/aws/aws-sdk-go-v2) from 1.99.2 to 1.100.2. Commits https://github.com/aws/aws-sdk-go-v2/commit/0cbb5aa17f907

[PR] docs:README uses iceberg-rust instead of we [iceberg-rust]

2024-10-13 Thread via GitHub
caicancai opened a new pull request, #667: URL: https://github.com/apache/iceberg-rust/pull/667 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] Api, Spark: Make StrictMetricsEvaluator not fail on nested column predicates [iceberg]

2024-10-13 Thread via GitHub
zhongyujiang commented on PR #11261: URL: https://github.com/apache/iceberg/pull/11261#issuecomment-2408925671 @amogh-jahagirdar Thanks for reviewing, tests updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[PR] chore(deps): Bump crate-ci/typos from 1.25.0 to 1.26.0 [iceberg-rust]

2024-10-13 Thread via GitHub
dependabot[bot] opened a new pull request, #668: URL: https://github.com/apache/iceberg-rust/pull/668 Bumps [crate-ci/typos](https://github.com/crate-ci/typos) from 1.25.0 to 1.26.0. Release notes Sourced from https://github.com/crate-ci/typos/releases";>crate-ci/typos's releases.

Re: [PR] [WIP] Core: Prototype for DVs in V3 [iceberg]

2024-10-13 Thread via GitHub
aokolnychyi commented on code in PR #11302: URL: https://github.com/apache/iceberg/pull/11302#discussion_r1798616398 ## api/src/main/java/org/apache/iceberg/DataFile.java: ## @@ -98,12 +98,23 @@ public interface DataFile extends ContentFile { Types.NestedField SORT_ORDER_ID =

Re: [PR] Puffin: Add delete-vector-v1 blob type [iceberg]

2024-10-13 Thread via GitHub
aokolnychyi commented on code in PR #11238: URL: https://github.com/apache/iceberg/pull/11238#discussion_r1798617437 ## format/puffin-spec.md: ## @@ -123,6 +123,54 @@ The blob metadata for this blob may include following properties: - `ndv`: estimate of number of distinct va

Re: [PR] Puffin: Add delete-vector-v1 blob type [iceberg]

2024-10-13 Thread via GitHub
aokolnychyi commented on code in PR #11238: URL: https://github.com/apache/iceberg/pull/11238#discussion_r1798622067 ## format/puffin-spec.md: ## @@ -123,6 +123,54 @@ The blob metadata for this blob may include following properties: - `ndv`: estimate of number of distinct va

Re: [PR] Puffin: Add delete-vector-v1 blob type [iceberg]

2024-10-13 Thread via GitHub
aokolnychyi commented on code in PR #11238: URL: https://github.com/apache/iceberg/pull/11238#discussion_r1798623532 ## format/puffin-spec.md: ## @@ -123,6 +123,54 @@ The blob metadata for this blob may include following properties: - `ndv`: estimate of number of distinct va

Re: [PR] Puffin: Add delete-vector-v1 blob type [iceberg]

2024-10-13 Thread via GitHub
aokolnychyi commented on code in PR #11238: URL: https://github.com/apache/iceberg/pull/11238#discussion_r1798622661 ## format/puffin-spec.md: ## @@ -123,6 +123,54 @@ The blob metadata for this blob may include following properties: - `ndv`: estimate of number of distinct va

Re: [PR] Puffin: Add delete-vector-v1 blob type [iceberg]

2024-10-13 Thread via GitHub
aokolnychyi commented on code in PR #11238: URL: https://github.com/apache/iceberg/pull/11238#discussion_r1798623532 ## format/puffin-spec.md: ## @@ -123,6 +123,54 @@ The blob metadata for this blob may include following properties: - `ndv`: estimate of number of distinct va

Re: [PR] Puffin: Add delete-vector-v1 blob type [iceberg]

2024-10-13 Thread via GitHub
aokolnychyi commented on code in PR #11238: URL: https://github.com/apache/iceberg/pull/11238#discussion_r1798624051 ## format/puffin-spec.md: ## @@ -123,6 +123,44 @@ The blob metadata for this blob may include following properties: - `ndv`: estimate of number of distinct va

Re: [PR] Puffin: Add delete-vector-v1 blob type [iceberg]

2024-10-13 Thread via GitHub
aokolnychyi commented on PR #11238: URL: https://github.com/apache/iceberg/pull/11238#issuecomment-2409353898 PR #11302 contains a sample implementation of this spec. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
singhpk234 commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1795908515 ## core/src/main/java/org/apache/iceberg/rest/RESTContentFileParser.java: ## @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
singhpk234 commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798632724 ## core/src/main/java/org/apache/iceberg/rest/RESTContentFileParser.java: ## @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

Re: [PR] Spark: Merge new position deletes with old deletes during writing [iceberg]

2024-10-13 Thread via GitHub
amogh-jahagirdar commented on code in PR #11273: URL: https://github.com/apache/iceberg/pull/11273#discussion_r1798634769 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/source/SparkPositionDeltaWrite.java: ## @@ -185,6 +196,7 @@ public void commit(WriterCommitMessage

Re: [PR] Spec v3: Add deletion vectors to the table spec [iceberg]

2024-10-13 Thread via GitHub
emkornfield commented on code in PR #11240: URL: https://github.com/apache/iceberg/pull/11240#discussion_r1798450250 ## format/spec.md: ## @@ -841,19 +855,45 @@ Notes: ## Delete Formats -This section details how to encode row-level deletes in Iceberg delete files. Row-leve

Re: [I] manifest exception [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] closed issue #8994: manifest exception URL: https://github.com/apache/iceberg/issues/8994 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [I] Iceberg Glue - Timeouts (maybe others client side error cases) can result in missing metadata_location [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #9618: URL: https://github.com/apache/iceberg/issues/9618#issuecomment-2409443905 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Migrate RESTCatalogServlet to use jakarta.* package for Spring boot 3 [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #9626: URL: https://github.com/apache/iceberg/issues/9626#issuecomment-2409443950 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Flink: Optionally Overwrite All Partitions [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9644: URL: https://github.com/apache/iceberg/pull/9644#issuecomment-2409443994 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Spark 3.5: Add a procedure to remove corrupt snapshots [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9645: URL: https://github.com/apache/iceberg/pull/9645#issuecomment-2409444041 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] manifest exception [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-2409443156 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] I can't find any detailed explanation about column metric options on the official docs for Iceberg configuration [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #8995: URL: https://github.com/apache/iceberg/issues/8995#issuecomment-2409443202 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Doc Bug: Iceberg Flink Example uses unsupported UNIQUE constraint [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #8997: URL: https://github.com/apache/iceberg/issues/8997#issuecomment-2409443247 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Doc Bug: Iceberg Flink Example uses unsupported UNIQUE constraint [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] closed issue #8997: Doc Bug: Iceberg Flink Example uses unsupported UNIQUE constraint URL: https://github.com/apache/iceberg/issues/8997 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [I] I can't find any detailed explanation about column metric options on the official docs for Iceberg configuration [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] closed issue #8995: I can't find any detailed explanation about column metric options on the official docs for Iceberg configuration URL: https://github.com/apache/iceberg/issues/8995 -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
singhpk234 commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798637028 ## core/src/main/java/org/apache/iceberg/rest/RESTFileScanTaskParser.java: ## @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
singhpk234 commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798637028 ## core/src/main/java/org/apache/iceberg/rest/RESTFileScanTaskParser.java: ## @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
amogh-jahagirdar commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798635808 ## core/src/main/java/org/apache/iceberg/RESTTable.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more c

Re: [I] Can we make commits inside compaction jobs with partial-progress.enabled sequential to avoid CommitFailedException? [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #9687: URL: https://github.com/apache/iceberg/issues/9687#issuecomment-2409444642 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] java.lang.IllegalArgumentException: requirement failed: length (-6235972) cannot be smaller than -1 [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #9689: URL: https://github.com/apache/iceberg/issues/9689#issuecomment-2409444689 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Core: Pass input file into iterators to get the file name [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9691: URL: https://github.com/apache/iceberg/pull/9691#issuecomment-2409444741 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Docs: Go over docs to check rendering of pages/sections [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #9657: URL: https://github.com/apache/iceberg/issues/9657#issuecomment-2409444136 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Docs: Add Mandarin translation of the docs site [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #9665: URL: https://github.com/apache/iceberg/issues/9665#issuecomment-2409444237 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Website: Add release schedule on the releases page [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9666: URL: https://github.com/apache/iceberg/pull/9666#issuecomment-2409444288 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Operations on partition columns in `WHERE` clause not used in pruning [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #9678: URL: https://github.com/apache/iceberg/issues/9678#issuecomment-240952 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Support for pushdown like filter (endsWith and contains) [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9683: URL: https://github.com/apache/iceberg/pull/9683#issuecomment-2409444593 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Build: Bump junit from 5.10.1 to 5.10.2 [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9699: URL: https://github.com/apache/iceberg/pull/9699#issuecomment-2409444871 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] HMS lock timeout [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #9654: URL: https://github.com/apache/iceberg/issues/9654#issuecomment-2409444091 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] HIVE-28021: escape percent symbol [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9667: URL: https://github.com/apache/iceberg/pull/9667#issuecomment-2409444347 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Iceberg Rewrite DataFiles unmanageable behavior [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #9674: URL: https://github.com/apache/iceberg/issues/9674#issuecomment-240901 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Flink: Made IcebergFilesCommitter work with single phase commit [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9694: URL: https://github.com/apache/iceberg/pull/9694#issuecomment-2409444787 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Docs: Deprecate distinct_counts since it is no longer used in codebase [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9680: URL: https://github.com/apache/iceberg/pull/9680#issuecomment-240998 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Fix header links with underscores in title [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on PR #9697: URL: https://github.com/apache/iceberg/pull/9697#issuecomment-2409444828 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
amogh-jahagirdar commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798639774 ## core/src/main/java/org/apache/iceberg/RESTPlanningMode.java: ## @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
amogh-jahagirdar commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798639774 ## core/src/main/java/org/apache/iceberg/RESTPlanningMode.java: ## @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
amogh-jahagirdar commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798639774 ## core/src/main/java/org/apache/iceberg/RESTPlanningMode.java: ## @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
amogh-jahagirdar commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798639774 ## core/src/main/java/org/apache/iceberg/RESTPlanningMode.java: ## @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or

Re: [PR] Spark: Merge new position deletes with old deletes during writing [iceberg]

2024-10-13 Thread via GitHub
amogh-jahagirdar commented on code in PR #11273: URL: https://github.com/apache/iceberg/pull/11273#discussion_r1798640841 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/source/SparkBatchQueryScan.java: ## @@ -158,6 +163,26 @@ public void filter(Predicate[] predicates

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
rahil-c commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798718031 ## core/src/main/java/org/apache/iceberg/rest/RESTContentFileParser.java: ## @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + *

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
singhpk234 commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798744690 ## core/src/main/java/org/apache/iceberg/rest/RESTContentFileParser.java: ## @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

Re: [PR] API, Core: Add scan planning apis to REST Catalog [iceberg]

2024-10-13 Thread via GitHub
singhpk234 commented on code in PR #11180: URL: https://github.com/apache/iceberg/pull/11180#discussion_r1798744690 ## core/src/main/java/org/apache/iceberg/rest/RESTContentFileParser.java: ## @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

Re: [PR] Arrow: Deprecate unused fixed width binary reader classes [iceberg]

2024-10-13 Thread via GitHub
nastra merged PR #11292: URL: https://github.com/apache/iceberg/pull/11292 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Spec v3: Add deletion vectors to the table spec [iceberg]

2024-10-13 Thread via GitHub
wgtmac commented on code in PR #11240: URL: https://github.com/apache/iceberg/pull/11240#discussion_r1798786736 ## format/spec.md: ## @@ -454,35 +457,40 @@ The schema of a manifest file is a struct called `manifest_entry` with the follo `data_file` is a struct with the follo

Re: [I] If we replaced or dropped partition spec field and drop the corresponding column, we can't select table again [iceberg]

2024-10-13 Thread via GitHub
bknbkn commented on issue #11314: URL: https://github.com/apache/iceberg/issues/11314#issuecomment-2409677616 The reason for this problem seems to be that each spec uses the latest schema, and historical specs may not be able to find fields in the latest schema. I think it is necessa

Re: [PR] docs: README uses iceberg-rust instead of we [iceberg-rust]

2024-10-13 Thread via GitHub
Xuanwo merged PR #667: URL: https://github.com/apache/iceberg-rust/pull/667 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.a

Re: [PR] chore(deps): Bump crate-ci/typos from 1.25.0 to 1.26.0 [iceberg-rust]

2024-10-13 Thread via GitHub
Xuanwo merged PR #668: URL: https://github.com/apache/iceberg-rust/pull/668 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.a

Re: [PR] Spec: Adds Row Lineage [iceberg]

2024-10-13 Thread via GitHub
wgtmac commented on code in PR #11130: URL: https://github.com/apache/iceberg/pull/11130#discussion_r1798768067 ## format/spec.md: ## @@ -598,6 +702,14 @@ Notes: 1. Lower and upper bounds are serialized to bytes using the single-object serialization in Appendix D. The type of

Re: [PR] OpenAPI: Standardize credentials in loadTable/loadView responses [iceberg]

2024-10-13 Thread via GitHub
nastra commented on code in PR #10722: URL: https://github.com/apache/iceberg/pull/10722#discussion_r1798841576 ## open-api/rest-catalog-open-api.yaml: ## @@ -3129,6 +3145,11 @@ components: - `s3.secret-access-key`: secret for credentials that provide access to data i

Re: [PR] Api, Spark: Make StrictMetricsEvaluator not fail on nested column predicates [iceberg]

2024-10-13 Thread via GitHub
nastra merged PR #11261: URL: https://github.com/apache/iceberg/pull/11261 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [I] Cannot delete column with nested field filter [iceberg]

2024-10-13 Thread via GitHub
nastra closed issue #7065: Cannot delete column with nested field filter URL: https://github.com/apache/iceberg/issues/7065 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u