Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
FANNG1 commented on code in PR #576: URL: https://github.com/apache/iceberg-rust/pull/576#discussion_r1729785163 ## crates/iceberg/src/spec/table_metadata.rs: ## @@ -1293,7 +1293,7 @@ mod tests { name: "x".to_string(), transform: Transform::Iden

Re: [I] partition-id should be field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
Xuanwo closed issue #575: partition-id should be field-id in UnboundPartitionField URL: https://github.com/apache/iceberg-rust/issues/575 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
Xuanwo commented on code in PR #576: URL: https://github.com/apache/iceberg-rust/pull/576#discussion_r1729727371 ## crates/iceberg/src/spec/table_metadata.rs: ## @@ -1293,7 +1293,7 @@ mod tests { name: "x".to_string(), transform: Transform::Iden

Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
Xuanwo merged PR #576: URL: https://github.com/apache/iceberg-rust/pull/576 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.a

Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
FANNG1 commented on code in PR #576: URL: https://github.com/apache/iceberg-rust/pull/576#discussion_r1729685905 ## crates/iceberg/src/spec/table_metadata.rs: ## @@ -1293,7 +1293,7 @@ mod tests { name: "x".to_string(), transform: Transform::Iden

Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
FANNG1 commented on code in PR #576: URL: https://github.com/apache/iceberg-rust/pull/576#discussion_r1729685905 ## crates/iceberg/src/spec/table_metadata.rs: ## @@ -1293,7 +1293,7 @@ mod tests { name: "x".to_string(), transform: Transform::Iden

Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
FANNG1 commented on code in PR #576: URL: https://github.com/apache/iceberg-rust/pull/576#discussion_r1729678815 ## crates/iceberg/src/spec/table_metadata.rs: ## @@ -1293,7 +1293,7 @@ mod tests { name: "x".to_string(), transform: Transform::Iden

Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
FANNG1 commented on code in PR #576: URL: https://github.com/apache/iceberg-rust/pull/576#discussion_r1729678815 ## crates/iceberg/src/spec/table_metadata.rs: ## @@ -1293,7 +1293,7 @@ mod tests { name: "x".to_string(), transform: Transform::Iden

Re: [I] Add benchmark to the CI [iceberg-python]

2024-08-23 Thread via GitHub
sungwy commented on issue #27: URL: https://github.com/apache/iceberg-python/issues/27#issuecomment-2307996563 bump - not stale -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] Fix `table_exists` behavior in REST catalog [iceberg-python]

2024-08-23 Thread via GitHub
sungwy merged PR #1096: URL: https://github.com/apache/iceberg-python/pull/1096 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@icebe

Re: [PR] Bump mkdocs-material from 9.5.32 to 9.5.33 [iceberg-python]

2024-08-23 Thread via GitHub
sungwy merged PR #1097: URL: https://github.com/apache/iceberg-python/pull/1097 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@icebe

Re: [PR] fix (issue-1079): allow update_column to set doc as '' [iceberg-python]

2024-08-23 Thread via GitHub
sungwy commented on code in PR #1083: URL: https://github.com/apache/iceberg-python/pull/1083#discussion_r1729655424 ## pyiceberg/table/__init__.py: ## @@ -2492,21 +2492,26 @@ def update_column( except ResolveError as e: raise ValidationErro

Re: [PR] fix (issue-1079): allow update_column to set doc as '' [iceberg-python]

2024-08-23 Thread via GitHub
sungwy commented on code in PR #1083: URL: https://github.com/apache/iceberg-python/pull/1083#discussion_r1729655377 ## pyiceberg/table/__init__.py: ## @@ -2492,21 +2492,26 @@ def update_column( except ResolveError as e: raise ValidationErro

[PR] Bump getdaft from 0.3.0 to 0.3.1 [iceberg-python]

2024-08-23 Thread via GitHub
dependabot[bot] opened a new pull request, #1098: URL: https://github.com/apache/iceberg-python/pull/1098 Bumps [getdaft](https://github.com/Eventual-Inc/Daft) from 0.3.0 to 0.3.1. Release notes Sourced from https://github.com/Eventual-Inc/Daft/releases";>getdaft's releases.

Re: [PR] Bump getdaft from 0.2.33 to 0.3.0 [iceberg-python]

2024-08-23 Thread via GitHub
dependabot[bot] closed pull request #1080: Bump getdaft from 0.2.33 to 0.3.0 URL: https://github.com/apache/iceberg-python/pull/1080 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] Bump getdaft from 0.2.33 to 0.3.0 [iceberg-python]

2024-08-23 Thread via GitHub
dependabot[bot] commented on PR #1080: URL: https://github.com/apache/iceberg-python/pull/1080#issuecomment-2307987556 Superseded by #1098. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] Bump mypy-boto3-glue from 1.35.0 to 1.35.3 [iceberg-python]

2024-08-23 Thread via GitHub
dependabot[bot] closed pull request #1086: Bump mypy-boto3-glue from 1.35.0 to 1.35.3 URL: https://github.com/apache/iceberg-python/pull/1086 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] Bump mypy-boto3-glue from 1.35.0 to 1.35.3 [iceberg-python]

2024-08-23 Thread via GitHub
dependabot[bot] commented on PR #1086: URL: https://github.com/apache/iceberg-python/pull/1086#issuecomment-2307986704 Looks like mypy-boto3-glue is up-to-date now, so this is no longer needed. -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [I] Increase the minimal required pyarrow version to 14.0.0 [iceberg-python]

2024-08-23 Thread via GitHub
sungwy commented on issue #1089: URL: https://github.com/apache/iceberg-python/issues/1089#issuecomment-2307986136 Resolved through #1090 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] Increase the minimal required pyarrow version to 14.0.0 [iceberg-python]

2024-08-23 Thread via GitHub
sungwy merged PR #1090: URL: https://github.com/apache/iceberg-python/pull/1090 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@icebe

Re: [I] Increase the minimal required pyarrow version to 14.0.0 [iceberg-python]

2024-08-23 Thread via GitHub
sungwy closed issue #1089: Increase the minimal required pyarrow version to 14.0.0 URL: https://github.com/apache/iceberg-python/issues/1089 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] show partition values [iceberg-python]

2024-08-23 Thread via GitHub
sungwy commented on issue #1094: URL: https://github.com/apache/iceberg-python/issues/1094#issuecomment-2307985053 Hi @carcmarc , thank you for raising this issue! I believe we already have this feature implemented through its inspect tables. Given that you have access to a table

Re: [PR] fix: improve makefile [iceberg-python]

2024-08-23 Thread via GitHub
sungwy commented on code in PR #1091: URL: https://github.com/apache/iceberg-python/pull/1091#discussion_r1729651357 ## Makefile: ## @@ -15,28 +15,37 @@ # specific language governing permissions and limitations # under the License. -install-poetry: - pip install poetry

Re: [PR] DRAFT - Issue 10275 - Reward support for nulls [iceberg]

2024-08-23 Thread via GitHub
sl255051 commented on PR #10953: URL: https://github.com/apache/iceberg/pull/10953#issuecomment-2307968000 Thank you, Eduard, for your help. I will be on vacation next week. I will pick this up again when I return on September 3. -Steve Lessard From: Eduard Tudenhoefner ***

Re: [PR] Spec: Support geo type [iceberg]

2024-08-23 Thread via GitHub
szehon-ho commented on PR #10981: URL: https://github.com/apache/iceberg/pull/10981#issuecomment-2307959561 Hi all fyi i have encountered some problems while remote, will come back to this after i get back home in a two weeks -- This is an automated message from the Apache Git Service. To

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi merged PR #10984: URL: https://github.com/apache/iceberg/pull/10984 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@icebe

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on PR #10984: URL: https://github.com/apache/iceberg/pull/10984#issuecomment-2307956095 Thanks, @karuppayya @nastra! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729628810 ## spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestComputeTableStatsAction.java: ## @@ -79,6 +79,20 @@ public class TestComputeTableStatsActio

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729628810 ## spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestComputeTableStatsAction.java: ## @@ -79,6 +79,20 @@ public class TestComputeTableStatsActio

Re: [PR] Add REST catalog spec to iceberg-core.jar [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6672: URL: https://github.com/apache/iceberg/pull/6672#issuecomment-2307946410 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Q: REST / `TableMetadata` format-version field [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6662: URL: https://github.com/apache/iceberg/issues/6662#issuecomment-2307946397 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Q: REST / `TableMetadata` format-version field [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] closed issue #6662: Q: REST / `TableMetadata` format-version field URL: https://github.com/apache/iceberg/issues/6662 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] ManifestReader does not return metrics with null filters [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6658: URL: https://github.com/apache/iceberg/issues/6658#issuecomment-2307946386 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Purpose of MAX_CONTINUOUS_EMPTY_COMMITS in IcebergFilesCommitter [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6630: URL: https://github.com/apache/iceberg/issues/6630#issuecomment-2307946346 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Unclear messaging about Glue catalog locking [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6636: URL: https://github.com/apache/iceberg/issues/6636#issuecomment-2307946357 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Core: Add information_schema.namespaces table [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6599: URL: https://github.com/apache/iceberg/pull/6599#issuecomment-2307946270 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Docs: Update the description of binary and varbinary type in the type conversion section [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6608: URL: https://github.com/apache/iceberg/pull/6608#issuecomment-2307946281 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Add a Spark procedure to collect NDV [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6582: URL: https://github.com/apache/iceberg/pull/6582#issuecomment-2307946260 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] AWS, Core, Hive: Fix `checkCommitStatus` when create table commit fails [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6499: URL: https://github.com/apache/iceberg/pull/6499#issuecomment-2307946202 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] WIP: Support Snapshot Copy-On-Write Hudi Table to Iceberg Table [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6642: URL: https://github.com/apache/iceberg/pull/6642#issuecomment-2307946373 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Extends Iceberg table stats API to allow publish data and stats atomically [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6442: URL: https://github.com/apache/iceberg/issues/6442#issuecomment-2307946138 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Provide Puffin reader API allowing read without decompression [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6443: URL: https://github.com/apache/iceberg/issues/6443#issuecomment-2307946149 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Core: Update error msg [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6626: URL: https://github.com/apache/iceberg/pull/6626#issuecomment-2307946334 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Docs: README [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6433: URL: https://github.com/apache/iceberg/pull/6433#issuecomment-2307946113 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] 🎨 Add "parallelism" parameter to "add_files" syscall and MigrateTable, SnapshotTable. [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6624: URL: https://github.com/apache/iceberg/pull/6624#issuecomment-2307946310 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] [HiveCatalog] Support Altering and Dropping Table Ownership [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6621: URL: https://github.com/apache/iceberg/pull/6621#issuecomment-2307946299 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Flink: Add UT for NaN [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6402: URL: https://github.com/apache/iceberg/pull/6402#issuecomment-2307946057 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Docs: Update Iceberg Hive documentation (#6337) [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6380: URL: https://github.com/apache/iceberg/pull/6380#issuecomment-2307946042 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Spark 3.3: Add RemoveDanglingDeletes action [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6581: URL: https://github.com/apache/iceberg/pull/6581#issuecomment-2307946253 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Increase Partition Start Id to 10000 [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6369: URL: https://github.com/apache/iceberg/pull/6369#issuecomment-2307946033 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Data: java api add GenericTaskWriter and add write demo to Doc. [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6571: URL: https://github.com/apache/iceberg/pull/6571#issuecomment-2307946237 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] fix delete when in upsert mode using two discontinuous primary keys [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6560: URL: https://github.com/apache/iceberg/pull/6560#issuecomment-2307946229 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] iceberg-1.1.0 - flink sql create hive catalog error [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6522: URL: https://github.com/apache/iceberg/issues/6522#issuecomment-2307946217 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] flink iceberg hadoop catalog support hadoop-conf-dir option to read hadoop conf [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6503: URL: https://github.com/apache/iceberg/pull/6503#issuecomment-2307946207 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Flink:support lookup join function with sync and async mode [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6498: URL: https://github.com/apache/iceberg/pull/6498#issuecomment-2307946188 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Spark: Allow specifying file format in RewriteDataFiles [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6470: URL: https://github.com/apache/iceberg/pull/6470#issuecomment-2307946174 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Spark-3.4: Store sort-order-id in manifest_entry's data_file [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6461: URL: https://github.com/apache/iceberg/pull/6461#issuecomment-2307946160 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
karuppayya commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729623120 ## spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestComputeTableStatsAction.java: ## @@ -79,6 +79,20 @@ public class TestComputeTableStatsAction

Re: [PR] Flink: Support Look-up Function [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6440: URL: https://github.com/apache/iceberg/pull/6440#issuecomment-2307946125 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] [Feature Proposal] Log Store in Iceberg [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6429: URL: https://github.com/apache/iceberg/issues/6429#issuecomment-2307946104 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] How compaction works along side incremental read [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6422: URL: https://github.com/apache/iceberg/issues/6422#issuecomment-2307946095 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Reuse existing parquet reader in ReadConf (6416) [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6417: URL: https://github.com/apache/iceberg/pull/6417#issuecomment-2307946079 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] API: Add Aggregate expression evaluation [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6405: URL: https://github.com/apache/iceberg/pull/6405#issuecomment-2307946067 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] [Docs]: improve ChangeLog [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6347: URL: https://github.com/apache/iceberg/issues/6347#issuecomment-2307946023 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] ORC: Fix error when projecting nested indentity partition column [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6327: URL: https://github.com/apache/iceberg/pull/6327#issuecomment-2307946010 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Use the Spark engine to delete from the error [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6255: URL: https://github.com/apache/iceberg/issues/6255#issuecomment-2307945985 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Flink: add more sink shuffling support [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6303: URL: https://github.com/apache/iceberg/issues/6303#issuecomment-2307945992 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Add ignoreDuplicates option for add_files procedure [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6306: URL: https://github.com/apache/iceberg/issues/6306#issuecomment-2307945999 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Update Iceberg Hive documentation [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6249: URL: https://github.com/apache/iceberg/issues/6249#issuecomment-2307945964 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Flink: Write watermark to the snapshot summary [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6253: URL: https://github.com/apache/iceberg/pull/6253#issuecomment-2307945979 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] There is no data in the table, when insert data using Hive on Tez. [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6235: URL: https://github.com/apache/iceberg/issues/6235#issuecomment-2307945953 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] [REST] Add documentation for the REST Catalog specificiation [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6202: URL: https://github.com/apache/iceberg/pull/6202#issuecomment-2307945925 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] AWS: Re-tag files when renaming tables in GlueCatalog [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6179: URL: https://github.com/apache/iceberg/pull/6179#issuecomment-2307945904 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Core: Support IncrementalChangelogScan with deletes. [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6182: URL: https://github.com/apache/iceberg/pull/6182#issuecomment-2307945917 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] iss5675: limit total size of data files for compaction [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6174: URL: https://github.com/apache/iceberg/pull/6174#issuecomment-2307945893 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] rewriteDataFiles throws exception in spark 3.2 [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on issue #6172: URL: https://github.com/apache/iceberg/issues/6172#issuecomment-2307945884 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Flink: Support locality with LocalitySplitAssigner [iceberg]

2024-08-23 Thread via GitHub
github-actions[bot] commented on PR #6160: URL: https://github.com/apache/iceberg/pull/6160#issuecomment-2307945871 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729610441 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/SparkTableUtil.java: ## @@ -851,18 +851,29 @@ private static void deleteManifests(FileIO io, List mani

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729615153 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/SparkTableUtil.java: ## @@ -851,18 +851,29 @@ private static void deleteManifests(FileIO io, List mani

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729610441 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/SparkTableUtil.java: ## @@ -851,18 +851,29 @@ private static void deleteManifests(FileIO io, List mani

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729610441 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/SparkTableUtil.java: ## @@ -851,18 +851,29 @@ private static void deleteManifests(FileIO io, List mani

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729609031 ## spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestComputeTableStatsAction.java: ## @@ -79,6 +79,20 @@ public class TestComputeTableStatsActio

Re: [PR] API: implement types timestamp_ns and timestamptz_ns [iceberg]

2024-08-23 Thread via GitHub
rdblue commented on code in PR #9008: URL: https://github.com/apache/iceberg/pull/9008#discussion_r1729604141 ## api/src/main/java/org/apache/iceberg/transforms/Timestamps.java: ## @@ -31,54 +33,159 @@ import org.apache.iceberg.util.DateTimeUtil; import org.apache.iceberg.util

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729600954 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/SparkTableUtil.java: ## @@ -851,18 +851,29 @@ private static void deleteManifests(FileIO io, List mani

Re: [PR] Spark 3.5: Add utility to load table state reliably [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on code in PR #10984: URL: https://github.com/apache/iceberg/pull/10984#discussion_r1729600743 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/SparkTableUtil.java: ## @@ -851,18 +851,29 @@ private static void deleteManifests(FileIO io, List mani

Re: [PR] Data: Add a util to read write partition stats [iceberg]

2024-08-23 Thread via GitHub
aokolnychyi commented on PR #10176: URL: https://github.com/apache/iceberg/pull/10176#issuecomment-2307890941 I took a detailed look at the implementation/spec today. Here are my high-level points: - The local algorithm was the right choice. I am on board with using `ConcurrentHashMa

Re: [PR] API: implement types timestamp_ns and timestamptz_ns [iceberg]

2024-08-23 Thread via GitHub
rdblue commented on code in PR #9008: URL: https://github.com/apache/iceberg/pull/9008#discussion_r1729572335 ## api/src/main/java/org/apache/iceberg/expressions/ExpressionUtil.java: ## @@ -515,6 +523,8 @@ private static String sanitize(Type type, Object value, long now, int to

[PR] Bump mkdocs-material from 9.5.32 to 9.5.33 [iceberg-python]

2024-08-23 Thread via GitHub
dependabot[bot] opened a new pull request, #1097: URL: https://github.com/apache/iceberg-python/pull/1097 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.5.32 to 9.5.33. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>

Re: [PR] API: implement types timestamp_ns and timestamptz_ns [iceberg]

2024-08-23 Thread via GitHub
rdblue commented on code in PR #9008: URL: https://github.com/apache/iceberg/pull/9008#discussion_r1729572058 ## api/src/main/java/org/apache/iceberg/expressions/Literals.java: ## @@ -453,6 +458,34 @@ protected Type.TypeID typeId() { } } + static class TimestampNanoLi

Re: [PR] API: implement types timestamp_ns and timestamptz_ns [iceberg]

2024-08-23 Thread via GitHub
rdblue commented on code in PR #9008: URL: https://github.com/apache/iceberg/pull/9008#discussion_r1729571928 ## api/src/main/java/org/apache/iceberg/expressions/Literals.java: ## @@ -515,6 +548,18 @@ public Literal to(Type type) { return (Literal) new TimestampLit

Re: [PR] Core: Remove deprecated AssertHelpers [iceberg]

2024-08-23 Thread via GitHub
rdblue commented on code in PR #8062: URL: https://github.com/apache/iceberg/pull/8062#discussion_r1729564755 ## core/src/test/java/org/apache/iceberg/TestSnapshotManager.java: ## @@ -115,11 +116,10 @@ public void testCherryPickDynamicOverwriteConflict() { long lastSnapshot

Re: [PR] API: implement types timestamp_ns and timestamptz_ns [iceberg]

2024-08-23 Thread via GitHub
rdblue commented on code in PR #9008: URL: https://github.com/apache/iceberg/pull/9008#discussion_r1729552330 ## api/src/main/java/org/apache/iceberg/util/DateTimeUtil.java: ## @@ -124,6 +135,11 @@ public static long isoTimestamptzToMicros(String timestampString) { Off

Re: [PR] API,Core: Introduce metrics for data files by file format [iceberg]

2024-08-23 Thread via GitHub
findepi commented on PR #5837: URL: https://github.com/apache/iceberg/pull/5837#issuecomment-2307633354 > for instance with Hive that used ORC format and with Impala that wrote Parquet files. that is likely addressed by preferred file format being a table-level configuration?

Re: [PR] Table Scan: Add Row Group Skipping [iceberg-rust]

2024-08-23 Thread via GitHub
sdd commented on code in PR #558: URL: https://github.com/apache/iceberg-rust/pull/558#discussion_r1729382056 ## crates/iceberg/src/expr/visitors/row_group_metrics_evaluator.rs: ## Review Comment: Back to you, @liurenjie1024 - I've added tests to cover (hopefully!) all cod

Re: [PR] OpenAPI: Add endpoint field to CatalogConfig [iceberg]

2024-08-23 Thread via GitHub
nastra merged PR #10928: URL: https://github.com/apache/iceberg/pull/10928 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
Xuanwo commented on code in PR #576: URL: https://github.com/apache/iceberg-rust/pull/576#discussion_r1729151672 ## crates/iceberg/src/spec/table_metadata.rs: ## @@ -1293,7 +1293,7 @@ mod tests { name: "x".to_string(), transform: Transform::Iden

Re: [PR] Fix `table_exists` behavior in REST catalog [iceberg-python]

2024-08-23 Thread via GitHub
Fokko commented on code in PR #1096: URL: https://github.com/apache/iceberg-python/pull/1096#discussion_r1729201914 ## tests/catalog/test_rest.py: ## @@ -701,17 +702,17 @@ def test_load_table_404(rest_mock: Mocker) -> None: assert "Table does not exist" in str(e.value)

Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
FANNG1 commented on code in PR #576: URL: https://github.com/apache/iceberg-rust/pull/576#discussion_r1729188927 ## crates/iceberg/src/spec/table_metadata.rs: ## @@ -1293,7 +1293,7 @@ mod tests { name: "x".to_string(), transform: Transform::Iden

Re: [PR] Flink: Port #10992 to v1.19 [iceberg]

2024-08-23 Thread via GitHub
pvary merged PR #10994: URL: https://github.com/apache/iceberg/pull/10994 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] fix: correct partition-id to field-id in UnboundPartitionField [iceberg-rust]

2024-08-23 Thread via GitHub
Xuanwo commented on code in PR #576: URL: https://github.com/apache/iceberg-rust/pull/576#discussion_r1729151672 ## crates/iceberg/src/spec/table_metadata.rs: ## @@ -1293,7 +1293,7 @@ mod tests { name: "x".to_string(), transform: Transform::Iden

  1   2   >