Re: [PR] API: Update Conversions.fromPartitionString API to handle timestamps [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10820: URL: https://github.com/apache/iceberg/pull/10820#issuecomment-2480862673 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Build: Bump datamodel-code-generator from 0.26.2 to 0.26.3 [iceberg]

2024-11-16 Thread via GitHub
Fokko merged PR #11572: URL: https://github.com/apache/iceberg/pull/11572 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] Build: Bump software.amazon.awssdk:bom from 2.29.9 to 2.29.15 [iceberg]

2024-11-16 Thread via GitHub
Fokko merged PR #11568: URL: https://github.com/apache/iceberg/pull/11568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] Docs: Add Databend docs url to sidebar [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10834: Docs: Add Databend docs url to sidebar URL: https://github.com/apache/iceberg/pull/10834 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Hive: Pre-check namespace presence for listTables [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10845: URL: https://github.com/apache/iceberg/pull/10845#issuecomment-2480862705 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Api, Core: Set upper boundary for the type parameter of `Scan` [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10743: Api, Core: Set upper boundary for the type parameter of `Scan` URL: https://github.com/apache/iceberg/pull/10743 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] add: test case for merge schema [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10816: URL: https://github.com/apache/iceberg/pull/10816#issuecomment-2480862661 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Docs: Fix Typos and Markdown Formats in Documentation Files [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10884: URL: https://github.com/apache/iceberg/pull/10884#issuecomment-2480862721 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] AddPartitionSpec: A new way to set new partition specs [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10737: URL: https://github.com/apache/iceberg/pull/10737#issuecomment-2480862579 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Docs: Add Databend docs url to sidebar [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10834: URL: https://github.com/apache/iceberg/pull/10834#issuecomment-2480862696 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Build: verify `gradle-wrapper jar` integrity [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10719: URL: https://github.com/apache/iceberg/pull/10719#issuecomment-2480862560 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Add RocksDBStructLikeSet for storing equality deletes [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10667: URL: https://github.com/apache/iceberg/pull/10667#issuecomment-2480862526 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Hive: Pre-check namespace presence for listTables [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10845: Hive: Pre-check namespace presence for listTables URL: https://github.com/apache/iceberg/pull/10845 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Add `IcebergAnalysisException` in iceberg-spark module [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10766: Add `IcebergAnalysisException` in iceberg-spark module URL: https://github.com/apache/iceberg/pull/10766 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Fence zombie coordinators [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10812: URL: https://github.com/apache/iceberg/pull/10812#issuecomment-2480862652 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Build: verify `gradle-wrapper jar` integrity [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10719: Build: verify `gradle-wrapper jar` integrity URL: https://github.com/apache/iceberg/pull/10719 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] Core: Add DataFiles builder API to enable users to specify their own custom conversion logic for string partition values [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10724: Core: Add DataFiles builder API to enable users to specify their own custom conversion logic for string partition values URL: https://github.com/apache/iceberg/pull/10724 -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] Add `IcebergAnalysisException` in iceberg-spark module [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10766: URL: https://github.com/apache/iceberg/pull/10766#issuecomment-2480862614 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Docs: Add a clarification in the spec regarding full name restrictions [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10883: Docs: Add a clarification in the spec regarding full name restrictions URL: https://github.com/apache/iceberg/pull/10883 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] API: Define RepairManifests action interface [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10784: URL: https://github.com/apache/iceberg/pull/10784#issuecomment-2480862630 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Add row-level operation benchmarks [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10687: URL: https://github.com/apache/iceberg/pull/10687#issuecomment-2480862542 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

[PR] Build: Bump datamodel-code-generator from 0.26.2 to 0.26.3 [iceberg]

2024-11-16 Thread via GitHub
dependabot[bot] opened a new pull request, #11572: URL: https://github.com/apache/iceberg/pull/11572 Bumps [datamodel-code-generator](https://github.com/koxudaxi/datamodel-code-generator) from 0.26.2 to 0.26.3. Release notes Sourced from https://github.com/koxudaxi/datamodel-code-

Re: [I] Explicitly declare supported public APIs with '__all__' [iceberg-python]

2024-11-16 Thread via GitHub
ndrluis commented on issue #1099: URL: https://github.com/apache/iceberg-python/issues/1099#issuecomment-2480920839 @sungwy I created [a document](https://docs.google.com/document/d/1s-p6_f9Egg5RPkEaRUiCyJHOqkyhyr5ThC8bNjC5F1s) with the idea to discuss and make it easier for other contribu

[PR] Build: Bump orc from 1.9.4 to 1.9.5 [iceberg]

2024-11-16 Thread via GitHub
dependabot[bot] opened a new pull request, #11571: URL: https://github.com/apache/iceberg/pull/11571 Bumps `orc` from 1.9.4 to 1.9.5. Updates `org.apache.orc:orc-core` from 1.9.4 to 1.9.5 Updates `org.apache.orc:orc-tools` from 1.9.4 to 1.9.5 Dependabot will resolve any c

[PR] Build: Bump parquet from 1.13.1 to 1.14.4 [iceberg]

2024-11-16 Thread via GitHub
dependabot[bot] opened a new pull request, #11570: URL: https://github.com/apache/iceberg/pull/11570 Bumps `parquet` from 1.13.1 to 1.14.4. Updates `org.apache.parquet:parquet-avro` from 1.13.1 to 1.14.4 Release notes Sourced from https://github.com/apache/parquet-mr/releases";>o

[PR] Build: Bump software.amazon.awssdk:bom from 2.29.9 to 2.29.15 [iceberg]

2024-11-16 Thread via GitHub
dependabot[bot] opened a new pull request, #11568: URL: https://github.com/apache/iceberg/pull/11568 Bumps software.amazon.awssdk:bom from 2.29.9 to 2.29.15. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=softw

[PR] Build: Bump io.netty:netty-buffer from 4.1.114.Final to 4.1.115.Final [iceberg]

2024-11-16 Thread via GitHub
dependabot[bot] opened a new pull request, #11569: URL: https://github.com/apache/iceberg/pull/11569 Bumps [io.netty:netty-buffer](https://github.com/netty/netty) from 4.1.114.Final to 4.1.115.Final. Commits https://github.com/netty/netty/commit/04f9b4a827d992ad439823eeba85d65d

[PR] Build: Bump nessie from 0.99.0 to 0.100.0 [iceberg]

2024-11-16 Thread via GitHub
dependabot[bot] opened a new pull request, #11567: URL: https://github.com/apache/iceberg/pull/11567 Bumps `nessie` from 0.99.0 to 0.100.0. Updates `org.projectnessie.nessie:nessie-client` from 0.99.0 to 0.100.0 Updates `org.projectnessie.nessie:nessie-jaxrs-testextension` from 0.99

Re: [PR] Docs: Clarify wording on releases [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10806: Docs: Clarify wording on releases URL: https://github.com/apache/iceberg/pull/10806 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] Spark-3.5: Procedure to add view dialect [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #11327: URL: https://github.com/apache/iceberg/pull/11327#issuecomment-2480862789 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Added support for evolving the partition of the table [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #11275: URL: https://github.com/apache/iceberg/pull/11275#issuecomment-2480862767 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Handling NO Coordinator Scenario and Data Loss in the current Design [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #11298: URL: https://github.com/apache/iceberg/pull/11298#issuecomment-2480862782 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Feature/otf 1500 column comparisons 1521 [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #11164: URL: https://github.com/apache/iceberg/pull/11164#issuecomment-2480862743 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Config for deciding whether to use Iceberg Time type [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #11174: URL: https://github.com/apache/iceberg/pull/11174#issuecomment-2480862755 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] AddPartitionSpec: A new way to set new partition specs [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10737: AddPartitionSpec: A new way to set new partition specs URL: https://github.com/apache/iceberg/pull/10737 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Docs: Add a clarification in the spec regarding full name restrictions [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10883: URL: https://github.com/apache/iceberg/pull/10883#issuecomment-2480862713 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Docs: Fix Typos and Markdown Formats in Documentation Files [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10884: Docs: Fix Typos and Markdown Formats in Documentation Files URL: https://github.com/apache/iceberg/pull/10884 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] API: Update Conversions.fromPartitionString API to handle timestamps [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10820: API: Update Conversions.fromPartitionString API to handle timestamps URL: https://github.com/apache/iceberg/pull/10820 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] Fence zombie coordinators [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10812: Fence zombie coordinators URL: https://github.com/apache/iceberg/pull/10812 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] add: test case for merge schema [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10816: add: test case for merge schema URL: https://github.com/apache/iceberg/pull/10816 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Docs: Clarify wording on releases [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10806: URL: https://github.com/apache/iceberg/pull/10806#issuecomment-2480862641 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] API: Define RepairManifests action interface [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10784: API: Define RepairManifests action interface URL: https://github.com/apache/iceberg/pull/10784 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] Kafka Connect: Add kerberos authentication option [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10173: URL: https://github.com/apache/iceberg/pull/10173#issuecomment-2480862491 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Api, Core: Set upper boundary for the type parameter of `Scan` [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] commented on PR #10743: URL: https://github.com/apache/iceberg/pull/10743#issuecomment-2480862595 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] Add RocksDBStructLikeSet for storing equality deletes [iceberg]

2024-11-16 Thread via GitHub
github-actions[bot] closed pull request #10667: Add RocksDBStructLikeSet for storing equality deletes URL: https://github.com/apache/iceberg/pull/10667 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] Why shouldn't we return an `UnboundPartitionSpec` instead? [iceberg-rust]

2024-11-16 Thread via GitHub
c-thiel commented on issue #694: URL: https://github.com/apache/iceberg-rust/issues/694#issuecomment-2480849988 > Unbound (not bound to a schema) and schemaless are the same, so I find them confusing. They are not quite - a previously bound schema has a required `field_id` (reference

Re: [I] Remove usage of deprecated functions from the codebase [iceberg-python]

2024-11-16 Thread via GitHub
kevinjqliu commented on issue #1327: URL: https://github.com/apache/iceberg-python/issues/1327#issuecomment-2480814630 That's true. For the short term, it'll be good to go through the API already marked for deprecation and make sure the codebase itself is not using them -- This is an au

Re: [I] Remove usage of deprecated functions from the codebase [iceberg-python]

2024-11-16 Thread via GitHub
ndrluis commented on issue #1327: URL: https://github.com/apache/iceberg-python/issues/1327#issuecomment-2480750139 Oh, ok. I believe we need to work on #1099. The way we are currently working makes it hard to deprecate because most of our code is public. -- This is an automated message

Re: [PR] TableMetadataBuilder [iceberg-rust]

2024-11-16 Thread via GitHub
c-thiel commented on code in PR #587: URL: https://github.com/apache/iceberg-rust/pull/587#discussion_r1845199857 ## crates/iceberg/src/spec/table_metadata_builder.rs: ## @@ -0,0 +1,2152 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor li

Re: [PR] Remove Hive 2 dependency [iceberg]

2024-11-16 Thread via GitHub
manuzhang closed pull request #11566: Remove Hive 2 dependency URL: https://github.com/apache/iceberg/pull/11566 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] TableMetadataBuilder [iceberg-rust]

2024-11-16 Thread via GitHub
c-thiel commented on PR #587: URL: https://github.com/apache/iceberg-rust/pull/587#issuecomment-2480672053 > @liurenjie1024 for `set_branch_snapshot` I was missing an easy way to determine the type of a ref. I introduced an enum `ReferenceType`, but if you don't like that, I can also just i

[PR] Add unit test for create_changelog_view time range behavior [iceberg]

2024-11-16 Thread via GitHub
Acehaidrey opened a new pull request, #11564: URL: https://github.com/apache/iceberg/pull/11564 # Add unit test for create_changelog_view time range behavior ## Problem After upgrading to Iceberg 1.5 and Spark 3.5.1, the `create_changelog_view` procedure occasionally returns record

Re: [I] Why shouldn't we return an `UnboundPartitionSpec` instead? [iceberg-rust]

2024-11-16 Thread via GitHub
Fokko commented on issue #694: URL: https://github.com/apache/iceberg-rust/issues/694#issuecomment-2480605287 Unbound (not bound to a schema) and schemaless are the same, so I find them confusing. Regarding https://github.com/apache/iceberg-rust/pull/645#issue-2543573501 there are s

[I] Implement the equality delete writer [iceberg-rust]

2024-11-16 Thread via GitHub
ZENOTME opened a new issue, #341: URL: https://github.com/apache/iceberg-rust/issues/341 After we finish https://github.com/apache/iceberg-rust/pull/275, we can implement the equality delete writer based on this framework. There is a [rust implementation](https://github.com/icelake-i

Re: [I] Implement the equality delete writer [iceberg-rust]

2024-11-16 Thread via GitHub
mkarbo commented on issue #341: URL: https://github.com/apache/iceberg-rust/issues/341#issuecomment-2480543716 Should this be re-opened @Xuanwo? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] Tracking issue: Writing iceberg tables [iceberg-rust]

2024-11-16 Thread via GitHub
ZENOTME commented on issue #346: URL: https://github.com/apache/iceberg-rust/issues/346#issuecomment-2480537255 Thank @c-thiel for raising! I am also working on #340 and can send it as a PR soon. Recently, I will also dedicate more effort to writing support. I think #349 is the first step t

Re: [I] Tracking issue: Writing iceberg tables [iceberg-rust]

2024-11-16 Thread via GitHub
sdd commented on issue #346: URL: https://github.com/apache/iceberg-rust/issues/346#issuecomment-2480530839 I've been intending on switching focus from reads to writes once me delete file read support PR is merged. I'll do my best to attend the meet on the 28th (day before my birthday! 😁) a

Re: [I] Tracking issue: Writing iceberg tables [iceberg-rust]

2024-11-16 Thread via GitHub
c-thiel commented on issue #346: URL: https://github.com/apache/iceberg-rust/issues/346#issuecomment-2480528116 Dear all, we have been talking to many people recently that are working in the Rust data ecosystem for which writes or compaction would be very important. Many are also willing

Re: [I] Why shouldn't we return an `UnboundPartitionSpec` instead? [iceberg-rust]

2024-11-16 Thread via GitHub
c-thiel commented on issue #694: URL: https://github.com/apache/iceberg-rust/issues/694#issuecomment-2480520037 @liurenjie1024, @Fokko, @Xuanwo we should probably come to a conclusion here before the next release. @Fokko is there already something in your Java PR which we can peek at? Wha

Re: [PR] TableMetadataBuilder [iceberg-rust]

2024-11-16 Thread via GitHub
c-thiel commented on code in PR #587: URL: https://github.com/apache/iceberg-rust/pull/587#discussion_r1844949615 ## crates/iceberg/src/spec/table_metadata_builder.rs: ## @@ -0,0 +1,2097 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor li

Re: [PR] API: Add Variant data type [iceberg]

2024-11-16 Thread via GitHub
rdblue commented on code in PR #11324: URL: https://github.com/apache/iceberg/pull/11324#discussion_r1844731548 ## api/src/main/java/org/apache/iceberg/types/Types.java: ## @@ -412,6 +412,41 @@ public String toString() { } } + public static class VariantType implement

Re: [PR] TableMetadataBuilder [iceberg-rust]

2024-11-16 Thread via GitHub
c-thiel commented on code in PR #587: URL: https://github.com/apache/iceberg-rust/pull/587#discussion_r1844668631 ## crates/iceberg/src/spec/table_metadata_builder.rs: ## @@ -0,0 +1,2070 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor li