Re: [PR] Add REST Compatibility Kit [iceberg]

2024-08-14 Thread via GitHub
nastra commented on code in PR #10908: URL: https://github.com/apache/iceberg/pull/10908#discussion_r1718014414 ## open-api/src/testFixtures/java/org/apache/iceberg/rest/RESTCatalogServer.java: ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under o

Re: [PR] AWS, Core: Slim down Jetty config for tests [iceberg]

2024-08-14 Thread via GitHub
nastra commented on code in PR #10945: URL: https://github.com/apache/iceberg/pull/10945#discussion_r1718013971 ## aws/src/test/java/org/apache/iceberg/aws/s3/signer/TestS3RestSigner.java: ## @@ -171,12 +171,8 @@ private static Server initHttpServer() throws Exception {

Re: [PR] AWS, Core: Slim down Jetty config for tests [iceberg]

2024-08-14 Thread via GitHub
nastra commented on code in PR #10945: URL: https://github.com/apache/iceberg/pull/10945#discussion_r1718013008 ## aws/src/test/java/org/apache/iceberg/aws/s3/signer/TestS3RestSigner.java: ## @@ -171,12 +171,8 @@ private static Server initHttpServer() throws Exception {

Re: [PR] Manifest list encryption [iceberg]

2024-08-14 Thread via GitHub
ggershinsky commented on code in PR #7770: URL: https://github.com/apache/iceberg/pull/7770#discussion_r1718009497 ## core/src/main/java/org/apache/iceberg/encryption/StandardEncryptionManager.java: ## @@ -20,28 +20,46 @@ import java.nio.ByteBuffer; import java.security.Secu

Re: [PR] Add REST Compatibility Kit [iceberg]

2024-08-14 Thread via GitHub
nastra commented on code in PR #10908: URL: https://github.com/apache/iceberg/pull/10908#discussion_r1718006287 ## open-api/src/testFixtures/java/org/apache/iceberg/rest/RESTCatalogServer.java: ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under o

Re: [PR] Flink: infer source parallelism for FLIP-27 source in batch execution mode [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10832: URL: https://github.com/apache/iceberg/pull/10832#discussion_r1717648578 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/source/IcebergSource.java: ## @@ -225,10 +254,12 @@ public static class Builder { private SplitAssi

Re: [PR] Introduces the new IcebergSink based on the new V2 Flink Sink Abstraction [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10179: URL: https://github.com/apache/iceberg/pull/10179#discussion_r1717695753 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergSink.java: ## @@ -0,0 +1,811 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

Re: [PR] Introduces the new IcebergSink based on the new V2 Flink Sink Abstraction [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10179: URL: https://github.com/apache/iceberg/pull/10179#discussion_r1717854156 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergSink.java: ## @@ -0,0 +1,761 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

Re: [PR] Introduces the new IcebergSink based on the new V2 Flink Sink Abstraction [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10179: URL: https://github.com/apache/iceberg/pull/10179#discussion_r1717845355 ## flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/committer/TestIcebergCommitter.java: ## @@ -0,0 +1,1526 @@ +/* + * Licensed to the Apache Software

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
sungwy commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717833002 ## pyiceberg/io/pyarrow.py: ## @@ -1304,6 +1305,195 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_per_f

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
sungwy commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717825245 ## pyiceberg/io/pyarrow.py: ## @@ -1308,6 +1309,192 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_per_f

[PR] update release [iceberg-python]

2024-08-14 Thread via GitHub
kevinjqliu opened a new pull request, #1064: URL: https://github.com/apache/iceberg-python/pull/1064 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
corleyma commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717763537 ## pyiceberg/io/pyarrow.py: ## @@ -1304,6 +1305,195 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_per

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
ndrluis commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717675207 ## pyiceberg/io/pyarrow.py: ## @@ -1308,6 +1309,192 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_per_

[I] Try `arro3` as custom FileIO in tests [iceberg-python]

2024-08-14 Thread via GitHub
kevinjqliu opened a new issue, #1063: URL: https://github.com/apache/iceberg-python/issues/1063 ### Feature Request / Improvement https://github.com/kylebarron/arro3 "A minimal Python library for Apache Arrow, connecting to the Rust arrow crate" Set `py-io-impl` and run test

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
kevinjqliu commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717696677 ## pyiceberg/io/pyarrow.py: ## @@ -1304,6 +1305,195 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_p

Re: [PR] Introduces the new IcebergSink based on the new V2 Flink Sink Abstraction [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10179: URL: https://github.com/apache/iceberg/pull/10179#discussion_r1717695753 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergSink.java: ## @@ -0,0 +1,811 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
kevinjqliu commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717696470 ## pyiceberg/io/pyarrow.py: ## @@ -1304,6 +1305,195 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_p

Re: [PR] Introduces the new IcebergSink based on the new V2 Flink Sink Abstraction [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10179: URL: https://github.com/apache/iceberg/pull/10179#discussion_r1717693414 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergSink.java: ## @@ -0,0 +1,811 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

Re: [PR] Introduces the new IcebergSink based on the new V2 Flink Sink Abstraction [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10179: URL: https://github.com/apache/iceberg/pull/10179#discussion_r1717690616 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergSink.java: ## @@ -0,0 +1,811 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

Re: [PR] Introduces the new IcebergSink based on the new V2 Flink Sink Abstraction [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10179: URL: https://github.com/apache/iceberg/pull/10179#discussion_r1717690006 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergSink.java: ## @@ -0,0 +1,811 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

Re: [PR] Introduces the new IcebergSink based on the new V2 Flink Sink Abstraction [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10179: URL: https://github.com/apache/iceberg/pull/10179#discussion_r1717685655 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergSink.java: ## @@ -0,0 +1,811 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
kevinjqliu commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717682714 ## pyiceberg/io/pyarrow.py: ## @@ -1304,6 +1305,195 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_p

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
kevinjqliu commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717681434 ## pyiceberg/io/pyarrow.py: ## @@ -1304,6 +1305,195 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_p

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
kevinjqliu commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717678600 ## pyiceberg/io/pyarrow.py: ## @@ -1308,6 +1309,192 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_p

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
ndrluis commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717675207 ## pyiceberg/io/pyarrow.py: ## @@ -1308,6 +1309,192 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_per_

Re: [PR] Refactor PyArrow DataFiles Projection functions [iceberg-python]

2024-08-14 Thread via GitHub
ndrluis commented on code in PR #1043: URL: https://github.com/apache/iceberg-python/pull/1043#discussion_r1717670683 ## pyiceberg/io/pyarrow.py: ## @@ -1308,6 +1309,192 @@ def _read_all_delete_files(fs: FileSystem, tasks: Iterable[FileScanTask]) -> Dic return deletes_per_

Re: [PR] Core: create a default Hadoop config if not provided in constructor [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10926: URL: https://github.com/apache/iceberg/pull/10926#discussion_r1717669065 ## core/src/main/java/org/apache/iceberg/hadoop/HadoopFileIO.java: ## @@ -63,7 +63,11 @@ public class HadoopFileIO implements HadoopConfigurable, DelegateFileIO {

Re: [PR] Core: create a default Hadoop config if not provided in constructor [iceberg]

2024-08-14 Thread via GitHub
stevenzwu commented on code in PR #10926: URL: https://github.com/apache/iceberg/pull/10926#discussion_r1717669065 ## core/src/main/java/org/apache/iceberg/hadoop/HadoopFileIO.java: ## @@ -63,7 +63,11 @@ public class HadoopFileIO implements HadoopConfigurable, DelegateFileIO {

Re: [PR] Optimize reads of record batches by pushing limit to file level [iceberg-python]

2024-08-14 Thread via GitHub
kevinjqliu commented on PR #1057: URL: https://github.com/apache/iceberg-python/pull/1057#issuecomment-2290148441 Thanks @soumya-ghosh. I think #1043 is addressing this same issue. Can we use this PR to standardize a test suite for the read path to ensure the optimization is applied?

Re: [I] Rust <> Python integration point [iceberg-rust]

2024-08-14 Thread via GitHub
kevinjqliu commented on issue #538: URL: https://github.com/apache/iceberg-rust/issues/538#issuecomment-2290124979 > Does pyiceberg provide an interface that we can integrate with? Yes, there is a `py-catalog-impl` configuration that will try to load a given classpath. ([documentatio

Re: [PR] Spark: Add Spark procedures for snapshot branching and tagging [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4586: Spark: Add Spark procedures for snapshot branching and tagging URL: https://github.com/apache/iceberg/pull/4586 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Spark: Add Spark procedures for snapshot branching and tagging [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4586: URL: https://github.com/apache/iceberg/pull/4586#issuecomment-2290114517 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] iceberg v2 table changelog streaming read feature support [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4528: iceberg v2 table changelog streaming read feature support URL: https://github.com/apache/iceberg/pull/4528 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] iceberg v2 table changelog streaming read feature support [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4528: URL: https://github.com/apache/iceberg/pull/4528#issuecomment-2290114440 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] API: Add default value core api and schema serialization [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4525: URL: https://github.com/apache/iceberg/pull/4525#issuecomment-2290114427 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] API: Add default value core api and schema serialization [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4525: API: Add default value core api and schema serialization URL: https://github.com/apache/iceberg/pull/4525 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Core: Skipping manifest clean-up for all Error or Exception. [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4507: URL: https://github.com/apache/iceberg/pull/4507#issuecomment-2290114387 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Core: Skipping manifest clean-up for all Error or Exception. [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4507: Core: Skipping manifest clean-up for all Error or Exception. URL: https://github.com/apache/iceberg/pull/4507 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Docs: update Spark Write doc for partitioned tables [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4463: URL: https://github.com/apache/iceberg/pull/4463#issuecomment-2290114376 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Spark: support stream-results in DeleteOrphanFiles action [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4451: Spark: support stream-results in DeleteOrphanFiles action URL: https://github.com/apache/iceberg/pull/4451 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Static Analysis: Rewrite empty and inappropriate Javadocs [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4438: Static Analysis: Rewrite empty and inappropriate Javadocs URL: https://github.com/apache/iceberg/pull/4438 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] Static Analysis: Rewrite empty and inappropriate Javadocs [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4438: URL: https://github.com/apache/iceberg/pull/4438#issuecomment-2290114336 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] [Spark][Core]: Release memory when rewriting RewriteFileGroup finished [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4427: URL: https://github.com/apache/iceberg/pull/4427#issuecomment-2290114282 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Static Analysis: Supressions we know are false positive [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4437: URL: https://github.com/apache/iceberg/pull/4437#issuecomment-2290114310 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] There is no 'key_metadata' field in manifest_file, so delete it [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4399: URL: https://github.com/apache/iceberg/pull/4399#issuecomment-2290114245 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] There is no 'key_metadata' field in manifest_file, so delete it [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4399: There is no 'key_metadata' field in manifest_file, so delete it URL: https://github.com/apache/iceberg/pull/4399 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Flink - Fix UPSERT delete file metadata [Backport to Flink 1.12] [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4418: Flink - Fix UPSERT delete file metadata [Backport to Flink 1.12] URL: https://github.com/apache/iceberg/pull/4418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] Docs: Add Drill to Documentation [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4300: Docs: Add Drill to Documentation URL: https://github.com/apache/iceberg/pull/4300 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Spark: Skip corrupt files in Spark Procedures and Actions [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4325: Spark: Skip corrupt files in Spark Procedures and Actions URL: https://github.com/apache/iceberg/pull/4325 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Flink: Add disk-based insertedRowMap to resolve the OOM while ingesting. [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4298: Flink: Add disk-based insertedRowMap to resolve the OOM while ingesting. URL: https://github.com/apache/iceberg/pull/4298 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Flink: Add support for ResolvedSchema [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4246: Flink: Add support for ResolvedSchema URL: https://github.com/apache/iceberg/pull/4246 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] Flink: Add support for ResolvedSchema [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4246: URL: https://github.com/apache/iceberg/pull/4246#issuecomment-2290114099 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] [Spark] Preserves the original table format when migrating from hive to Iceberg #4226 [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4227: [Spark] Preserves the original table format when migrating from hive to Iceberg #4226 URL: https://github.com/apache/iceberg/pull/4227 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] Support non-optional union types for Avro [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4242: Support non-optional union types for Avro URL: https://github.com/apache/iceberg/pull/4242 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Support non-optional union types for Avro [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4242: URL: https://github.com/apache/iceberg/pull/4242#issuecomment-2290114076 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] SPEC - Update REST Catalog spec to put examples + type details on catalog config [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4186: URL: https://github.com/apache/iceberg/pull/4186#issuecomment-2290114000 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Doc: Add flink configuration [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4181: URL: https://github.com/apache/iceberg/pull/4181#issuecomment-2290113947 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Core: bugfix add initial offset when using parquet format [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4162: URL: https://github.com/apache/iceberg/pull/4162#issuecomment-2290113918 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] [Core] Add utility to print an Iceberg table metadata [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4142: URL: https://github.com/apache/iceberg/pull/4142#issuecomment-2290113890 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Spark: Implement the architecture to read default values [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4547: URL: https://github.com/apache/iceberg/pull/4547#issuecomment-2290114499 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] [Core] Add utility to print an Iceberg table metadata [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4142: [Core] Add utility to print an Iceberg table metadata URL: https://github.com/apache/iceberg/pull/4142 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Core: filter manifest with deleted files optimization [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4094: URL: https://github.com/apache/iceberg/pull/4094#issuecomment-2290113813 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Core: filter manifest with deleted files optimization [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4094: Core: filter manifest with deleted files optimization URL: https://github.com/apache/iceberg/pull/4094 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Core: add FanoutEqualityDeleteWriter and FanoutPositionDeleteWriter [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4091: Core: add FanoutEqualityDeleteWriter and FanoutPositionDeleteWriter URL: https://github.com/apache/iceberg/pull/4091 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] Change Data Capture(CDC)[Draft] [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4539: Change Data Capture(CDC)[Draft] URL: https://github.com/apache/iceberg/pull/4539 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Spark: Implement the architecture to read default values [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4547: Spark: Implement the architecture to read default values URL: https://github.com/apache/iceberg/pull/4547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Change Data Capture(CDC)[Draft] [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4539: URL: https://github.com/apache/iceberg/pull/4539#issuecomment-2290114484 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Core: Add InMemory FileIO/Catalog and extract common catalog tests from HadoopCatalog into a common test [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4054: URL: https://github.com/apache/iceberg/pull/4054#issuecomment-2290113670 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] :bug: fix Flink Read support for parquet int96 timestamps [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #3987: :bug: fix Flink Read support for parquet int96 timestamps URL: https://github.com/apache/iceberg/pull/3987 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Docs: add Cloudera native docs section [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4536: Docs: add Cloudera native docs section URL: https://github.com/apache/iceberg/pull/4536 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Docs: add Cloudera native docs section [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4536: URL: https://github.com/apache/iceberg/pull/4536#issuecomment-2290114455 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Core: Add InMemory FileIO/Catalog and extract common catalog tests from HadoopCatalog into a common test [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4054: Core: Add InMemory FileIO/Catalog and extract common catalog tests from HadoopCatalog into a common test URL: https://github.com/apache/iceberg/pull/4054 -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] Core: Use min sequence number on each partition to remove old delete files [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #3990: Core: Use min sequence number on each partition to remove old delete files URL: https://github.com/apache/iceberg/pull/3990 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] Core: Use min sequence number on each partition to remove old delete files [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #3990: URL: https://github.com/apache/iceberg/pull/3990#issuecomment-2290113545 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Core: Rewrite v2 table files. [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4522: Core: Rewrite v2 table files. URL: https://github.com/apache/iceberg/pull/4522 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Core: Rewrite v2 table files. [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4522: URL: https://github.com/apache/iceberg/pull/4522#issuecomment-2290114410 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Core: fix it will not be rewritten when only one large file is divided into several target files [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #3975: URL: https://github.com/apache/iceberg/pull/3975#issuecomment-2290113467 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Docs: update Spark Write doc for partitioned tables [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4463: Docs: update Spark Write doc for partitioned tables URL: https://github.com/apache/iceberg/pull/4463 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Core: fix it will not be rewritten when only one large file is divided into several target files [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #3975: Core: fix it will not be rewritten when only one large file is divided into several target files URL: https://github.com/apache/iceberg/pull/3975 -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] Parquet: close parquet writer compressor to avoid leaking the native memory #3950 [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #3974: Parquet: close parquet writer compressor to avoid leaking the native memory #3950 URL: https://github.com/apache/iceberg/pull/3974 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Hive: HiveSchemaConverter should use one-based indexing like Iceberg … [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #3947: Hive: HiveSchemaConverter should use one-based indexing like Iceberg … URL: https://github.com/apache/iceberg/pull/3947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] Spark: support stream-results in DeleteOrphanFiles action [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4451: URL: https://github.com/apache/iceberg/pull/4451#issuecomment-2290114349 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Core: Use changed partition to validate file confilct [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #3945: Core: Use changed partition to validate file confilct URL: https://github.com/apache/iceberg/pull/3945 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Hive: HiveSchemaConverter should use one-based indexing like Iceberg … [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #3947: URL: https://github.com/apache/iceberg/pull/3947#issuecomment-2290113389 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Core: Use changed partition to validate file confilct [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #3945: URL: https://github.com/apache/iceberg/pull/3945#issuecomment-2290113357 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Static Analysis: Supressions we know are false positive [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4437: Static Analysis: Supressions we know are false positive URL: https://github.com/apache/iceberg/pull/4437 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] Flink - Fix UPSERT delete file metadata [Backport to Flink 1.12] [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4418: URL: https://github.com/apache/iceberg/pull/4418#issuecomment-2290114264 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] [Spark][Core]: Release memory when rewriting RewriteFileGroup finished [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4427: [Spark][Core]: Release memory when rewriting RewriteFileGroup finished URL: https://github.com/apache/iceberg/pull/4427 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] Enable parallel_delete in spark action to speed up snapshot expire [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4340: Enable parallel_delete in spark action to speed up snapshot expire URL: https://github.com/apache/iceberg/pull/4340 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] Spark: Skip corrupt files in Spark Procedures and Actions [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4325: URL: https://github.com/apache/iceberg/pull/4325#issuecomment-2290114199 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Doc: add a page to explain Iceberg multi-engine support [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #3864: URL: https://github.com/apache/iceberg/pull/3864#issuecomment-2290113314 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Enable parallel_delete in spark action to speed up snapshot expire [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4340: URL: https://github.com/apache/iceberg/pull/4340#issuecomment-2290114220 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Flink: Refactor to use the BaseEqualityDeltaWriter. [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4264: Flink: Refactor to use the BaseEqualityDeltaWriter. URL: https://github.com/apache/iceberg/pull/4264 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Docs: Add Drill to Documentation [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4300: URL: https://github.com/apache/iceberg/pull/4300#issuecomment-2290114171 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Spark: Supports partition management in V2 Catalog [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #3862: Spark: Supports partition management in V2 Catalog URL: https://github.com/apache/iceberg/pull/3862 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Flink: Refactor to use the BaseEqualityDeltaWriter. [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4264: URL: https://github.com/apache/iceberg/pull/4264#issuecomment-2290114128 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Flink: Add disk-based insertedRowMap to resolve the OOM while ingesting. [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] commented on PR #4298: URL: https://github.com/apache/iceberg/pull/4298#issuecomment-2290114152 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Docs: Sync back markdown updates which were done directly in iceberg-docs [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4215: Docs: Sync back markdown updates which were done directly in iceberg-docs URL: https://github.com/apache/iceberg/pull/4215 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] SPEC - Update REST Catalog spec to put examples + type details on catalog config [iceberg]

2024-08-14 Thread via GitHub
github-actions[bot] closed pull request #4186: SPEC - Update REST Catalog spec to put examples + type details on catalog config URL: https://github.com/apache/iceberg/pull/4186 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

  1   2   3   >