Re: [PR] Kafka Connect: Add kerberos authentication option [iceberg]

Dawnpool commented on PR #12119: URL: https://github.com/apache/iceberg/pull/12119#issuecomment-2692010557 Hi @bryanck Please check this PR when you have a chance. Thank you in advance. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] AWS: Add support for enabling access to S3 Requester Pays bucket [iceberg]

github-actions[bot] commented on PR #11915: URL: https://github.com/apache/iceberg/pull/11915#issuecomment-2691757200 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] AWS: Integrate S3 analytics accelerator library [iceberg]

SanjayMarreddi commented on code in PR #12299: URL: https://github.com/apache/iceberg/pull/12299#discussion_r1975861782 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -640,12 +663,21 @@ public S3FileIOProperties(Map properties) { prop

Re: [I] [CI] use version 19 of clang-tools in cpp-linter-action [iceberg-cpp]

zhjwpku closed issue #41: [CI] use version 19 of clang-tools in cpp-linter-action URL: https://github.com/apache/iceberg-cpp/issues/41 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Flink: Dynamic Iceberg Sink Contribution [iceberg]

manuzhang commented on PR #12424: URL: https://github.com/apache/iceberg/pull/12424#issuecomment-2691881505 @mxm Thanks for the nice work. It will be much easier to review and revise only Flink 1.20 parts in this PR, and back-port to Flink 1.19 afterwards. -- This is an automated message

Re: [PR] WIP generic reader [iceberg]

github-actions[bot] commented on PR #12069: URL: https://github.com/apache/iceberg/pull/12069#issuecomment-2691757300 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Parquet: Implement Variant writers [iceberg]

rdblue commented on code in PR #12323: URL: https://github.com/apache/iceberg/pull/12323#discussion_r1976216730 ## core/src/main/java/org/apache/iceberg/variants/VariantVisitor.java: ## @@ -0,0 +1,83 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or mo

Re: [I] Flink Table Maintenance [iceberg]

akshat0395 commented on issue #10264: URL: https://github.com/apache/iceberg/issues/10264#issuecomment-2691837940 Thanks @pvary for sharing the details! Looking forward to this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] Parquet: Implement Variant writers [iceberg]

rdblue commented on code in PR #12323: URL: https://github.com/apache/iceberg/pull/12323#discussion_r1976219383 ## parquet/src/main/java/org/apache/iceberg/parquet/TypeToMessageType.java: ## @@ -56,6 +58,19 @@ public class TypeToMessageType { LogicalTypeAnnotation.timesta

Re: [PR] Parquet: Implement Variant writers [iceberg]

rdblue commented on code in PR #12323: URL: https://github.com/apache/iceberg/pull/12323#discussion_r1976217430 ## parquet/src/main/java/org/apache/iceberg/parquet/ParquetVariantWriters.java: ## @@ -0,0 +1,386 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] Parquet: Implement Variant writers [iceberg]

rdblue commented on code in PR #12323: URL: https://github.com/apache/iceberg/pull/12323#discussion_r1976217154 ## parquet/src/main/java/org/apache/iceberg/data/parquet/BaseParquetWriter.java: ## @@ -157,6 +171,16 @@ public ParquetValueWriter primitive(PrimitiveType primitive)

Re: [PR] Core: Add Variant logical type for Avro [iceberg]

aihuaxu commented on code in PR #12238: URL: https://github.com/apache/iceberg/pull/12238#discussion_r1974489717 ## core/src/main/java/org/apache/iceberg/avro/AvroCustomOrderSchemaVisitor.java: ## @@ -27,13 +27,20 @@ import org.apache.iceberg.relocated.com.google.common.collect

[I] Spark iceberg runtime - predicate pushdown in parquet reader [iceberg]

nateagr opened a new issue, #12428: URL: https://github.com/apache/iceberg/issues/12428 ### Query engine _No response_ ### Question Hello! After migrating some of our parquet tables (in Hive) to Iceberg (still parquet), I've noticed that reading the new Iceberg ta

Re: [PR] Core, Test: Parsing and Writing Tests for V3 Metadata [iceberg]

github-actions[bot] commented on PR #12025: URL: https://github.com/apache/iceberg/pull/12025#issuecomment-2691757244 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] OpenAPI: Use more clear language in recommending error responses [iceberg]

flyrain commented on code in PR #12376: URL: https://github.com/apache/iceberg/pull/12376#discussion_r1976113681 ## open-api/rest-catalog-open-api.yaml: ## @@ -4566,7 +4568,9 @@ components: AuthenticationTimeoutResponse: description: -Credentials have timed

Re: [I] [feat] push down schema casting to the record batch level [iceberg-python]

github-actions[bot] commented on issue #1049: URL: https://github.com/apache/iceberg-python/issues/1049#issuecomment-2691761229 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity

Re: [I] Try `arro3` as custom FileIO in tests [iceberg-python]

github-actions[bot] commented on issue #1063: URL: https://github.com/apache/iceberg-python/issues/1063#issuecomment-2691761205 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity

Re: [I] [bug] `table.inspect.partitions()` does not respect partition evolution [iceberg-python]

github-actions[bot] commented on issue #1120: URL: https://github.com/apache/iceberg-python/issues/1120#issuecomment-2691761186 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity

Re: [I] AWS: provide option to hide old fields in Glue table [iceberg]

github-actions[bot] commented on issue #7584: URL: https://github.com/apache/iceberg/issues/7584#issuecomment-2691756856 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Spark: Action to remove missing files [iceberg]

github-actions[bot] commented on PR #12106: URL: https://github.com/apache/iceberg/pull/12106#issuecomment-2691757359 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] AWS: Add support for enabling access to S3 Requester Pays bucket [iceberg]

github-actions[bot] closed pull request #11915: AWS: Add support for enabling access to S3 Requester Pays bucket URL: https://github.com/apache/iceberg/pull/11915 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] Core, Test: Parsing and Writing Tests for V3 Metadata [iceberg]

github-actions[bot] closed pull request #12025: Core, Test: Parsing and Writing Tests for V3 Metadata URL: https://github.com/apache/iceberg/pull/12025 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] FlinkSchemaUtil.toSchema should return Schema or ResolvedSchema instead of deprecated TableSchema [iceberg]

github-actions[bot] closed issue #10950: FlinkSchemaUtil.toSchema should return Schema or ResolvedSchema instead of deprecated TableSchema URL: https://github.com/apache/iceberg/issues/10950 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Core: Move `iceberg-parquet` files to `iceberg-core` [iceberg]

github-actions[bot] commented on PR #8500: URL: https://github.com/apache/iceberg/pull/8500#issuecomment-2691756916 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] How to set Spark conf to use Parquet and Iceberg tables using glue catalog without catalog name(spark_catalog)? [iceberg]

github-actions[bot] commented on issue #7748: URL: https://github.com/apache/iceberg/issues/7748#issuecomment-2691756876 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] feat: Add existing parquet files [iceberg-rust]

jonathanc-n commented on PR #960: URL: https://github.com/apache/iceberg-rust/pull/960#issuecomment-2691739611 > Thanks @jonathanc-n for this pr. I think we have an important thing missing: check schema compatability between parquet file and table schema? Is the best way to do this to

Re: [PR] spec: fix the wrong example in Geo Types [iceberg]

szehon-ho commented on PR #12421: URL: https://github.com/apache/iceberg/pull/12421#issuecomment-2691672923 Sorry missed it, yea let me give it a day to let others have chance to see , will merge tonight if no other comment. -- This is an automated message from the Apache Git Service. To

Re: [PR] Wrap variant in PrimitiveHoder so serialization can result same instance [iceberg]

flyrain commented on code in PR #12317: URL: https://github.com/apache/iceberg/pull/12317#discussion_r1976039730 ## api/src/main/java/org/apache/iceberg/types/PrimitiveHolder.java: ## @@ -21,7 +21,7 @@ import java.io.ObjectStreamException; import java.io.Serializable; -/** R

Re: [I] Move docker-specific tests to integrationTest configuration [iceberg]

anuragmantri commented on issue #12236: URL: https://github.com/apache/iceberg/issues/12236#issuecomment-2691617745 Sorry, it was my mistake, I think I marked my PR as `closes` this issue. When @nastra merged, it would have automatically closed this issue. -- This is an automated message

Re: [PR] Core: lazy init workerPool [iceberg]

pvary commented on code in PR #12427: URL: https://github.com/apache/iceberg/pull/12427#discussion_r1975822162 ## core/src/main/java/org/apache/iceberg/SnapshotProducer.java: ## @@ -197,7 +198,7 @@ protected String targetBranch() { } protected ExecutorService workerPool(

Re: [I] Move docker-specific tests to integrationTest configuration [iceberg]

kevinjqliu commented on issue #12236: URL: https://github.com/apache/iceberg/issues/12236#issuecomment-2691483016 hey @nastra I dont think we can close the issue just yet. we'd want to be able to run `./gradlew build` without any docker daemon -- This is an automated message from the Apac

Re: [PR] Include DELETE entries when inspecting [iceberg-python]

kevinjqliu commented on PR #1731: URL: https://github.com/apache/iceberg-python/pull/1731#issuecomment-2691394793 oops youre right. definitely not needed in `_files`. For `partitions`, looks like we dont need the deleted files either. nit: perhaps we can make it explicit by setting `disc

Re: [PR] REST auth error [iceberg]

aihuaxu commented on code in PR #12415: URL: https://github.com/apache/iceberg/pull/12415#discussion_r1975923639 ## core/src/main/java/org/apache/iceberg/rest/RESTSessionCatalog.java: ## @@ -258,7 +258,9 @@ public void initialize(String name, Map unresolved) { config =

Re: [PR] Core: lazy init workerPool [iceberg]

abstractdog commented on PR #12427: URL: https://github.com/apache/iceberg/pull/12427#issuecomment-2691235997 > So let me recap: > > * Hive have a task which needs to access some Iceberg tables during the shutdown > * During the shutdown the general threadpools are terminated >

Re: [PR] Core: lazy init workerPool [iceberg]

abstractdog commented on code in PR #12427: URL: https://github.com/apache/iceberg/pull/12427#discussion_r1975827553 ## core/src/main/java/org/apache/iceberg/SnapshotProducer.java: ## @@ -197,7 +198,7 @@ protected String targetBranch() { } protected ExecutorService worke

Re: [PR] Wrap variant in PrimitiveHoder so serialization can result same instance [iceberg]

aihuaxu commented on code in PR #12317: URL: https://github.com/apache/iceberg/pull/12317#discussion_r1975827872 ## api/src/main/java/org/apache/iceberg/types/PrimitiveHolder.java: ## @@ -21,7 +21,7 @@ import java.io.ObjectStreamException; import java.io.Serializable; -/** R

Re: [PR] Core: lazy init workerPool [iceberg]

abstractdog commented on code in PR #12427: URL: https://github.com/apache/iceberg/pull/12427#discussion_r1975825857 ## core/src/main/java/org/apache/iceberg/SnapshotProducer.java: ## @@ -197,7 +198,7 @@ protected String targetBranch() { } protected ExecutorService worke

Re: [PR] Core: lazy init workerPool [iceberg]

pvary commented on PR #12427: URL: https://github.com/apache/iceberg/pull/12427#issuecomment-2691232543 So let me recap: - Hive have a task which needs to access some Iceberg tables during the shutdown - During the shutdown the general threadpools are terminated - Hive could provide

Re: [I] Does iceberg support "Predicate Pushdown" when spark read data from it? [iceberg]

nateagr commented on issue #11617: URL: https://github.com/apache/iceberg/issues/11617#issuecomment-2691230858 Hello! I'm also interesting in more details about the predicate pushdown in Iceberg. I've opened an issue about it [here](https://github.com/apache/iceberg/issues/12428). I

Re: [PR] chore: Point user questions to github discussion [iceberg-rust]

Xuanwo merged PR #1016: URL: https://github.com/apache/iceberg-rust/pull/1016 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] Core: lazy init workerPool [iceberg]

pvary commented on PR #12427: URL: https://github.com/apache/iceberg/pull/12427#issuecomment-2691216964 I have seen a similar issue here: #12427 12220 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[I] Support scanning a specific branch of a table [iceberg-python]

malcolmbovey opened a new issue, #1746: URL: https://github.com/apache/iceberg-python/issues/1746 ### Feature Request / Improvement As far as I can tell, PyIceberg does not directly support being able to scan a particular branch of an iceberg table. For example, there is no way to b

Re: [PR] Core: lazy init workerPool [iceberg]

abstractdog commented on PR #12427: URL: https://github.com/apache/iceberg/pull/12427#issuecomment-2691177743 > Hi Laci, Long time, no see... What is the actual issue where you have find this problematic? Hey, long time no see Peter! the actual use-case was [HIVE-28759](https://is

Re: [PR] Core: lazy init workerPool [iceberg]

pvary commented on PR #12427: URL: https://github.com/apache/iceberg/pull/12427#issuecomment-2691159055 Hi Laci, Long time, no see... What is the actual issue where you have find this problematic? -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] feat: Add existing parquet files [iceberg-rust]

jonathanc-n commented on code in PR #960: URL: https://github.com/apache/iceberg-rust/pull/960#discussion_r1975700516 ## crates/iceberg/src/scan.rs: ## @@ -1413,6 +1462,214 @@ pub mod tests { writer.close().unwrap(); } } + +pub asyn

[PR] Fix typo in delete statement: change database name from "dbl" to "db" in spark-writes.md [iceberg]

wenxin-cn opened a new pull request, #12426: URL: https://github.com/apache/iceberg/pull/12426 Fix typo in delete statement: change database name from `dbl` to `db` in spark-writes.md -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] spec: fix the wrong example in Geo Types [iceberg]

jiayuasu commented on PR #12421: URL: https://github.com/apache/iceberg/pull/12421#issuecomment-2691042254 @szehon-ho Can you merge the PR if you are fine with that? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] spec: fix the wrong example in Geo Types [iceberg]

jiayuasu commented on PR #12421: URL: https://github.com/apache/iceberg/pull/12421#issuecomment-2691035420 @szehon-ho yes, the projjson representation of OGC:CRS84 is listed above. To put it in the Iceberg format, it is ``` projjson:{ "$schema": "https://proj.org/schemas/v0.

Re: [PR] Core: Bulk deletion in RemoveSnapshots [iceberg]

pvary commented on PR #11837: URL: https://github.com/apache/iceberg/pull/11837#issuecomment-2690965941 Why did you decide against an util method? The code is really very similar to the orphan file removal stuff -- This is an automated message from the Apache Git Service. To respond to th

Re: [PR] AWS, AZURE: Move docker-based tests to integration test source [iceberg]

anuragmantri commented on PR #12274: URL: https://github.com/apache/iceberg/pull/12274#issuecomment-2690899362 Thanks @nastra - I moved S3 tests back to where they were. This PR contains only Azure tests moved to integration source set now. -- This is an automated message from the Apache

Re: [I] java.lang.NoClassDefFoundError: scala/jdk/CollectionConverters$ [iceberg]

nastra closed issue #10175: java.lang.NoClassDefFoundError: scala/jdk/CollectionConverters$ URL: https://github.com/apache/iceberg/issues/10175 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] Add SparkSessionCatalog support for views [iceberg]

nastra commented on issue #9845: URL: https://github.com/apache/iceberg/issues/9845#issuecomment-2690882693 This has been done via https://github.com/apache/iceberg/pull/11388 and https://github.com/apache/iceberg/pull/11797 -- This is an automated message from the Apache Git Service. To

Re: [PR] Core: Change RemoveSnapshots to remove unused schemas [iceberg]

gaborkaszab commented on PR #12089: URL: https://github.com/apache/iceberg/pull/12089#issuecomment-2690905726 I resolved some merge conflicts with TestTables changes. @nastra @Fokko would you mind taking a look? -- This is an automated message from the Apache Git Service. To respond to th

Re: [I] Improve Position Deletes in V3 [iceberg]

nastra closed issue #11122: Improve Position Deletes in V3 URL: https://github.com/apache/iceberg/issues/11122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [I] Adding RESTCatalog based Spark Integ Test [iceberg]

nastra closed issue #11079: Adding RESTCatalog based Spark Integ Test URL: https://github.com/apache/iceberg/issues/11079 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [I] Improve Position Deletes in V3 [iceberg]

nastra commented on issue #11122: URL: https://github.com/apache/iceberg/issues/11122#issuecomment-2690901986 Closing this as it has been added to the Spec and to the java impl + to Spark -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] Adding RESTCatalog based Spark Integ Test [iceberg]

nastra commented on issue #11079: URL: https://github.com/apache/iceberg/issues/11079#issuecomment-2690897332 this has been done via #11093 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] java.lang.NoClassDefFoundError: scala/jdk/CollectionConverters$ [iceberg]

nastra commented on issue #10175: URL: https://github.com/apache/iceberg/issues/10175#issuecomment-2690893520 If you're using Spark with Scala 2.12 make sure to use the iceberg-spark-runtime jar that is built for Scala 2.12. The latest one can be found [here](https://search.maven.org/remot

Re: [I] Geospatial Support [iceberg]

nastra closed issue #10260: Geospatial Support URL: https://github.com/apache/iceberg/issues/10260 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issue

Re: [I] Geospatial Support [iceberg]

nastra commented on issue #10260: URL: https://github.com/apache/iceberg/issues/10260#issuecomment-2690889394 Closing this as this has been added to the spec via https://github.com/apache/iceberg/pull/10981 -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [I] Add SparkSessionCatalog support for views [iceberg]

nastra closed issue #9845: Add SparkSessionCatalog support for views URL: https://github.com/apache/iceberg/issues/9845 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] REST auth error [iceberg]

nastra commented on PR #12415: URL: https://github.com/apache/iceberg/pull/12415#issuecomment-2690866631 Closing this as it's not needed and the issue happened in a proprietary version of the code -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] REST auth error [iceberg]

nastra closed pull request #12415: REST auth error URL: https://github.com/apache/iceberg/pull/12415 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: iss

Re: [PR] Core: Bulk deletion in RemoveSnapshots [iceberg]

gaborkaszab commented on PR #11837: URL: https://github.com/apache/iceberg/pull/11837#issuecomment-2690864221 Hi @amogh-jahagirdar , @pvary , I managed to simplify the original PR and uploaded a new version. I took a deeper look at how [orphan file deletion does the same thing](https

Re: [I] S3FileIO does not raise exception when failing to drop/purge data [iceberg]

nastra commented on issue #12420: URL: https://github.com/apache/iceberg/issues/12420#issuecomment-2690863243 @mderoy I've updated the description, since the issue is caused by the AWS SDK making changes to the default integrity protection (see https://github.com/aws/aws-sdk-java-v2/discuss

Re: [PR] Data: Add partition stats writer and reader [iceberg]

ajantha-bhat commented on PR #11216: URL: https://github.com/apache/iceberg/pull/11216#issuecomment-2690823724 Thanks everyone for the review and merging it. This was a long awaited and super impactful feature. Hive, Trino, Dremio is waiting for it to be shipped. -- This is a

Re: [I] PartitionStatsUtil#computeStats returns incomplete stats in case of partition evolution [iceberg]

ajantha-bhat closed issue #12168: PartitionStatsUtil#computeStats returns incomplete stats in case of partition evolution URL: https://github.com/apache/iceberg/issues/12168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] PartitionStatsUtil#computeStats returns incomplete stats in case of partition evolution [iceberg]

ajantha-bhat commented on issue #12168: URL: https://github.com/apache/iceberg/issues/12168#issuecomment-2690828098 completed via https://github.com/apache/iceberg/pull/12137 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Spark: Rewrite V2 deletes to V3 DVs [iceberg]

nastra commented on code in PR #12250: URL: https://github.com/apache/iceberg/pull/12250#discussion_r1975518509 ## spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/source/SparkPositionDeletesRewrite.java: ## @@ -200,7 +207,8 @@ static class PositionDeletesWriterFactory im

Re: [PR] AWS: Integrate S3 analytics accelerator library [iceberg]

SanjayMarreddi commented on code in PR #12299: URL: https://github.com/apache/iceberg/pull/12299#discussion_r1975440490 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3URI.java: ## @@ -31,7 +31,7 @@ * * Note: Path-style access is deprecated and not supported by this implem

Re: [PR] feat: Add Issue Template [iceberg-rust]

jonathanc-n commented on code in PR #1008: URL: https://github.com/apache/iceberg-rust/pull/1008#discussion_r1975428110 ## .github/ISSUE_TEMPLATE/iceberg_question.yml: ## @@ -0,0 +1,32 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor lic

Re: [I] Iceberg-rust Write support [iceberg-rust]

takaebato commented on issue #700: URL: https://github.com/apache/iceberg-rust/issues/700#issuecomment-2690653904 Hi! I’m really interested in getting involved. If there’s an available issue, could you assign it to me? -- This is an automated message from the Apache Git Service. To respon

Re: [PR] Data: Add partition stats writer and reader [iceberg]

pvary commented on PR #11216: URL: https://github.com/apache/iceberg/pull/11216#issuecomment-2690641023 Thanks for all your work @ajantha-bhat! Also thanks for all of the reviewers! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] Data: Add partition stats writer and reader [iceberg]

pvary merged PR #11216: URL: https://github.com/apache/iceberg/pull/11216 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

[I] SASL negotiation fails when invoking multiple methods on `pyiceberg.catalog.hive.HiveCatalog` [iceberg-python]

mnzpk opened a new issue, #1744: URL: https://github.com/apache/iceberg-python/issues/1744 ### Apache Iceberg version None ### Please describe the bug 🐞 ## Bug Description Invoking multiple methods (or the same method multiple times) on an object of `pyiceberg.catalog

[PR] Manual deduction of partitions [iceberg-python]

afiodorov opened a new pull request, #1743: URL: https://github.com/apache/iceberg-python/pull/1743 I want to a) be able to add files that a partitioned by the filename convention, e.g. s3://bucket/table/year=2025/month=12 b) add files even if they have extra columns without having to mig

Re: [PR] Fix metadata class loader [iceberg]

pvary commented on PR #898: URL: https://github.com/apache/iceberg/pull/898#issuecomment-2690476055 @rdblue: Is this issue not happening with the new `InternalData.ReadBuilder`? I don't see the `classLoader` method called on the internal readers. -- This is an automated message from the

Re: [PR] Data: Add partition stats writer and reader [iceberg]

ajantha-bhat commented on PR #11216: URL: https://github.com/apache/iceberg/pull/11216#issuecomment-2690498532 Just rebased the PR as there was a conflict from https://github.com/apache/iceberg/pull/12419 in `TestTables` -- This is an automated message from the Apache Git Service. To resp

Re: [PR] Core: Code cleanup around TestTable and TestTableOperations [iceberg]

nastra merged PR #12419: URL: https://github.com/apache/iceberg/pull/12419 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

[PR] Docs: Fix link of ndv in spark-procedures.md [iceberg]

wangyinsheng opened a new pull request, #12425: URL: https://github.com/apache/iceberg/pull/12425 Docs: Fix link of ndv in spark-procedures.md -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] chore: Point user questions to github discussion [iceberg-rust]

liurenjie1024 opened a new pull request, #1016: URL: https://github.com/apache/iceberg-rust/pull/1016 ## What changes are included in this PR? This pr removes issue template for discussion, but add a contact link so that user could ask questions in github discussio

Re: [I] Add issue template. [iceberg-rust]

liurenjie1024 closed issue #1007: Add issue template. URL: https://github.com/apache/iceberg-rust/issues/1007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [I] Add issue template. [iceberg-rust]

liurenjie1024 closed issue #1007: Add issue template. URL: https://github.com/apache/iceberg-rust/issues/1007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [PR] feat: Add Issue Template [iceberg-rust]

liurenjie1024 merged PR #1008: URL: https://github.com/apache/iceberg-rust/pull/1008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [I] Too verbose logs in Spark from Iceberg [iceberg]

manuzhang commented on issue #12423: URL: https://github.com/apache/iceberg/issues/12423#issuecomment-2690083423 I see a lot of `25/02/27 19:32:23 INFO SerializableTableWithSize$SerializableMetadataTableWithSize: Releasing resources` in executor logs. -- This is an automated message from

Re: [I] IndexOutOfBounds in FileFormat#fromFileName [iceberg]

nastra closed issue #12300: IndexOutOfBounds in FileFormat#fromFileName URL: https://github.com/apache/iceberg/issues/12300 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[PR] Flink: Dynamic Iceberg Sink Contribution [iceberg]

mxm opened a new pull request, #12424: URL: https://github.com/apache/iceberg/pull/12424 The Flink Iceberg sink allows writing data from a continuous Flink stream to an Iceberg table. It already powers countless production jobs and has passed the test of time. But for many users, the static

Re: [PR] Core: Print un-pretty metadata files without whitespace [iceberg]

nastra merged PR #12318: URL: https://github.com/apache/iceberg/pull/12318 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Fix IndexOutOfBounds exception in FileFormat#fromFileName [iceberg]

nastra merged PR #12301: URL: https://github.com/apache/iceberg/pull/12301 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] AWS, AZURE: Move docker-based tests to integration test source [iceberg]

nastra commented on PR #12274: URL: https://github.com/apache/iceberg/pull/12274#issuecomment-2690310516 @anuragmantri as you already mentioned earlier, I think we should revert the AWS stuff in this PR. The problem is that `./gradlew :iceberg-aws:integrationTest` is never being executed as

Re: [I] Print un-pretty metadata JSON files without whitespace [iceberg]

nastra closed issue #12281: Print un-pretty metadata JSON files without whitespace URL: https://github.com/apache/iceberg/issues/12281 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [I] Appending data to a partitioned table by pyiceberg [iceberg]

nastra closed issue #12399: Appending data to a partitioned table by pyiceberg URL: https://github.com/apache/iceberg/issues/12399 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] Ignore apt-get update error when building `iceberg-rest-fixture` image [iceberg]

Fokko commented on PR #12416: URL: https://github.com/apache/iceberg/pull/12416#issuecomment-2689980568 @manuzhang WDYT of removing the update? I think these should come from the base image. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] Docs: Add versioned Javadocs for 1.8.1 [iceberg]

Fokko merged PR #12412: URL: https://github.com/apache/iceberg/pull/12412 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] Spark: Bump Spark 3.5 to 3.5.5 [iceberg]

nastra merged PR #12396: URL: https://github.com/apache/iceberg/pull/12396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] spec: fix the wrong example in Geo Types [iceberg]

szehon-ho commented on PR #12421: URL: https://github.com/apache/iceberg/pull/12421#issuecomment-2690148357 > Whenever the spec says OGC:CRS84, it always refers to the following projjson object. It is pretty much the srid:4326 but with axis order in lon/lat. Curious question , is there an

Re: [PR] Update release version to 1.8.1 in doap.rdf [iceberg]

Fokko merged PR #12408: URL: https://github.com/apache/iceberg/pull/12408 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] Build: Bump pyspark from 3.5.3 to 3.5.5 [iceberg-python]

Fokko merged PR #1740: URL: https://github.com/apache/iceberg-python/pull/1740 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceber

Re: [PR] fix: upgrade spark version [iceberg-rust]

Fokko commented on PR #1015: URL: https://github.com/apache/iceberg-rust/pull/1015#issuecomment-2690046693 Thanks @ZENOTME 🙌 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] fix: upgrade spark version [iceberg-rust]

Fokko merged PR #1015: URL: https://github.com/apache/iceberg-rust/pull/1015 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

  1   2   >