Re: [PR] Core: Clean expired metadata even if there is no snapshot to expire [iceberg]

lirui-apache commented on PR #13322: URL: https://github.com/apache/iceberg/pull/13322#issuecomment-2979084010 Update to add test. Thanks @pvary @amogh-jahagirdar for reviewing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] Build: Bump pypa/cibuildwheel from 2.23.3 to 3.0.0 [iceberg-python]

kevinjqliu merged PR #2099: URL: https://github.com/apache/iceberg-python/pull/2099 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [PR] AWS: KeyManagementClient implementation that works with AWS KMS [iceberg]

amogh-jahagirdar commented on code in PR #13136: URL: https://github.com/apache/iceberg/pull/13136#discussion_r2151357425 ## aws/src/integration/java/org/apache/iceberg/aws/TestKeyManagementClient.java: ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (ASF

Re: [PR] Core: Fix numeric overflow of timestamp nano literal [iceberg]

ebyhr commented on code in PR #11775: URL: https://github.com/apache/iceberg/pull/11775#discussion_r2151333446 ## api/src/test/java/org/apache/iceberg/expressions/TestTimestampLiteralConversions.java: ## @@ -107,6 +108,33 @@ public void testTimestampMicrosToDateConversion() {

Re: [PR] Spark 4.0: Row Lineage support [iceberg]

amogh-jahagirdar commented on code in PR #13310: URL: https://github.com/apache/iceberg/pull/13310#discussion_r2151310569 ## spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/source/SparkPositionDeltaWrite.java: ## @@ -767,15 +822,23 @@ public void update(InternalRow meta,

Re: [PR] Spark 4.0: Row Lineage support [iceberg]

amogh-jahagirdar commented on code in PR #13310: URL: https://github.com/apache/iceberg/pull/13310#discussion_r2151310129 ## spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/source/SparkWrite.java: ## @@ -699,29 +706,83 @@ public DataWriter createWriter(int partitionId,

[I] Required fields within optional fields cause incorrect results in Trino [iceberg]

dejangvozdenac opened a new issue, #13328: URL: https://github.com/apache/iceberg/issues/13328 ### Apache Iceberg version 1.9.1 (latest release) ### Query engine Trino ### Please describe the bug 🐞 In Spark, we create a nested struct `address.street`. The ou

Re: [PR] Build: Bump pydantic from 2.11.5 to 2.11.7 [iceberg-python]

kevinjqliu merged PR #2107: URL: https://github.com/apache/iceberg-python/pull/2107 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [PR] Build: Bump coverage from 7.8.2 to 7.9.1 [iceberg-python]

kevinjqliu merged PR #2106: URL: https://github.com/apache/iceberg-python/pull/2106 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [PR] Build: Bump cachetools from 5.5.2 to 6.1.0 [iceberg-python]

kevinjqliu merged PR #2101: URL: https://github.com/apache/iceberg-python/pull/2101 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [PR] Build: Bump boto3 from 1.37.3 to 1.38.27 [iceberg-python]

kevinjqliu merged PR #2108: URL: https://github.com/apache/iceberg-python/pull/2108 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [PR] Build: Bump duckdb from 1.3.0 to 1.3.1 [iceberg-python]

kevinjqliu merged PR #2105: URL: https://github.com/apache/iceberg-python/pull/2105 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [PR] Build: Bump typing-extensions from 4.13.2 to 4.14.0 [iceberg-python]

kevinjqliu merged PR #2104: URL: https://github.com/apache/iceberg-python/pull/2104 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [PR] Build: Bump huggingface-hub from 0.32.5 to 0.33.0 [iceberg-python]

kevinjqliu merged PR #2103: URL: https://github.com/apache/iceberg-python/pull/2103 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [PR] Build: Bump moto from 5.1.5 to 5.1.6 [iceberg-python]

kevinjqliu merged PR #2100: URL: https://github.com/apache/iceberg-python/pull/2100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

[PR] Spark: option to set predicate for filtering files in compaction [iceberg]

bryanck opened a new pull request, #13327: URL: https://github.com/apache/iceberg/pull/13327 This PR adds an option to `RewriteDataFiles` to set a predicate for filtering out data files by attributes. You can already specify an expression to filter out data files, but there is currently no

Re: [PR] Added BigQuery Metastore Catalog [iceberg-python]

djouallah commented on PR #2068: URL: https://github.com/apache/iceberg-python/pull/2068#issuecomment-2978786103 @rambleraptor user here, I tried to use bigquery metastore recently when it was announced it has added rest API interface, I am just wondering, why you need to add support for p

Re: [PR] Spark: Iceberg_Spark Add delegation token for HiveCatalog [iceberg]

zhangwl9 commented on PR #13187: URL: https://github.com/apache/iceberg/pull/13187#issuecomment-2978745808 @pan3793 Yes, I need to additionally register the parameter "hive.metastore.token.signature=metaStoreUri" along with it to HMS when iceberg creates the hiveCatalog -- This is an aut

Re: [PR] Spark: Iceberg_Spark Add delegation token for HiveCatalog [iceberg]

zhangwl9 commented on PR #13187: URL: https://github.com/apache/iceberg/pull/13187#issuecomment-2978746087 @pan3793 Yes, I need to additionally register the parameter hive.metastore.token.signature=metaStoreUri along with it to HMS when iceberg creates the hiveCatalog. -- This is an auto

Re: [I] Spark: Doing a Coalesce and foreachpartitions in spark directly on an iceberg table is leaking memory heavy iterators [iceberg]

jkolash commented on issue #13297: URL: https://github.com/apache/iceberg/issues/13297#issuecomment-2978743069 On the ParquetPartitionReaderFactory side quest. looking deeper at https://github.toasttab.com/toasttab/spork/commit/23ebd389b5cb528a7ba04113a12929bebfaf1e9a#diff-392c885fe00

Re: [I] Spark: Doing a Coalesce and foreachpartitions in spark directly on an iceberg table is leaking memory heavy iterators [iceberg]

jkolash commented on issue #13297: URL: https://github.com/apache/iceberg/issues/13297#issuecomment-2978695785 On the v2 parquet reader side quest. This total set of spark changes allows the v2 parquet reader to work https://github.com/user-attachments/assets/f4307624-8168-4c2f-b91a-f

Re: [PR] Build: Bump pyspark from 3.5.6 to 4.0.0 [iceberg-python]

kevinjqliu commented on PR #2102: URL: https://github.com/apache/iceberg-python/pull/2102#issuecomment-2978646487 We are blocked from using spark 4.0 until the next iceberg version (1.10) https://github.com/apache/iceberg/issues/13162#issuecomment-2912307091 due to `iceberg-spark-r

Re: [PR] spec: add clarification about the Geometry type calculation [iceberg]

paleolimbot commented on PR #13227: URL: https://github.com/apache/iceberg/pull/13227#issuecomment-2978018350 Thank you for the ping! Just a note that I don't think this clarification is needed...a Cartesian bounding box like the one described here is perfectly legal in for the geomet

[PR] Build: Bump boto3 from 1.37.3 to 1.38.27 [iceberg-python]

dependabot[bot] opened a new pull request, #2108: URL: https://github.com/apache/iceberg-python/pull/2108 Bumps [boto3](https://github.com/boto/boto3) from 1.37.3 to 1.38.27. Commits https://github.com/boto/boto3/commit/ccacc66e8fc488fb75b0326c5ea8a60715f1b090";>ccacc66 Merge b

Re: [PR] feat(transaction): Implement TransactionAction for ReplaceSortOrderAction [iceberg-rust]

liurenjie1024 merged PR #1441: URL: https://github.com/apache/iceberg-rust/pull/1441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [PR] feat(transaction): Implement TransactionAction for FastAppendAction [iceberg-rust]

CTTY commented on code in PR #1448: URL: https://github.com/apache/iceberg-rust/pull/1448#discussion_r2151121670 ## crates/iceberg/src/transaction/append.rs: ## @@ -87,76 +169,45 @@ impl FastAppendAction { /// Specifically, schema compatibility checks and support for adding

[PR] Build: Bump pydantic from 2.11.5 to 2.11.7 [iceberg-python]

dependabot[bot] opened a new pull request, #2107: URL: https://github.com/apache/iceberg-python/pull/2107 Bumps [pydantic](https://github.com/pydantic/pydantic) from 2.11.5 to 2.11.7. Release notes Sourced from https://github.com/pydantic/pydantic/releases";>pydantic's releases.

[PR] Build: Bump coverage from 7.8.2 to 7.9.1 [iceberg-python]

dependabot[bot] opened a new pull request, #2106: URL: https://github.com/apache/iceberg-python/pull/2106 Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.8.2 to 7.9.1. Changelog Sourced from https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst";>coverage's cha

[PR] Build: Bump duckdb from 1.3.0 to 1.3.1 [iceberg-python]

dependabot[bot] opened a new pull request, #2105: URL: https://github.com/apache/iceberg-python/pull/2105 Bumps [duckdb](https://github.com/duckdb/duckdb) from 1.3.0 to 1.3.1. Release notes Sourced from https://github.com/duckdb/duckdb/releases";>duckdb's releases. v1.3.1 Bug

[PR] Build: Bump typing-extensions from 4.13.2 to 4.14.0 [iceberg-python]

dependabot[bot] opened a new pull request, #2104: URL: https://github.com/apache/iceberg-python/pull/2104 Bumps [typing-extensions](https://github.com/python/typing_extensions) from 4.13.2 to 4.14.0. Release notes Sourced from https://github.com/python/typing_extensions/releases";>

Re: [PR] feat(transaction): Implement TransactionAction for FastAppendAction [iceberg-rust]

jonathanc-n commented on code in PR #1448: URL: https://github.com/apache/iceberg-rust/pull/1448#discussion_r2151101515 ## crates/iceberg/src/transaction/append.rs: ## @@ -87,76 +169,45 @@ impl FastAppendAction { /// Specifically, schema compatibility checks and support for

[PR] Build: Bump huggingface-hub from 0.32.5 to 0.33.0 [iceberg-python]

dependabot[bot] opened a new pull request, #2103: URL: https://github.com/apache/iceberg-python/pull/2103 Bumps [huggingface-hub](https://github.com/huggingface/huggingface_hub) from 0.32.5 to 0.33.0. Release notes Sourced from https://github.com/huggingface/huggingface_hub/release

Re: [PR] [CORE][REST]: Add context aware response parsing [iceberg]

singhpk234 commented on code in PR #13191: URL: https://github.com/apache/iceberg/pull/13191#discussion_r2151100252 ## core/src/main/java/org/apache/iceberg/rest/HTTPClient.java: ## @@ -94,6 +96,7 @@ public class HTTPClient extends BaseHTTPClient { private final ObjectMapper

Re: [PR] feat(transaction): Implement TransactionAction for FastAppendAction [iceberg-rust]

CTTY commented on code in PR #1448: URL: https://github.com/apache/iceberg-rust/pull/1448#discussion_r2151080053 ## crates/iceberg/src/transaction/append.rs: ## @@ -87,76 +169,45 @@ impl FastAppendAction { /// Specifically, schema compatibility checks and support for adding

[PR] Build: Bump pyspark from 3.5.6 to 4.0.0 [iceberg-python]

dependabot[bot] opened a new pull request, #2102: URL: https://github.com/apache/iceberg-python/pull/2102 Bumps [pyspark](https://github.com/apache/spark) from 3.5.6 to 4.0.0. Commits https://github.com/apache/spark/commit/fa33ea000a0bda9e5a3fa1af98e8e85b8cc5e4d4";>fa33ea0 Prep

Re: [PR] Core,REST: extend httpClient builder to support tls factory [iceberg]

github-actions[bot] commented on PR #11979: URL: https://github.com/apache/iceberg/pull/11979#issuecomment-2978535724 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [PR] AWS: add view support for Glue Catalog [iceberg]

github-actions[bot] commented on PR #12544: URL: https://github.com/apache/iceberg/pull/12544#issuecomment-2978535769 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Core,REST: extend httpClient builder to support tls factory [iceberg]

github-actions[bot] closed pull request #11979: Core,REST: extend httpClient builder to support tls factory URL: https://github.com/apache/iceberg/pull/11979 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [I] Structured streaming writes to partitioned table fails when spark.sql.extensions is set to IcebergSparkSessionExtensions [iceberg]

github-actions[bot] commented on issue #7226: URL: https://github.com/apache/iceberg/issues/7226#issuecomment-2978535471 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

[PR] Build: Bump cachetools from 5.5.2 to 6.1.0 [iceberg-python]

dependabot[bot] opened a new pull request, #2101: URL: https://github.com/apache/iceberg-python/pull/2101 Bumps [cachetools](https://github.com/tkem/cachetools) from 5.5.2 to 6.1.0. Changelog Sourced from https://github.com/tkem/cachetools/blob/master/CHANGELOG.rst";>cachetools's c

[PR] Build: Bump moto from 5.1.5 to 5.1.6 [iceberg-python]

dependabot[bot] opened a new pull request, #2100: URL: https://github.com/apache/iceberg-python/pull/2100 Bumps [moto](https://github.com/getmoto/moto) from 5.1.5 to 5.1.6. Changelog Sourced from https://github.com/getmoto/moto/blob/master/CHANGELOG.md";>moto's changelog. 5.

Re: [PR] [CORE][REST]: Add context aware response parsing [iceberg]

amogh-jahagirdar commented on code in PR #13191: URL: https://github.com/apache/iceberg/pull/13191#discussion_r2151085076 ## core/src/main/java/org/apache/iceberg/rest/ParserContext.java: ## @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + *

Re: [PR] GCP: Add Google Authentication Support [iceberg]

danielcweeks commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r2150897656 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthSession.java: ## @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

[PR] Build: Bump pypa/cibuildwheel from 2.23.3 to 3.0.0 [iceberg-python]

dependabot[bot] opened a new pull request, #2099: URL: https://github.com/apache/iceberg-python/pull/2099 Bumps [pypa/cibuildwheel](https://github.com/pypa/cibuildwheel) from 2.23.3 to 3.0.0. Release notes Sourced from https://github.com/pypa/cibuildwheel/releases";>pypa/cibuildwhe

Re: [PR] GCP: Add Google Authentication Support [iceberg]

talatuyarer commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r2151060705 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthSession.java: ## @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

Re: [PR] GCP: Add Google Authentication Support [iceberg]

talatuyarer commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r2151057944 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthSession.java: ## @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

Re: [PR] GCP: Add Google Authentication Support [iceberg]

talatuyarer commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r2151056667 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthManager.java: ## @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

[PR] feat(transaction): Implement TransactionAction for FastAppendAction [iceberg-rust]

CTTY opened a new pull request, #1448: URL: https://github.com/apache/iceberg-rust/pull/1448 ## Which issue does this PR close? Related Issues: - #1382 [EPIC] ## What changes are included in this PR? - Implement `TransactionAction` for `FastAppendAction

Re: [PR] GCP: Add Google Authentication Support [iceberg]

adutra commented on PR #13212: URL: https://github.com/apache/iceberg/pull/13212#issuecomment-2977674200 @sungwy FYI: https://lists.apache.org/thread/37w7v7gxfd0klb2lp6082wqto5krh9r8 -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] feat: adding schema update methods [iceberg-go]

zeroshade commented on code in PR #431: URL: https://github.com/apache/iceberg-go/pull/431#discussion_r2150988103 ## table/update_schema.go: ## @@ -0,0 +1,659 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See the N

Re: [PR] feat: adding schema update methods [iceberg-go]

nandorKollar commented on code in PR #431: URL: https://github.com/apache/iceberg-go/pull/431#discussion_r2150975882 ## table/update_schema.go: ## @@ -0,0 +1,659 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See th

Re: [I] Error creating table from pyarrow schema with pa.uuid() [iceberg-python]

Fokko commented on issue #1986: URL: https://github.com/apache/iceberg-python/issues/1986#issuecomment-2978273095 @simw Indeed, I think the PR is ready now 👍 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] fix: correct `UUIDType` partition representation for `BucketTransform` [iceberg-python]

Fokko commented on PR #2003: URL: https://github.com/apache/iceberg-python/pull/2003#issuecomment-2978276988 BTW, I found the issue on the Java side: https://github.com/apache/iceberg/pull/13324 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] Flink: Backports #13260 to Flink 1.19 and 1.20 [iceberg]

stevenzwu merged PR #13326: URL: https://github.com/apache/iceberg/pull/13326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] docs: Fix typo in `rewrite_manifests` output table in spark-procedures.md [iceberg]

Fokko merged PR #13325: URL: https://github.com/apache/iceberg/pull/13325 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [PR] feat: adding schema update methods [iceberg-go]

zeroshade commented on code in PR #431: URL: https://github.com/apache/iceberg-go/pull/431#discussion_r2150940685 ## table/update_schema.go: ## @@ -0,0 +1,659 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See the N

Re: [PR] fix(cli/rest) Support Glue REST operations with Iceberg-Go CLI [iceberg-go]

zeroshade commented on PR #459: URL: https://github.com/apache/iceberg-go/pull/459#issuecomment-2978254385 I agree with @laskoviymishka that we shouldn't be passing custom JSON stuff and should instead use flags or just follow whatever pattern pyiceberg is using. -- This is an automated m

Re: [PR] Flink: Add support for Flink 2.0 [iceberg]

stevenzwu commented on PR #12527: URL: https://github.com/apache/iceberg/pull/12527#issuecomment-2978214160 @le5hy it will be released in 1.10.0 which is targeted for end of June if not postponed. -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] GCP: Add Google Authentication Support [iceberg]

danielcweeks commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r2150921433 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthSession.java: ## @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

Re: [PR] GCP: Add Google Authentication Support [iceberg]

danielcweeks commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r2150894062 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthSession.java: ## @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

Re: [PR] GCP: Add Google Authentication Support [iceberg]

danielcweeks commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r2150891810 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthSession.java: ## @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one +

Re: [PR] GCP: Add Google Authentication Support [iceberg]

danielcweeks commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r2150889991 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthManager.java: ## @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] GCP: Add Google Authentication Support [iceberg]

danielcweeks commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r2150889546 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthManager.java: ## @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] GCP: Add Google Authentication Support [iceberg]

danielcweeks commented on code in PR #13212: URL: https://github.com/apache/iceberg/pull/13212#discussion_r215072 ## gcp/src/main/java/org/apache/iceberg/gcp/auth/GoogleAuthManager.java: ## @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [I] Add `miri` to detect undefined behavior. [iceberg-rust]

GeetKrishna commented on issue #446: URL: https://github.com/apache/iceberg-rust/issues/446#issuecomment-2978145478 Hello, I'm new and would like to contribute to this project. If this task is still available, I'd be interested in working on it as it would help me familiarize myself with th

Re: [PR] Flink: Backports #13260 to Flink 1.19 and 1.20 [iceberg]

rodmeneses commented on PR #13326: URL: https://github.com/apache/iceberg/pull/13326#issuecomment-2978133902 cc: @stevenzwu @mxm Thanks !!! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] Flink: Backports #13260 to Flink 1.19 and 1.20 [iceberg]

rodmeneses opened a new pull request, #13326: URL: https://github.com/apache/iceberg/pull/13326 This PR backports https://github.com/apache/iceberg/pull/13260 to Flink 1.19 and 1.20 The backport patch came out cleanly. -- This is an automated message from the Apache Git Ser

Re: [PR] Flink: If IcebergSink writeParallelism is not specified, defaults to the input source parallelism [iceberg]

rodmeneses commented on PR #13260: URL: https://github.com/apache/iceberg/pull/13260#issuecomment-2978098920 thanks @stevenzwu for merging. The backport one is coming soon -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] Flink: If IcebergSink writeParallelism is not specified, defaults to the input source parallelism [iceberg]

stevenzwu commented on PR #13260: URL: https://github.com/apache/iceberg/pull/13260#issuecomment-2978063775 thanks @rodmeneses for the contribution and @gyfora and @mxm for the review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[PR] docs: Update spark-procedures.md [iceberg]

zschumacher opened a new pull request, #13325: URL: https://github.com/apache/iceberg/pull/13325 Update typo in `rewrite_manifests` spark procedure docs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Flink: If IcebergSink writeParallelism is not specified, defaults to the input source parallelism [iceberg]

stevenzwu merged PR #13260: URL: https://github.com/apache/iceberg/pull/13260 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [I] Spark: Doing a Coalesce and foreachpartitions in spark directly on an iceberg table is leaking memory heavy iterators [iceberg]

jkolash commented on issue #13297: URL: https://github.com/apache/iceberg/issues/13297#issuecomment-2977939838 I believe it is happening because normally these would be separate tasks but coalesce kind of hides each task and combines multiple partitions into 1 partition so the task cannot "

[PR] Add deprecation message for source-id [iceberg-python]

rambleraptor opened a new pull request, #2098: URL: https://github.com/apache/iceberg-python/pull/2098 Closes #1547 # Rationale for this change Iceberg v3 does not support `source-id` and only supports `source-ids`. Meanwhile, Iceberg v2 only supports `source-id`. R

Re: [PR] Flink: Add support for Flink 2.0 [iceberg]

le5hy commented on PR #12527: URL: https://github.com/apache/iceberg/pull/12527#issuecomment-2977953020 when is the 2.0 release coming? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] spec: add clarification about the Geometry type calculation [iceberg]

jiayuasu commented on PR #13227: URL: https://github.com/apache/iceberg/pull/13227#issuecomment-2977637332 Ping geo folks and see if they have comments @jorisvandenbossche @paleolimbot @kylebarron @cholmes @migurski -- This is an automated message from the Apache Git Ser

Re: [PR] Add BigQuery Dependencies for Iceberg GCP Bundle [iceberg]

talatuyarer commented on PR #13111: URL: https://github.com/apache/iceberg/pull/13111#issuecomment-2977838601 yes @stevenzwu I plan to update this PR today. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] Spark: Doing a Coalesce and foreachpartitions in spark directly on an iceberg table is leaking memory heavy iterators [iceberg]

szehon-ho commented on issue #13297: URL: https://github.com/apache/iceberg/issues/13297#issuecomment-2977649874 Yea of course, it is welcome on spark side. btw, to learn, why is it only for coalesce + foreach? is it for all wide iceberg tables, and coalesce just makes it more vulnerable?

Re: [PR] fix(cli/rest) Support Glue REST operations with Iceberg-Go CLI [iceberg-go]

laskoviymishka commented on PR #459: URL: https://github.com/apache/iceberg-go/pull/459#issuecomment-2977630441 I think this is still a problem. From what I see in other Glue clients, parameters are typically passed as CLI flags instead of a JSON file. CLI flags are more self-describin

[PR] fix: add metadata_properties to _construct_parameters when updating glue table [iceberg-python]

summermousa-vendia opened a new pull request, #2097: URL: https://github.com/apache/iceberg-python/pull/2097 # Rationale for this change See: https://github.com/apache/iceberg-python/pull/2013 And: https://github.com/apache/iceberg-python/issues/2064 Conti

Re: [I] [feature request] docs for IRC catalog connection [iceberg-python]

kevinjqliu commented on issue #2096: URL: https://github.com/apache/iceberg-python/issues/2096#issuecomment-2977446303 Some of the catalog integrations might already exist in their respective docs - lakekeeper, https://docs.lakekeeper.io/docs/latest/engines/?h=pyiceberg#pyiceberg - R2

[I] [feature request] docs for catalog connection [iceberg-python]

kevinjqliu opened a new issue, #2096: URL: https://github.com/apache/iceberg-python/issues/2096 ### Feature Request / Improvement I think we can improve the REST catalog documentation https://py.iceberg.apache.org/configuration/#rest-catalog Specifically, it would be great to

Re: [I] Spark: Doing a Coalesce and foreachpartitions in spark directly on an iceberg table is leaking memory heavy iterators [iceberg]

jkolash commented on issue #13297: URL: https://github.com/apache/iceberg/issues/13297#issuecomment-2977406636 So I made the following changes to just spark, without my iceberg changes. and I was able to not OOM. https://github.com/user-attachments/assets/1158512c-6157-455e-aebe-2a01f

Re: [PR] Docs: Update Kafka Connect installation instructions and fix minor typos [iceberg]

liko9 commented on PR #12994: URL: https://github.com/apache/iceberg/pull/12994#issuecomment-2977387773 @RussellSpitzer Can you please approve this doc improvement as you've review it previously? -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] fix(cli/rest) Support Glue REST operations with Iceberg-Go CLI [iceberg-go]

maninc commented on PR #459: URL: https://github.com/apache/iceberg-go/pull/459#issuecomment-2977382593 > I'm doubtful about this approach. Can we pass this via flags? This makes the CLI less unified. I think it's better to keep this approach consistent — by using flags. Thanks @lask

Re: [PR] Flink: Dynamic Iceberg Sink: Add sink / core processing logic / benchmarking [iceberg]

pvary commented on code in PR #13304: URL: https://github.com/apache/iceberg/pull/13304#discussion_r2150314750 ## flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicIcebergSink.java: ## @@ -0,0 +1,832 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] GCP: Add Google Authentication Support [iceberg]

adutra commented on PR #13212: URL: https://github.com/apache/iceberg/pull/13212#issuecomment-2977361640 @sungwy thanks for raising the question! > do we want to encourage vendors to implement and manage their AuthManager separately from this project, or encourage them to contribute

Re: [I] Issue with kerberized hive metastore [iceberg-python]

kevinjqliu commented on issue #2032: URL: https://github.com/apache/iceberg-python/issues/2032#issuecomment-2977346977 sounds logical to me, thanks for finding those references. we can add `HIVE_KERBEROS_SERVICE_NAME = "hive.kerberos-service-name"` and `HIVE_KERBEROS_SERVICE_NAME_DE

Re: [I] Issue with kerberized hive metastore [iceberg-python]

gardenia commented on issue #2032: URL: https://github.com/apache/iceberg-python/issues/2032#issuecomment-2977231053 @kevinjqliu yes happy to help add this. I'm not an authority on kerberos but the hive properties you mentioned (hive.metastore.kerberos.principal and hive.metastore

Re: [PR] Add BigQuery Dependencies for Iceberg GCP Bundle [iceberg]

stevenzwu commented on PR #13111: URL: https://github.com/apache/iceberg/pull/13111#issuecomment-2977116785 @talatuyarer can you take a look at @jbonofre 's latest comments? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Flink: Dynamic Iceberg Sink: Add sink / core processing logic / benchmarking [iceberg]

mxm commented on code in PR #13304: URL: https://github.com/apache/iceberg/pull/13304#discussion_r2150322804 ## flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordProcessor.java: ## @@ -0,0 +1,163 @@ +/* + * Licensed to the Apache Software Foundati

Re: [I] Publish Iceberg kafka connect runtime to Confluent hub [iceberg]

stevenzwu commented on issue #10745: URL: https://github.com/apache/iceberg/issues/10745#issuecomment-2977122262 are we still targeting some automated solution for the next Iceberg 1.10.0 release? Please let me know if there are any manual steps required for 1.10.0 release. -- This

Re: [PR] feat: adding schema update methods [iceberg-go]

zeroshade commented on PR #431: URL: https://github.com/apache/iceberg-go/pull/431#issuecomment-2977094636 I'll go through this again today and give a review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] Flink: Dynamic Iceberg Sink: Add sink / core processing logic / benchmarking [iceberg]

mxm commented on code in PR #13304: URL: https://github.com/apache/iceberg/pull/13304#discussion_r2150287964 ## flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordProcessor.java: ## @@ -0,0 +1,163 @@ +/* + * Licensed to the Apache Software Foundati

Re: [PR] Flink: Dynamic Iceberg Sink: Add sink / core processing logic / benchmarking [iceberg]

pvary commented on code in PR #13304: URL: https://github.com/apache/iceberg/pull/13304#discussion_r2150205666 ## flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordProcessor.java: ## @@ -0,0 +1,163 @@ +/* + * Licensed to the Apache Software Founda

Re: [I] Corrupted table on RESTException while performing manifest rewrite [iceberg]

lkindere closed issue #12792: Corrupted table on RESTException while performing manifest rewrite URL: https://github.com/apache/iceberg/issues/12792 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [I] Corrupted table on RESTException while performing manifest rewrite [iceberg]

lkindere commented on issue #12792: URL: https://github.com/apache/iceberg/issues/12792#issuecomment-2976918741 Upon further investigation it seems to be likely that the version used when executing the operations was not in fact 1.7.1 due to databricks pre-packaging it's own iceberg runtime

Re: [PR] Flink: Dynamic Iceberg Sink: Add sink / core processing logic / benchmarking [iceberg]

mxm commented on code in PR #13304: URL: https://github.com/apache/iceberg/pull/13304#discussion_r2150182952 ## flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordProcessor.java: ## @@ -0,0 +1,163 @@ +/* + * Licensed to the Apache Software Foundati

Re: [PR] Flink: Dynamic Iceberg Sink: Add sink / core processing logic / benchmarking [iceberg]

mxm commented on code in PR #13304: URL: https://github.com/apache/iceberg/pull/13304#discussion_r2150173756 ## flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordProcessor.java: ## @@ -0,0 +1,163 @@ +/* + * Licensed to the Apache Software Foundati

Re: [I] Spark 4.0 [iceberg]

TomerHeber commented on issue #13162: URL: https://github.com/apache/iceberg/issues/13162#issuecomment-2976826252 Hi @nastra is there an ETA for the next Iceberg Release? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] feat: Public accessors for `last_column_id` and `last_partition_id` [iceberg-rust]

Fokko merged PR #1438: URL: https://github.com/apache/iceberg-rust/pull/1438 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

  1   2   >