Re: [PR] Build: Bump nessie from 0.103.5 to 0.103.6 [iceberg]

2025-05-04 Thread via GitHub
nastra merged PR #12963: URL: https://github.com/apache/iceberg/pull/12963 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Build: Bump software.amazon.awssdk:bom from 2.31.30 to 2.31.35 [iceberg]

2025-05-04 Thread via GitHub
nastra merged PR #12967: URL: https://github.com/apache/iceberg/pull/12967 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Build: Bump org.openapitools:openapi-generator-gradle-plugin from 7.12.0 to 7.13.0 [iceberg]

2025-05-04 Thread via GitHub
nastra merged PR #12966: URL: https://github.com/apache/iceberg/pull/12966 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Build: Bump parquet from 1.15.1 to 1.15.2 [iceberg]

2025-05-04 Thread via GitHub
nastra merged PR #12964: URL: https://github.com/apache/iceberg/pull/12964 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Spec: Clarify behavior of special geo objects for lower/upper bounds [iceberg]

2025-05-04 Thread via GitHub
jiayuasu commented on code in PR #12956: URL: https://github.com/apache/iceberg/pull/12956#discussion_r2072882493 ## format/spec.md: ## @@ -649,6 +649,8 @@ Notes: For `geometry` and `geography` types, `lower_bounds` and `upper_bounds` are both points of the following coordin

Re: [PR] Spec: Clarify behavior of special geo objects for lower/upper bounds [iceberg]

2025-05-04 Thread via GitHub
jiayuasu commented on code in PR #12956: URL: https://github.com/apache/iceberg/pull/12956#discussion_r2072880636 ## format/spec.md: ## @@ -649,6 +649,8 @@ Notes: For `geometry` and `geography` types, `lower_bounds` and `upper_bounds` are both points of the following coordin

[PR] Hive: Add DO_NOT_UPDATE_STATS in alter_table [iceberg-python]

2025-05-04 Thread via GitHub
frankliee opened a new pull request, #1966: URL: https://github.com/apache/iceberg-python/pull/1966 # Rationale for this change Let the hive metastore does not compute hive stats which is not used by iceberg. # Are these changes tested? Existing tests

Re: [I] Support Defining PartitionSpec and SortOrder without field-ids in create_table [iceberg-python]

2025-05-04 Thread via GitHub
github-actions[bot] commented on issue #338: URL: https://github.com/apache/iceberg-python/issues/338#issuecomment-2849611737 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity oc

Re: [I] Check behavior when dropping a field that's part of the current partition spec [iceberg-python]

2025-05-04 Thread via GitHub
github-actions[bot] commented on issue #1293: URL: https://github.com/apache/iceberg-python/issues/1293#issuecomment-2849611711 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity

Re: [PR] CORE: Inject OAuth2 Token from TableSession [iceberg]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #12635: URL: https://github.com/apache/iceberg/pull/12635#issuecomment-2849609648 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [I] Error Reading Parquet Data Files Written by Hive/Impala after Migration to Iceberg using Spark SQL [iceberg]

2025-05-04 Thread via GitHub
github-actions[bot] closed issue #11367: Error Reading Parquet Data Files Written by Hive/Impala after Migration to Iceberg using Spark SQL URL: https://github.com/apache/iceberg/issues/11367 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Prototyping Spark 3.4 row lineage [iceberg]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #12592: URL: https://github.com/apache/iceberg/pull/12592#issuecomment-2849609613 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] CORE: Inject OAuth2 Token from TableSession [iceberg]

2025-05-04 Thread via GitHub
github-actions[bot] closed pull request #12635: CORE: Inject OAuth2 Token from TableSession URL: https://github.com/apache/iceberg/pull/12635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [I] Error while connecting to REST catalog using Spark [iceberg]

2025-05-04 Thread via GitHub
github-actions[bot] commented on issue #11477: URL: https://github.com/apache/iceberg/issues/11477#issuecomment-2849609531 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [PR] Core: Simplify AuthManager API [iceberg]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #12555: URL: https://github.com/apache/iceberg/pull/12555#issuecomment-2849609594 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [I] Error Reading Parquet Data Files Written by Hive/Impala after Migration to Iceberg using Spark SQL [iceberg]

2025-05-04 Thread via GitHub
github-actions[bot] commented on issue #11367: URL: https://github.com/apache/iceberg/issues/11367#issuecomment-2849609477 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] How to reinitialize/refresh iceberg catalog object in spark catalog on an ongoing spark session [iceberg]

2025-05-04 Thread via GitHub
github-actions[bot] commented on issue #10227: URL: https://github.com/apache/iceberg/issues/10227#issuecomment-2849609420 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] column type change failed : timestamp without timezone change to timestamp with timezone [iceberg]

2025-05-04 Thread via GitHub
github-actions[bot] commented on issue #10660: URL: https://github.com/apache/iceberg/issues/10660#issuecomment-2849609431 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [PR] Docs: Incorrect property in CREATE CATALOG for Flink [iceberg]

2025-05-04 Thread via GitHub
ebyhr commented on code in PR #12894: URL: https://github.com/apache/iceberg/pull/12894#discussion_r2072728468 ## docs/docs/aws.md: ## @@ -96,7 +96,7 @@ catalogs: - name: my_catalog type: iceberg warehouse: s3://my-bucket/my/key/prefix -catalog-impl: org.apache.

Re: [PR] Add Python version 3.13 to test matrix. [iceberg-python]

2025-05-04 Thread via GitHub
kevinjqliu commented on code in PR #1377: URL: https://github.com/apache/iceberg-python/pull/1377#discussion_r2072674445 ## pyproject.toml: ## Review Comment: can you also add 3.13 to the `classifiers` -- This is an automated message from the Apache Git Service. To res

Re: [PR] Add Python version 3.13 to test matrix. [iceberg-python]

2025-05-04 Thread via GitHub
kevinjqliu commented on code in PR #1377: URL: https://github.com/apache/iceberg-python/pull/1377#discussion_r2072674290 ## poetry.lock: ## @@ -1,4 +1,4 @@ -# This file is automatically @generated by Poetry 2.1.1 and should not be changed by hand. +# This file is automatically

Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]

2025-05-04 Thread via GitHub
dev-sajal commented on issue #135: URL: https://github.com/apache/iceberg-python/issues/135#issuecomment-2849330465 Hey, just checking if someone was able to use it still? I am unable to access metastore yet, facing the same issue as the initial thread. -- This is an automated message fro

Re: [PR] feat: delete orphaned files [iceberg-python]

2025-05-04 Thread via GitHub
jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072668166 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1376,28 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

2025-05-04 Thread via GitHub
jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072667388 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,62 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

2025-05-04 Thread via GitHub
jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072662780 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,62 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

2025-05-04 Thread via GitHub
jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072661982 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1376,28 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

2025-05-04 Thread via GitHub
jayceslesar commented on PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#issuecomment-2849311767 > a meta question, wydt of moving the orphan file function to its own file/namespace, similar to how to use `.inspect`. > > i like the idea of having all the table mainte

Re: [PR] feat: delete orphaned files [iceberg-python]

2025-05-04 Thread via GitHub
jayceslesar commented on PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#issuecomment-2849311662 > orphaned_files I think that makes sense -- would https://github.com/apache/iceberg-python/pull/1880 end up there too? Also ideally there is a CLI that exposes al

[PR] feat: support arrow dictionary in schema conversion [iceberg-rust]

2025-05-04 Thread via GitHub
jdockerty opened a new pull request, #1293: URL: https://github.com/apache/iceberg-rust/pull/1293 ## Which issue does this PR close? - Closes https://github.com/apache/iceberg-rust/issues/1277 ## What changes are included in this PR? An expansion to the curren

Re: [PR] Add Python version 3.13 to test matrix. [iceberg-python]

2025-05-04 Thread via GitHub
JE-Chen commented on PR #1377: URL: https://github.com/apache/iceberg-python/pull/1377#issuecomment-2849296360 > You dont need to change the content of the poetry.lock file directly, its generated by running `poetry lock` after modifying the `pyproject.toml` file. > > Take a look at #

Re: [PR] Add Python version 3.13 to test matrix. [iceberg-python]

2025-05-04 Thread via GitHub
kevinjqliu commented on PR #1377: URL: https://github.com/apache/iceberg-python/pull/1377#issuecomment-2849294387 You dont need to change the content of the poetry.lock file directly, its generated by running `poetry lock` after modifying the `pyproject.toml` file. Take a look at htt

Re: [I] Clarify Error Logs for GCS Directory/Object Conflicts [iceberg-python]

2025-05-04 Thread via GitHub
kevinjqliu commented on issue #1952: URL: https://github.com/apache/iceberg-python/issues/1952#issuecomment-2849293475 Hi @HyunWooZZ thanks for raising this issue! I want to summary my understanding > I had a problem writing an Iceberg table to GCS via the JDBC catalog, but I solve

Re: [PR] Build: Bump parquet from 1.15.1 to 1.15.2 [iceberg]

2025-05-04 Thread via GitHub
manuzhang closed pull request #12964: Build: Bump parquet from 1.15.1 to 1.15.2 URL: https://github.com/apache/iceberg/pull/12964 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Build: Bump parquet from 1.15.1 to 1.15.2 [iceberg]

2025-05-04 Thread via GitHub
dependabot[bot] commented on PR #12964: URL: https://github.com/apache/iceberg/pull/12964#issuecomment-2849276455 OK, I won't notify you again about this release, but will get in touch when a new version is available. You can also ignore all major, minor, or patch releases for a dependency

Re: [PR] Site: Add open-api/ to site-ci [iceberg]

2025-05-04 Thread via GitHub
manuzhang closed pull request #12947: Site: Add open-api/ to site-ci URL: https://github.com/apache/iceberg/pull/12947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

Re: [PR] Site: Add open-api/ to site-ci [iceberg]

2025-05-04 Thread via GitHub
manuzhang commented on PR #12947: URL: https://github.com/apache/iceberg/pull/12947#issuecomment-2849274332 Gotcha. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[PR] chore(deps): Bump crate-ci/typos from 1.31.1 to 1.32.0 [iceberg-rust]

2025-05-04 Thread via GitHub
dependabot[bot] opened a new pull request, #1292: URL: https://github.com/apache/iceberg-rust/pull/1292 Bumps [crate-ci/typos](https://github.com/crate-ci/typos) from 1.31.1 to 1.32.0. Release notes Sourced from https://github.com/crate-ci/typos/releases";>crate-ci/typos's release

Re: [PR] Fix: handle IllegalArgumentException when not base64 encoded [iceberg]

2025-05-04 Thread via GitHub
regadas commented on PR #12955: URL: https://github.com/apache/iceberg/pull/12955#issuecomment-2849166775 > do you know when it is not base64 encoded ? wondering if this is the right handling or if we should throw an IllegalStateException or something Hi @singhpk234 Thanks for taking

[I] Feature request: list namespaces and tables in stream style [iceberg-rust]

2025-05-04 Thread via GitHub
dentiny opened a new issue, #1291: URL: https://github.com/apache/iceberg-rust/issues/1291 ### Is your feature request related to a problem or challenge? Hi team, I plan to use `list_namespaces` and `list_tables` on recovery. For example, when a server goes back, created catalog

[PR] build(deps): bump the gomod_updates group with 2 updates [iceberg-go]

2025-05-04 Thread via GitHub
dependabot[bot] opened a new pull request, #418: URL: https://github.com/apache/iceberg-go/pull/418 Bumps the gomod_updates group with 2 updates: [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) and [google.golang.org/api](https://github.com/googleapis/google-

Re: [PR] Add tests for optimistic concurrency [iceberg-python]

2025-05-04 Thread via GitHub
hussein-awala commented on code in PR #1962: URL: https://github.com/apache/iceberg-python/pull/1962#discussion_r2072552413 ## tests/integration/test_writes/test_optimistic_concurrency.py: ## @@ -0,0 +1,89 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or mo

Re: [I] Issue in multiple appends in one transaction [iceberg-python]

2025-05-04 Thread via GitHub
dor-bernstein commented on issue #1946: URL: https://github.com/apache/iceberg-python/issues/1946#issuecomment-2849064077 @Fokko Can I leave the context manager without triggering a commit? I prefer to be more explicit -- This is an automated message from the Apache Git Service. To respo

Re: [I] Confusing rules for `struct` defaults [iceberg]

2025-05-04 Thread via GitHub
Tishj commented on issue #12953: URL: https://github.com/apache/iceberg/issues/12953#issuecomment-2849047886 Yes, the examples are great, like I said the intent is clear, but those 2 lines add nothing but confusion. They talk about an alternative for a situation that is in direct con