Re: [I] [feat] add missing metadata tables [iceberg-python]

2025-01-11 Thread via GitHub
soumya-ghosh commented on issue #1053: URL: https://github.com/apache/iceberg-python/issues/1053#issuecomment-2585271579 sure @amitgilad3. You can work on `positional_deletes` and `all_entries`. `all_files`, `all_data_files` and `all_delete_files` will use the same base implementation an

Re: [PR] Modified exception objects being thrown when converting Pyarrow tables [iceberg-python]

2025-01-11 Thread via GitHub
kevinjqliu commented on code in PR #1498: URL: https://github.com/apache/iceberg-python/pull/1498#discussion_r1912158909 ## tests/io/test_pyarrow_visitor.py: ## @@ -625,6 +626,91 @@ def test_pyarrow_schema_ensure_large_types(pyarrow_schema_nested_without_ids: pa assert _p

Re: [PR] Use `ObjectStoreLocationProvider` by default [iceberg-python]

2025-01-11 Thread via GitHub
kevinjqliu commented on code in PR #1509: URL: https://github.com/apache/iceberg-python/pull/1509#discussion_r1912162975 ## tests/integration/test_writes/test_partitioned_writes.py: ## @@ -297,8 +297,8 @@ def test_object_storage_location_provider_excludes_partition_path( t

Re: [PR] Parquet: Add readers and writers for the internal object model [iceberg]

2025-01-11 Thread via GitHub
ajantha-bhat commented on code in PR #11904: URL: https://github.com/apache/iceberg/pull/11904#discussion_r1911927458 ## api/src/test/java/org/apache/iceberg/util/RandomUtil.java: ## @@ -237,7 +237,7 @@ private static BigInteger randomUnscaled(int precision, Random random) {

Re: [PR] Parquet: Add readers and writers for the internal object model [iceberg]

2025-01-11 Thread via GitHub
ajantha-bhat commented on PR #11904: URL: https://github.com/apache/iceberg/pull/11904#issuecomment-2585142658 @rdblue: Thanks for the review. I have addressed the comments. Please take a look at it again. -- This is an automated message from the Apache Git Service. To respond to the me

Re: [I] [feat] add missing metadata tables [iceberg-python]

2025-01-11 Thread via GitHub
amitgilad3 commented on issue #1053: URL: https://github.com/apache/iceberg-python/issues/1053#issuecomment-2585250099 Hey @soumya-ghosh & @kevinjqliu , would love to contribute . i dont want to step on you work so i was wondering what i can take from this list: positional_deletes, all_f

Re: [I] Implement partition writer [iceberg-rust]

2025-01-11 Thread via GitHub
ZENOTME commented on issue #342: URL: https://github.com/apache/iceberg-rust/issues/342#issuecomment-2585258477 > Hey folks, curious to know the status of partition write in Iceberg Rust? I'm working on this and we should complete #731 first. -- This is an automated message from th

[PR] Use `ObjectStoreLocationProvider` by default [iceberg-python]

2025-01-11 Thread via GitHub
smaheshwar-pltr opened a new pull request, #1509: URL: https://github.com/apache/iceberg-python/pull/1509 Following the discussion in https://github.com/apache/iceberg-python/pull/1452#discussion_r1899070323, this PR proposes diverging from the historical, Java-side preference of disabling

Re: [PR] Use `ObjectStoreLocationProvider` by default [iceberg-python]

2025-01-11 Thread via GitHub
smaheshwar-pltr commented on PR #1509: URL: https://github.com/apache/iceberg-python/pull/1509#issuecomment-2585317026 Want to strongly highlight for folks reviewing (@kevinjqliu + @Fokko?) that I've **not** changed `WRITE_OBJECT_STORE_PARTITIONED_PATHS_DEFAULT` to `False` even though it's

Re: [PR] Use `ObjectStoreLocationProvider` by default [iceberg-python]

2025-01-11 Thread via GitHub
smaheshwar-pltr commented on code in PR #1509: URL: https://github.com/apache/iceberg-python/pull/1509#discussion_r1912071614 ## tests/integration/test_writes/test_partitioned_writes.py: ## @@ -297,8 +297,8 @@ def test_object_storage_location_provider_excludes_partition_path(

Re: [PR] Use `ObjectStoreLocationProvider` by default [iceberg-python]

2025-01-11 Thread via GitHub
smaheshwar-pltr commented on PR #1509: URL: https://github.com/apache/iceberg-python/pull/1509#issuecomment-2585318235 The main downside of this PR is that file paths and their directory structures are more obscured by default with a bunch of hash directories inserted in the middle. But IMH

Re: [PR] Fix ParallelIterable deadlock [iceberg]

2025-01-11 Thread via GitHub
findepi commented on PR #11781: URL: https://github.com/apache/iceberg/pull/11781#issuecomment-2585320135 It seems we're in agreement. The deadlock must be resolved. This PR supposedly avoids any deadlocks at the cost of increased memory usage, which is fair. I think we should not remove me

Re: [PR] Fix ParallelIterable deadlock [iceberg]

2025-01-11 Thread via GitHub
findepi commented on PR #11781: URL: https://github.com/apache/iceberg/pull/11781#issuecomment-2585320268 Given that many approvals, it looks ready to go. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [I] ParallelIterable is deadlocking and is generally really complicated [iceberg]

2025-01-11 Thread via GitHub
findepi closed issue #11768: ParallelIterable is deadlocking and is generally really complicated URL: https://github.com/apache/iceberg/issues/11768 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] Core: Fix possible deadlock in ParallelIterable [iceberg]

2025-01-11 Thread via GitHub
findepi merged PR #11781: URL: https://github.com/apache/iceberg/pull/11781 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.a

Re: [I] ParallelIterable is deadlocking and is generally really complicated [iceberg]

2025-01-11 Thread via GitHub
findepi closed issue #11768: ParallelIterable is deadlocking and is generally really complicated URL: https://github.com/apache/iceberg/issues/11768 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] Core: Fix possible deadlock in ParallelIterable [iceberg]

2025-01-11 Thread via GitHub
findepi commented on PR #11781: URL: https://github.com/apache/iceberg/pull/11781#issuecomment-2585320623 thank you @sopel39 for the PR and @osscm @RussellSpitzer @stevenzwu for reviews! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] Documentation for Location Providers [iceberg-python]

2025-01-11 Thread via GitHub
smaheshwar-pltr commented on issue #1510: URL: https://github.com/apache/iceberg-python/issues/1510#issuecomment-2585322771 Happy to pick this up, just dropping an issue for now. I'd like to wait for https://github.com/apache/iceberg-python/pull/1509 to merge before *merging* this (

Re: [PR] Use `ObjectStoreLocationProvider` by default [iceberg-python]

2025-01-11 Thread via GitHub
smaheshwar-pltr commented on code in PR #1509: URL: https://github.com/apache/iceberg-python/pull/1509#discussion_r1912296178 ## pyiceberg/table/__init__.py: ## @@ -190,7 +190,7 @@ class TableProperties: WRITE_PY_LOCATION_PROVIDER_IMPL = "write.py-location-provider.impl"

Re: [PR] Use `ObjectStoreLocationProvider` by default [iceberg-python]

2025-01-11 Thread via GitHub
smaheshwar-pltr commented on code in PR #1509: URL: https://github.com/apache/iceberg-python/pull/1509#discussion_r1912296178 ## pyiceberg/table/__init__.py: ## @@ -190,7 +190,7 @@ class TableProperties: WRITE_PY_LOCATION_PROVIDER_IMPL = "write.py-location-provider.impl"

Re: [PR] Use `ObjectStoreLocationProvider` by default [iceberg-python]

2025-01-11 Thread via GitHub
smaheshwar-pltr commented on code in PR #1509: URL: https://github.com/apache/iceberg-python/pull/1509#discussion_r1912296503 ## tests/integration/test_writes/test_partitioned_writes.py: ## @@ -297,8 +297,8 @@ def test_object_storage_location_provider_excludes_partition_path(

Re: [I] Add PrePlanTable and PlanTable Endpoints to open api spec [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] closed issue #10391: Add PrePlanTable and PlanTable Endpoints to open api spec URL: https://github.com/apache/iceberg/issues/10391 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] Add PrePlanTable and PlanTable Endpoints to open api spec [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on issue #10391: URL: https://github.com/apache/iceberg/issues/10391#issuecomment-2585490596 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] Iceberg REST Spec Extensions for Access Decision Exchange [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] closed issue #10395: Iceberg REST Spec Extensions for Access Decision Exchange URL: https://github.com/apache/iceberg/issues/10395 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] Iceberg REST Spec Extensions for Access Decision Exchange [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on issue #10395: URL: https://github.com/apache/iceberg/issues/10395#issuecomment-2585490604 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [PR] Core: Suppress exceptions in case of dropTableData [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] closed pull request #9184: Core: Suppress exceptions in case of dropTableData URL: https://github.com/apache/iceberg/pull/9184 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] New REST Catalog Spec/RFC [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on issue #10075: URL: https://github.com/apache/iceberg/issues/10075#issuecomment-2585490571 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] New REST Catalog Spec/RFC [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] closed issue #10075: New REST Catalog Spec/RFC URL: https://github.com/apache/iceberg/issues/10075 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

Re: [PR] support uri not end with character '/' in rest catalog [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #11392: URL: https://github.com/apache/iceberg/pull/11392#issuecomment-2585490661 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Remove Hive 2 [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #10996: URL: https://github.com/apache/iceberg/pull/10996#issuecomment-2585490637 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [I] Support client-side purge in REST catalog [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] closed issue #10089: Support client-side purge in REST catalog URL: https://github.com/apache/iceberg/issues/10089 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Spark 3.5: Add query runner in test module [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #11758: URL: https://github.com/apache/iceberg/pull/11758#issuecomment-2585490703 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [I] Support Securable Objects in Iceberg REST Catalog [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] closed issue #10407: Support Securable Objects in Iceberg REST Catalog URL: https://github.com/apache/iceberg/issues/10407 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] Support Securable Objects in Iceberg REST Catalog [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on issue #10407: URL: https://github.com/apache/iceberg/issues/10407#issuecomment-2585490610 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] Old Avro file not found breaks Athena iceberg table [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] closed issue #10560: Old Avro file not found breaks Athena iceberg table URL: https://github.com/apache/iceberg/issues/10560 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] Old Avro file not found breaks Athena iceberg table [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on issue #10560: URL: https://github.com/apache/iceberg/issues/10560#issuecomment-2585490615 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] Support client-side purge in REST catalog [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on issue #10089: URL: https://github.com/apache/iceberg/issues/10089#issuecomment-2585490582 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [PR] Spark 3.5: Add ignore-invalid-options to RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #11737: URL: https://github.com/apache/iceberg/pull/11737#issuecomment-2585490696 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Spark3.4,3.5,Api,Hive: Fix using NullType in View. [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #11728: URL: https://github.com/apache/iceberg/pull/11728#issuecomment-2585490691 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Core, Rest: Enable useSystemProperties on RESTClient [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #11548: URL: https://github.com/apache/iceberg/pull/11548#issuecomment-2585490675 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Core, Rest: Read the max connection for rest client from properties [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #11522: URL: https://github.com/apache/iceberg/pull/11522#issuecomment-2585490669 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Spark 3.5: Display write metrics on SQL UI [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #11340: URL: https://github.com/apache/iceberg/pull/11340#issuecomment-2585490653 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Spec: Add cross-region bucket access property to config [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #11260: URL: https://github.com/apache/iceberg/pull/11260#issuecomment-2585490645 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [I] Accessing S3 Express one zone bucket from pyiceberg [iceberg-python]

2025-01-11 Thread via GitHub
github-actions[bot] commented on issue #928: URL: https://github.com/apache/iceberg-python/issues/928#issuecomment-2585491356 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity oc

Re: [PR] Core: Suppress exceptions in case of dropTableData [iceberg]

2025-01-11 Thread via GitHub
github-actions[bot] commented on PR #9184: URL: https://github.com/apache/iceberg/pull/9184#issuecomment-2585490558 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If y

Re: [PR] Implement column projection [iceberg-python]

2025-01-11 Thread via GitHub
gabeiglio commented on code in PR #1443: URL: https://github.com/apache/iceberg-python/pull/1443#discussion_r1912328061 ## pyiceberg/io/pyarrow.py: ## @@ -1216,6 +1216,25 @@ def _field_id(self, field: pa.Field) -> int: return -1 +def _get_column_projection_values( +

Re: [PR] Implement column projection [iceberg-python]

2025-01-11 Thread via GitHub
gabeiglio commented on code in PR #1443: URL: https://github.com/apache/iceberg-python/pull/1443#discussion_r1912344028 ## pyiceberg/io/pyarrow.py: ## @@ -1216,6 +1216,25 @@ def _field_id(self, field: pa.Field) -> int: return -1 +def _get_column_projection_values( +

Re: [PR] feat: support `arrow_struct_to_iceberg_struct` [iceberg-rust]

2025-01-11 Thread via GitHub
ZENOTME commented on code in PR #731: URL: https://github.com/apache/iceberg-rust/pull/731#discussion_r1912050258 ## crates/iceberg/src/spec/schema.rs: ## @@ -1132,6 +1132,213 @@ impl ReassignFieldIds { } } +/// A post order schema visitor with partner. +/// +/// For ord

Re: [PR] [Docs] Update spark-getting-started docs page to make the example valid [iceberg]

2025-01-11 Thread via GitHub
nickdelnano commented on PR #11923: URL: https://github.com/apache/iceberg/pull/11923#issuecomment-2585619422 @kevinjqliu oop, sorry about that. Ran the linter 98c99f1010e1c78b973461f20c0fe874c535d38e ``` ./gradlew spotlessApply BUILD SUCCESSFUL in 1s 69 actionable task

Re: [PR] Update cmake instructions in README [iceberg-cpp]

2025-01-11 Thread via GitHub
lidavidm commented on code in PR #24: URL: https://github.com/apache/iceberg-cpp/pull/24#discussion_r1912383203 ## README.md: ## @@ -32,7 +32,7 @@ C++ implementation of [Apache Iceberg™](https://iceberg.apache.org/). ```bash cd iceberg-cpp -cmake -S . -B build -DCMAKE_INSTA

Re: [PR] feat(puffin): Parse Puffin FileMetadata [iceberg-rust]

2025-01-11 Thread via GitHub
liurenjie1024 commented on PR #765: URL: https://github.com/apache/iceberg-rust/pull/765#issuecomment-258031 Let's wait for a moment to see if others need to take a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] Build: Bump software.amazon.awssdk:bom from 2.29.45 to 2.29.50 [iceberg]

2025-01-11 Thread via GitHub
dependabot[bot] opened a new pull request, #11949: URL: https://github.com/apache/iceberg/pull/11949 Bumps software.amazon.awssdk:bom from 2.29.45 to 2.29.50. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=soft

Re: [I] Implement partition writer [iceberg-rust]

2025-01-11 Thread via GitHub
hackintoshrao commented on issue #342: URL: https://github.com/apache/iceberg-rust/issues/342#issuecomment-2585207885 Hey folks, curious to know the status of partition write in Iceberg Rust? -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] feat(puffin): Parse Puffin FileMetadata [iceberg-rust]

2025-01-11 Thread via GitHub
fqaiser94 commented on code in PR #765: URL: https://github.com/apache/iceberg-rust/pull/765#discussion_r1912192560 ## crates/iceberg/src/puffin/metadata.rs: ## @@ -0,0 +1,777 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agree

Re: [PR] feat(puffin): Parse Puffin FileMetadata [iceberg-rust]

2025-01-11 Thread via GitHub
fqaiser94 commented on code in PR #765: URL: https://github.com/apache/iceberg-rust/pull/765#discussion_r1912192306 ## crates/iceberg/src/puffin/metadata.rs: ## @@ -0,0 +1,777 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agree

Re: [PR] feat(puffin): Parse Puffin FileMetadata [iceberg-rust]

2025-01-11 Thread via GitHub
fqaiser94 commented on code in PR #765: URL: https://github.com/apache/iceberg-rust/pull/765#discussion_r1912193550 ## crates/iceberg/src/puffin/metadata.rs: ## @@ -0,0 +1,777 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agree

Re: [PR] Build: Bump deptry from 0.21.2 to 0.22.0 [iceberg-python]

2025-01-11 Thread via GitHub
kevinjqliu merged PR #1508: URL: https://github.com/apache/iceberg-python/pull/1508 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [PR] [WIP] Feat: replace sort order [iceberg-python]

2025-01-11 Thread via GitHub
kevinjqliu commented on code in PR #1500: URL: https://github.com/apache/iceberg-python/pull/1500#discussion_r1912178675 ## tests/integration/test_sort_order_update.py: ## @@ -0,0 +1,99 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor licen

Re: [PR] Modified exception objects being thrown when converting Pyarrow tables [iceberg-python]

2025-01-11 Thread via GitHub
DevChrisCross commented on code in PR #1498: URL: https://github.com/apache/iceberg-python/pull/1498#discussion_r1912180256 ## tests/io/test_pyarrow_visitor.py: ## @@ -625,6 +626,91 @@ def test_pyarrow_schema_ensure_large_types(pyarrow_schema_nested_without_ids: pa assert

Re: [PR] feat(puffin): Parse Puffin FileMetadata [iceberg-rust]

2025-01-11 Thread via GitHub
fqaiser94 commented on code in PR #765: URL: https://github.com/apache/iceberg-rust/pull/765#discussion_r1912193550 ## crates/iceberg/src/puffin/metadata.rs: ## @@ -0,0 +1,777 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agree

Re: [PR] Use `ObjectStoreLocationProvider` by default [iceberg-python]

2025-01-11 Thread via GitHub
smaheshwar-pltr commented on PR #1509: URL: https://github.com/apache/iceberg-python/pull/1509#issuecomment-2585391350 > In terms of the default value for WRITE_OBJECT_STORE_PARTITIONED_PATHS, here are the four different scenarios. ([source](https://github.com/apache/iceberg-python/blob/cad

Re: [PR] Modified exception objects being thrown when converting Pyarrow tables [iceberg-python]

2025-01-11 Thread via GitHub
DevChrisCross commented on code in PR #1498: URL: https://github.com/apache/iceberg-python/pull/1498#discussion_r1912229915 ## tests/io/test_pyarrow_visitor.py: ## @@ -625,6 +626,91 @@ def test_pyarrow_schema_ensure_large_types(pyarrow_schema_nested_without_ids: pa assert

Re: [PR] Modified exception objects being thrown when converting Pyarrow tables [iceberg-python]

2025-01-11 Thread via GitHub
DevChrisCross commented on code in PR #1498: URL: https://github.com/apache/iceberg-python/pull/1498#discussion_r1912229915 ## tests/io/test_pyarrow_visitor.py: ## @@ -625,6 +626,91 @@ def test_pyarrow_schema_ensure_large_types(pyarrow_schema_nested_without_ids: pa assert

Re: [PR] Modified exception objects being thrown when converting Pyarrow tables [iceberg-python]

2025-01-11 Thread via GitHub
DevChrisCross commented on code in PR #1498: URL: https://github.com/apache/iceberg-python/pull/1498#discussion_r1912229915 ## tests/io/test_pyarrow_visitor.py: ## @@ -625,6 +626,91 @@ def test_pyarrow_schema_ensure_large_types(pyarrow_schema_nested_without_ids: pa assert

Re: [PR] Modified exception objects being thrown when converting Pyarrow tables [iceberg-python]

2025-01-11 Thread via GitHub
DevChrisCross commented on code in PR #1498: URL: https://github.com/apache/iceberg-python/pull/1498#discussion_r1912229915 ## tests/io/test_pyarrow_visitor.py: ## @@ -625,6 +626,91 @@ def test_pyarrow_schema_ensure_large_types(pyarrow_schema_nested_without_ids: pa assert

Re: [I] Support writing to a branch [iceberg-python]

2025-01-11 Thread via GitHub
sl2902 commented on issue #306: URL: https://github.com/apache/iceberg-python/issues/306#issuecomment-2585419953 @vinjai Thanks for working on this feature Is there any update regarding this feature? I would like to have this feature to perform a Write Audit Publish pattern in my pipe