Re: [PR] bump arrow version to 21.0.0 [iceberg-cpp]

2025-07-20 Thread via GitHub
wgtmac commented on code in PR #149: URL: https://github.com/apache/iceberg-cpp/pull/149#discussion_r2218316080 ## cmake_modules/IcebergThirdpartyToolchain.cmake: ## @@ -98,10 +98,10 @@ function(resolve_arrow_dependency) fetchcontent_declare(VendoredArrow

Re: [PR] feat: avro support applying field-ids based on name mapping [iceberg-cpp]

2025-07-20 Thread via GitHub
MisterRaindrop commented on code in PR #127: URL: https://github.com/apache/iceberg-cpp/pull/127#discussion_r2218292603 ## test/avro_schema_test.cc: ## @@ -1057,4 +1079,383 @@ TEST(AvroSchemaProjectionTest, ProjectDecimalIncompatible) { ASSERT_THAT(projection_result, HasErro

[PR] bump arrow version to 21.0.0 [iceberg-cpp]

2025-07-20 Thread via GitHub
zhjwpku opened a new pull request, #149: URL: https://github.com/apache/iceberg-cpp/pull/149 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [I] Spark returns incorrect results when reading Parquet bloom filters created by Trino [iceberg]

2025-07-20 Thread via GitHub
wfxxh commented on issue #12458: URL: https://github.com/apache/iceberg/issues/12458#issuecomment-3095303389 I'm having the same problem. But I'm not using trino .Below is my evnironment: spark: v3.5.3 iceberg: 1.7.1 ~ 1.9.2. when I set 'write.parquet.bloom-filter-enabled.column.MY

Re: [I] Feature request: support set snapshot property [iceberg-rust]

2025-07-20 Thread via GitHub
dentiny commented on issue #1533: URL: https://github.com/apache/iceberg-rust/issues/1533#issuecomment-3095299433 > I think the existing iceberg-rust only support `FastAppendAction` that will update the snapshot via snapshot producer, do you mean that we should add `set_snapshot_properties`

Re: [I] Metadata stop to be written after random period of time. Commit failed, will try again next cycle. [iceberg]

2025-07-20 Thread via GitHub
mblesak commented on issue #13593: URL: https://github.com/apache/iceberg/issues/13593#issuecomment-3095269275 This part seems to be problem: https://github.com/apache/iceberg/blob/77f1f5ba47f0e5250b8af4e16cbe6febc8244ee5/kafka-connect/kafka-connect/src/main/java/org/apache/iceberg/connec

Re: [I] Feature request: support set snapshot property [iceberg-rust]

2025-07-20 Thread via GitHub
CTTY commented on issue #1533: URL: https://github.com/apache/iceberg-rust/issues/1533#issuecomment-3095259190 I think the existing iceberg-rust only support `FastAppendAction` that will update the snapshot via snapshot producer, do you mean that we should add `set_snapshot_properties` when

Re: [PR] feat: avro support applying field-ids based on name mapping [iceberg-cpp]

2025-07-20 Thread via GitHub
wgtmac commented on code in PR #127: URL: https://github.com/apache/iceberg-cpp/pull/127#discussion_r2218124851 ## test/avro_schema_test.cc: ## @@ -23,9 +23,13 @@ #include #include #include +#include Review Comment: ```suggestion ``` ## test/CMakeLists.t

Re: [I] Bump com.google.cloud:libraries-bom from 26.62.0 to 26.64.0 [iceberg]

2025-07-20 Thread via GitHub
VK18-png commented on issue #13606: URL: https://github.com/apache/iceberg/issues/13606#issuecomment-3095159653 Hi manuzhang, Im working on the draft PR for the Bump com.google.cloud:libraries-bom from 26.62.0 to 26.64.0 cleanup feature (as discussed in issue #13606). I'm really pass

Re: [PR] feat: support operator== for Literal/Manifest/ManifestList [iceberg-cpp]

2025-07-20 Thread via GitHub
Xuanwo merged PR #147: URL: https://github.com/apache/iceberg-cpp/pull/147 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] feat: RegisterTable support for InMemoryCatalog [iceberg-cpp]

2025-07-20 Thread via GitHub
Xuanwo merged PR #142: URL: https://github.com/apache/iceberg-cpp/pull/142 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Add support for custom credential loader for S3 FileIO [iceberg-rust]

2025-07-20 Thread via GitHub
Xuanwo merged PR #1528: URL: https://github.com/apache/iceberg-rust/pull/1528 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [I] Add ability to specify a custom AWS credential loader for S3 FileIO [iceberg-rust]

2025-07-20 Thread via GitHub
Xuanwo closed issue #1527: Add ability to specify a custom AWS credential loader for S3 FileIO URL: https://github.com/apache/iceberg-rust/issues/1527 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] feat: implement transform ResultType [iceberg-cpp]

2025-07-20 Thread via GitHub
wgtmac commented on code in PR #132: URL: https://github.com/apache/iceberg-cpp/pull/132#discussion_r2218122767 ## src/iceberg/transform_function.cc: ## @@ -48,7 +48,27 @@ Result BucketTransform::Transform(const ArrowArray& input) { } Result> BucketTransform::ResultType() c

Re: [I] How compaction works along side incremental read [iceberg]

2025-07-20 Thread via GitHub
jiqiujia commented on issue #6422: URL: https://github.com/apache/iceberg/issues/6422#issuecomment-3095118282 @ChristinaTech any update on this?Does incremental read use compacted files now? -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [I] Bump com.google.cloud:libraries-bom from 26.62.0 to 26.64.0 [iceberg]

2025-07-20 Thread via GitHub
manuzhang commented on issue #13606: URL: https://github.com/apache/iceberg/issues/13606#issuecomment-3095117691 Yeah, feel free to open a PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] Bump com.google.cloud:libraries-bom from 26.62.0 to 26.64.0 [iceberg]

2025-07-20 Thread via GitHub
VK18-png commented on issue #13606: URL: https://github.com/apache/iceberg/issues/13606#issuecomment-3095115641 Hi, I’d like to contribute to this issue and have some ideas for an implementation plan. Would it be okay if I opened a draft PR to discuss the direction? -- This is an automat

[I] Bump com.google.cloud:libraries-bom from 26.62.0 to 26.64.0 [iceberg]

2025-07-20 Thread via GitHub
manuzhang opened a new issue, #13606: URL: https://github.com/apache/iceberg/issues/13606 ### Feature Request / Improvement Auto-upgrade [Bump com.google.cloud:libraries-bom from 26.62.0 to 26.64.0](https://github.com/apache/iceberg/pull/13604) failed. It looks there've been breaking

[PR] feat: append action allows snapshot properties [iceberg-rust]

2025-07-20 Thread via GitHub
dentiny opened a new pull request, #1534: URL: https://github.com/apache/iceberg-rust/pull/1534 ## Which issue does this PR close? - Closes https://github.com/apache/iceberg-rust/issues/1533 ## What changes are included in this PR? I have a real-world production requireme

Re: [PR] Expose Avro reader to PyIceberg [iceberg-rust]

2025-07-20 Thread via GitHub
kevinjqliu commented on PR #1328: URL: https://github.com/apache/iceberg-rust/pull/1328#issuecomment-3094943218 interesting, now it fails with ``` > manifest = manifest.read_manifest_entries(bs) ^^ E pyo3_runtime.Pani

Re: [PR] Expose Avro reader to PyIceberg [iceberg-rust]

2025-07-20 Thread via GitHub
kevinjqliu commented on PR #1328: URL: https://github.com/apache/iceberg-rust/pull/1328#issuecomment-3094939499 I merged main to resolve the merge conflict with the lock file. Fixed clippy issue that was caught by CI. And took some inspiration from https://github.com/apache/iceberg-pyth

Re: [PR] Error handling with DLQ support [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on PR #13135: URL: https://github.com/apache/iceberg/pull/13135#issuecomment-3094926363 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [I] Question about hash of BucketInteger [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on issue #12015: URL: https://github.com/apache/iceberg/issues/12015#issuecomment-3094926009 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] Unable to create tables automatically with Iceberg REST and AWS Glue [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on issue #11921: URL: https://github.com/apache/iceberg/issues/11921#issuecomment-3094925622 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] Unable to create tables automatically with Iceberg REST and AWS Glue [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] closed issue #11921: Unable to create tables automatically with Iceberg REST and AWS Glue URL: https://github.com/apache/iceberg/issues/11921 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [I] Question about Decimal Type Limitations in Iceberg [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] closed issue #11920: Question about Decimal Type Limitations in Iceberg URL: https://github.com/apache/iceberg/issues/11920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] How to apply partition/bloom filter to old data? Does rewrite_data_files/rewrite_manifests procedure work? [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on issue #11878: URL: https://github.com/apache/iceberg/issues/11878#issuecomment-3094925360 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] Implement Human OAuth2 Flows for OAuth2Manager [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] closed issue #10677: Implement Human OAuth2 Flows for OAuth2Manager URL: https://github.com/apache/iceberg/issues/10677 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [I] Conditional Deletes [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on issue #11985: URL: https://github.com/apache/iceberg/issues/11985#issuecomment-3094925835 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] Question about Decimal Type Limitations in Iceberg [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on issue #11920: URL: https://github.com/apache/iceberg/issues/11920#issuecomment-3094925478 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] Implement Human OAuth2 Flows for OAuth2Manager [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on issue #10677: URL: https://github.com/apache/iceberg/issues/10677#issuecomment-3094924962 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] [Java API] Rough edges when recreating a DataFile that is partitioned by month or hour [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on issue #11900: URL: https://github.com/apache/iceberg/issues/11900#issuecomment-3094925412 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occur

Re: [I] flink在提交任务的时候报错 [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] closed issue #11823: flink在提交任务的时候报错 URL: https://github.com/apache/iceberg/issues/11823 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-m

Re: [I] flink在提交任务的时候报错 [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on issue #11823: URL: https://github.com/apache/iceberg/issues/11823#issuecomment-3094925295 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] Using the Struct type as the primary key in equalDelete operation will cause data reading errors. [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] commented on issue #11611: URL: https://github.com/apache/iceberg/issues/11611#issuecomment-3094925223 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache

Re: [I] Using the Struct type as the primary key in equalDelete operation will cause data reading errors. [iceberg]

2025-07-20 Thread via GitHub
github-actions[bot] closed issue #11611: Using the Struct type as the primary key in equalDelete operation will cause data reading errors. URL: https://github.com/apache/iceberg/issues/11611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] bug? `test_bodo_nan` in `tests/integration/test_reads.py` hangs locally [iceberg-python]

2025-07-20 Thread via GitHub
ehsantn commented on issue #2225: URL: https://github.com/apache/iceberg-python/issues/2225#issuecomment-3094866692 @kevinjqliu I can't reproduce the hang on my local Mac (Arm). I'm on latest main (`fb78904714e47e8ca1d281bc4a4796347faa3310`) and Python 3.12. Could you share more about your

[I] Feature request: support set snapshot property [iceberg-rust]

2025-07-20 Thread via GitHub
dentiny opened a new issue, #1533: URL: https://github.com/apache/iceberg-rust/issues/1533 ### Is your feature request related to a problem or challenge? A re-raise for https://github.com/apache/iceberg-rust/issues/1329. Previously I only add the ability to `FastAppendAction`, but i

Re: [PR] Add Column Name to the Error Message in StatsAggregator [iceberg-python]

2025-07-20 Thread via GitHub
james5418 commented on code in PR #2190: URL: https://github.com/apache/iceberg-python/pull/2190#discussion_r2217988988 ## pyiceberg/io/pyarrow.py: ## @@ -2405,7 +2407,7 @@ def data_file_statistics_from_parquet_metadata( if field_id not in col_aggs:

Re: [I] bug? `test_bodo_nan` in `tests/integration/test_reads.py` hangs locally [iceberg-python]

2025-07-20 Thread via GitHub
ehsantn commented on issue #2225: URL: https://github.com/apache/iceberg-python/issues/2225#issuecomment-3094837015 @kevinjqliu Thanks for opening the issue. Looking at it right now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] Use Iceberg-Rust for parsing the ManifestList and Manifests [iceberg-python]

2025-07-20 Thread via GitHub
yogevyuval commented on PR #2004: URL: https://github.com/apache/iceberg-python/pull/2004#issuecomment-3094818584 > @yogevyuval Thanks for asking, and yes, I do expect performance impact since just a part of the deserialization is cythonized. With this change, much more is pushed into Rust.

Re: [PR] Spark 4.0: Preserve row lineage information on compaction [iceberg]

2025-07-20 Thread via GitHub
amogh-jahagirdar commented on code in PR #13555: URL: https://github.com/apache/iceberg/pull/13555#discussion_r2217975460 ## spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/source/SparkWriteBuilder.java: ## @@ -120,12 +120,15 @@ public WriteBuilder overwrite(Filter[] fil

Re: [PR] Kafka Connect: Add option to fail connector task after max retries [iceberg]

2025-07-20 Thread via GitHub
dttung2905 commented on PR #13268: URL: https://github.com/apache/iceberg/pull/13268#issuecomment-3094794164 Hi @kevinjqliu Could you help to take a look at this PR as well ? :pray: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] feat (cli): Add Support CreateTableOpt with table properties, partition spec & sort order [iceberg-go]

2025-07-20 Thread via GitHub
kevinjqliu commented on code in PR #475: URL: https://github.com/apache/iceberg-go/pull/475#discussion_r2217942026 ## cmd/iceberg/main.go: ## @@ -83,7 +83,13 @@ Options: --description TEXT specify a description for the namespace --location-uri TEXT specify a loc

[I] docs: add a table for data type conversion between arrow and iceberg types [iceberg-python]

2025-07-20 Thread via GitHub
kevinjqliu opened a new issue, #2226: URL: https://github.com/apache/iceberg-python/issues/2226 ### Feature Request / Improvement inspired by https://shubhamg2404.medium.com/the-bridge-between-pyarrow-and-pyiceberg-a-deep-dive-into-data-type-conversions-957c72f8dd9e similar to

Re: [I] Consolidate catalog behavior [iceberg-python]

2025-07-20 Thread via GitHub
kevinjqliu commented on issue #813: URL: https://github.com/apache/iceberg-python/issues/813#issuecomment-3094736425 Got a good framework started in #2090 thanks to @.jayceslesar Now we can add more tests, more catalog types and maybe even remove some redundant tests -- This i

Re: [PR] maint: common catalog integration test suite [iceberg-python]

2025-07-20 Thread via GitHub
kevinjqliu commented on PR #2090: URL: https://github.com/apache/iceberg-python/pull/2090#issuecomment-3094735124 Thanks @jayceslesar for the PR and @Fokko for the review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] maint: common catalog integration test suite [iceberg-python]

2025-07-20 Thread via GitHub
kevinjqliu merged PR #2090: URL: https://github.com/apache/iceberg-python/pull/2090 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [I] How to get the snapshot id of a tag [iceberg-python]

2025-07-20 Thread via GitHub
kevinjqliu commented on issue #: URL: https://github.com/apache/iceberg-python/issues/#issuecomment-3094731631 > there is not api to get the snapshot_id from a given tag as @.jayceslesar mentioned, `Table` has `snapshot_by_name` which can take in a tag name. Something

Re: [PR] maint: common catalog integration test suite [iceberg-python]

2025-07-20 Thread via GitHub
kevinjqliu commented on PR #2090: URL: https://github.com/apache/iceberg-python/pull/2090#issuecomment-3094726907 ``` FAILED tests/integration/test_writes/test_writes.py::test_table_v1_with_null_nested_namespace - pyiceberg.exceptions.NoSuchNamespaceError: NoSuchNamespaceException: Canno

Re: [I] bug? `test_bodo_nan` in `tests/integration/test_reads.py` hangs locally [iceberg-python]

2025-07-20 Thread via GitHub
kevinjqliu commented on issue #2225: URL: https://github.com/apache/iceberg-python/issues/2225#issuecomment-3094726147 @ehsantn would you have any ideas? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[I] bug? `test_bodo_nan` in `tests/integration/test_reads.py` hangs locally [iceberg-python]

2025-07-20 Thread via GitHub
kevinjqliu opened a new issue, #2225: URL: https://github.com/apache/iceberg-python/issues/2225 ### Apache Iceberg version None ### Please describe the bug 🐞 Related to #2167 When im running integration tests locally on my laptop `make integration` it always ge

Re: [PR] maint: common catalog integration test suite [iceberg-python]

2025-07-20 Thread via GitHub
kevinjqliu commented on PR #2090: URL: https://github.com/apache/iceberg-python/pull/2090#issuecomment-3094717933 ``` - CATALOG_JDBC_STRICT__MODE=true ``` is also being fixed upstream in https://github.com/apache/iceberg/pull/13599 -- This is an automated message from th

Re: [PR] REST-Fixture: Ensure strict mode on jdbc catalog for rest fixture [iceberg]

2025-07-20 Thread via GitHub
kevinjqliu commented on PR #13599: URL: https://github.com/apache/iceberg/pull/13599#issuecomment-3094717105 With this change, tables can no longer be created without first creating its namespace in the `iceberg-rest-fixture` REST server. This is a change in default behavior. Before

Re: [PR] Spark 4.0, 3.5: Add configuration to disable executor cache for delete files [iceberg]

2025-07-20 Thread via GitHub
anuragmantri commented on PR #12893: URL: https://github.com/apache/iceberg/pull/12893#issuecomment-3094697650 This is ready for another review @RussellSpitzer. Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[PR] #1820 Add Geography/Geometry type [iceberg-python]

2025-07-20 Thread via GitHub
Gawaboumga opened a new pull request, #2224: URL: https://github.com/apache/iceberg-python/pull/2224 # Rationale for this change Iceberg V3 supports both Geography & Geometry types. # Are these changes tested? Not enough -- This is an automated message from the Apa

Re: [PR] feat: add schema conversion from avro `timestamp-millis` and `uuid` [iceberg-python]

2025-07-20 Thread via GitHub
matthias-Q commented on code in PR #2173: URL: https://github.com/apache/iceberg-python/pull/2173#discussion_r2217898870 ## pyiceberg/utils/schema_conversion.py: ## @@ -69,8 +69,10 @@ LOGICAL_FIELD_TYPE_MAPPING: Dict[Tuple[str, str], PrimitiveType] = { ("date", "int"): Dat

Re: [PR] Spark 4.0: Preserve row lineage information on compaction [iceberg]

2025-07-20 Thread via GitHub
amogh-jahagirdar commented on PR #13555: URL: https://github.com/apache/iceberg/pull/13555#issuecomment-3094657155 TestRewritePositionDeleteFilesAction > testRewriteManyColumns() has OOM'ed twice so far, it should be unrelated to this change but double checking -- This is an automated mes

Re: [I] How to get the snapshot id of a tag [iceberg-python]

2025-07-20 Thread via GitHub
ForeverAngry commented on issue #: URL: https://github.com/apache/iceberg-python/issues/#issuecomment-3094645983 @jayceslesar your thinking something like this, yeah? ```python def scan_by_tag( self, tag_name: str, row_filter: Union[str, BooleanExpressi

Re: [I] How to get the snapshot id of a tag [iceberg-python]

2025-07-20 Thread via GitHub
jayceslesar commented on issue #: URL: https://github.com/apache/iceberg-python/issues/#issuecomment-3094568485 Can we not get the `snapshot_id` via the `[table.refs()](https://github.com/apache/iceberg-python/blob/e9c025318787bfd34b98a3fc41544e0f168904ba/pyiceberg/table/__init__.py

Re: [I] Add Python 3.13 to the test matrix [iceberg-python]

2025-07-20 Thread via GitHub
jayceslesar commented on issue #1372: URL: https://github.com/apache/iceberg-python/issues/1372#issuecomment-3094521578 https://github.com/ray-project/ray/pull/54405 was merged and I am able to install ray in a fresh 3.13 venv with the following: 1. Raise the upper bound on ray in `p

Re: [PR] maint: common catalog integration test suite [iceberg-python]

2025-07-20 Thread via GitHub
jayceslesar commented on code in PR #2090: URL: https://github.com/apache/iceberg-python/pull/2090#discussion_r2217772161 ## tests/integration/test_catalog.py: ## @@ -0,0 +1,466 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agr

Re: [I] GlueCatalog + temporary AWS credentials (with session token) fails to authenticate (403 / signature mismatch) despite custom AwsClientFactory and S3FileIO [iceberg]

2025-07-20 Thread via GitHub
astarrr commented on issue #13597: URL: https://github.com/apache/iceberg/issues/13597#issuecomment-3094446099 Hi! Are you sure that AWS SDK picks these? `aws.accessKeyId` etc Can you try this configuration? ``` spark.conf.set("spark.sql.catalog..s3.access-key-id", acces

Re: [PR] REST-Fixture: Ensure strict mode on jdbc catalog for rest fixture [iceberg]

2025-07-20 Thread via GitHub
Fokko commented on code in PR #13599: URL: https://github.com/apache/iceberg/pull/13599#discussion_r2217762954 ## docker/iceberg-rest-fixture/Dockerfile: ## @@ -37,6 +37,7 @@ ENV CATALOG_CATALOG__IMPL=org.apache.iceberg.jdbc.JdbcCatalog ENV CATALOG_URI=jdbc:sqlite:/tmp/iceberg_

Re: [PR] maint: common catalog integration test suite [iceberg-python]

2025-07-20 Thread via GitHub
Fokko commented on code in PR #2090: URL: https://github.com/apache/iceberg-python/pull/2090#discussion_r2217762536 ## tests/integration/test_catalog.py: ## @@ -0,0 +1,466 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreement

Re: [PR] chore: expose default schema id [iceberg-rust]

2025-07-20 Thread via GitHub
liurenjie1024 merged PR #1526: URL: https://github.com/apache/iceberg-rust/pull/1526 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[PR] build(deps): bump the gomod_updates group with 16 updates [iceberg-go]

2025-07-20 Thread via GitHub
dependabot[bot] opened a new pull request, #490: URL: https://github.com/apache/iceberg-go/pull/490 Bumps the gomod_updates group with 16 updates: | Package | From | To | | --- | --- | --- | | [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) | `1.36.5` | `1.3

Re: [PR] Closing the ParquetWriter in the correct spot [iceberg]

2025-07-20 Thread via GitHub
ajantha-bhat commented on PR #13565: URL: https://github.com/apache/iceberg/pull/13565#issuecomment-3094340108 > @ajantha-bhat or @nastra , could you please have another look at the test? It's now focused on the ParquetWriter, without all the wrapping classes. Also, a ticket in parquet-ja

Re: [I] Question: Intergration Plan/Solution for Lance with Iceberg [iceberg]

2025-07-20 Thread via GitHub
littleDrew commented on issue #13438: URL: https://github.com/apache/iceberg/issues/13438#issuecomment-3094323984 Hi @pvary, these 3 needed steps, it seems that: step 1 you have done, and **step 3 seems need to be discuss by iceberg community member, does there existed a planed discussion m