[PR] build(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.73.2 to 1.74.1 [iceberg-go]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #271: URL: https://github.com/apache/iceberg-go/pull/271 Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.73.2 to 1.74.1. Commits https://github.com/aws/aws-sdk-go-v2/commit/676a8b1bf0174c87

Re: [PR] feat(puffin): Add PuffinReader [iceberg-rust]

2025-01-26 Thread via GitHub
fqaiser94 commented on code in PR #892: URL: https://github.com/apache/iceberg-rust/pull/892#discussion_r1929789733 ## crates/iceberg/src/puffin/reader.rs: ## @@ -0,0 +1,126 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreeme

Re: [I] `partial-progress.max-failed-commits` Incorrectly compare the failureCommit value [iceberg]

2025-01-26 Thread via GitHub
manuzhang commented on issue #12076: URL: https://github.com/apache/iceberg/issues/12076#issuecomment-2614450507 @ruotianwang Are you referring to the case where there are fewer commits than maxCommits due to file group rewrite failure? ```java int groupsPerCommit = IntMath.divide

Re: [PR] Spark 3.5: Always use '/' in RewriteTablePath [iceberg]

2025-01-26 Thread via GitHub
manuzhang commented on PR #12066: URL: https://github.com/apache/iceberg/pull/12066#issuecomment-2614458369 @szehon-ho @RussellSpitzer I'm doing the opposite now, replacing previous use of `File.Separator`. Please help review again. Thanks. -- This is an automated message from the Apache

Re: [PR] Log exception when FileIO import fails [iceberg-python]

2025-01-26 Thread via GitHub
rshkv commented on PR #1578: URL: https://github.com/apache/iceberg-python/pull/1578#issuecomment-2614539396 Updated the warnings for location providers and custom catalogs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Update cmake instructions in README [iceberg-cpp]

2025-01-26 Thread via GitHub
zuyu closed pull request #24: Update cmake instructions in README URL: https://github.com/apache/iceberg-cpp/pull/24 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [I] Support for timestamp downcasting when loading data to iceberg tables [iceberg-python]

2025-01-26 Thread via GitHub
fusion commented on issue #1045: URL: https://github.com/apache/iceberg-python/issues/1045#issuecomment-2614600767 At this point I looked on code 4 hours about how to adjust unit test mentioned by @kevinjqliu. But code is so complicated and it is hard to navigate for a newcomer.

Re: [PR] Core: Check referencedDataFile existence for DV [iceberg]

2025-01-26 Thread via GitHub
ebyhr commented on code in PR #12088: URL: https://github.com/apache/iceberg/pull/12088#discussion_r1929470728 ## core/src/main/java/org/apache/iceberg/FileMetadata.java: ## @@ -255,6 +255,8 @@ public DeleteFile build() { if (format == FileFormat.PUFFIN) { Precon

Re: [PR] Enable pyiceberg.table.Table.add_files ns downcasting [iceberg-python]

2025-01-26 Thread via GitHub
fusion commented on PR #1572: URL: https://github.com/apache/iceberg-python/pull/1572#issuecomment-2614604023 I am a bit stucked... There is a warning shown in a code, but I have no idea what is the rationale behind it. Some advice from more experienced contributor would be appreciated.

[PR] [docs] Link community contributing guidelines [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu opened a new pull request, #1579: URL: https://github.com/apache/iceberg-python/pull/1579 Closes #970 This PR links community guideline on contribution, https://iceberg.apache.org/contribute/ ![Screenshot 2025-01-26 at 1 47 41  PM](https://github.com/user-attachments

Re: [PR] Spec: Adds in missing ChangeLog metadata columns - Reassigns Row Line… [iceberg]

2025-01-26 Thread via GitHub
stevenzwu commented on code in PR #12100: URL: https://github.com/apache/iceberg/pull/12100#discussion_r1929891571 ## format/spec.md: ## @@ -337,8 +337,11 @@ The set of metadata columns is: | **`2147483546 file_path`** | `string` | Path of a file, used in position-b

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r1929893856 ## src/iceberg/type.h: ## @@ -0,0 +1,411 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOT

Re: [I] [DISCUSS] Columnar data protocol: Arrow or implement a new one? [iceberg-cpp]

2025-01-26 Thread via GitHub
zeroshade commented on issue #33: URL: https://github.com/apache/iceberg-cpp/issues/33#issuecomment-2614633919 It also may make sense to consider leveraging the [Async C API](https://arrow.apache.org/docs/format/CDeviceDataInterface.html#async-device-stream-interface) In some potential APIs

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r1929894113 ## src/iceberg/type.h: ## @@ -0,0 +1,411 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOT

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r192989 ## src/iceberg/type.cc: ## @@ -0,0 +1,314 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NO

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r1929895464 ## src/iceberg/type.cc: ## @@ -0,0 +1,314 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NO

Re: [I] [DISCUSS] Columnar data protocol: Arrow or implement a new one? [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on issue #33: URL: https://github.com/apache/iceberg-cpp/issues/33#issuecomment-2614633063 > EDIT: perhaps we need to include `--with-device` to `ci/scripts/bundle.py --with-device --cpp --symbol-namespace=iceberg --output-dir /tmp/bundled` if we need to consider GPU? [@l

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r1929895510 ## src/iceberg/type.cc: ## @@ -0,0 +1,314 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NO

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r1929896367 ## src/iceberg/type_fwd.h: ## @@ -0,0 +1,85 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r1929897727 ## src/iceberg/schema.h: ## @@ -0,0 +1,64 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NO

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r1929898199 ## src/iceberg/type.cc: ## @@ -0,0 +1,314 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NO

Re: [I] [DISCUSS] Columnar data protocol: Arrow or implement a new one? [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on issue #33: URL: https://github.com/apache/iceberg-cpp/issues/33#issuecomment-2614644727 If the core library itself does not do I/O then we can avoid the need to have async/sync copies of everything, IMO (the app would do async I/O then call out to iceberg-core to do th

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r1929897710 ## src/iceberg/type.cc: ## @@ -0,0 +1,314 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NO

Re: [PR] backport c++23 std::expected [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #40: URL: https://github.com/apache/iceberg-cpp/pull/40#discussion_r1929899791 ## src/iceberg/expected.h: ## @@ -0,0 +1,2332 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See th

Re: [PR] Spark: Adding simple custom partition sort order option to RewriteManifests Spark Action [iceberg]

2025-01-26 Thread via GitHub
github-actions[bot] commented on PR #9731: URL: https://github.com/apache/iceberg/pull/9731#issuecomment-2614650005 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Adding new rewrite manifest spark action to accept custom partition o… [iceberg]

2025-01-26 Thread via GitHub
github-actions[bot] commented on PR #11881: URL: https://github.com/apache/iceberg/pull/11881#issuecomment-2614650165 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] API, Core: Support keeping at most N snapshots in ExpireSnapshots [iceberg]

2025-01-26 Thread via GitHub
github-actions[bot] commented on PR #11879: URL: https://github.com/apache/iceberg/pull/11879#issuecomment-2614650146 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Core: Reset to main as part of replace shouldn't remove main ref [iceberg]

2025-01-26 Thread via GitHub
github-actions[bot] closed pull request #11819: Core: Reset to main as part of replace shouldn't remove main ref URL: https://github.com/apache/iceberg/pull/11819 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] Core: check catalog and schema for JdbcCatalog initialization [iceberg]

2025-01-26 Thread via GitHub
github-actions[bot] commented on PR #11864: URL: https://github.com/apache/iceberg/pull/11864#issuecomment-2614650140 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pul

Re: [PR] Core: Reset to main as part of replace shouldn't remove main ref [iceberg]

2025-01-26 Thread via GitHub
github-actions[bot] commented on PR #11819: URL: https://github.com/apache/iceberg/pull/11819#issuecomment-2614650126 This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If

Re: [I] Accessing S3 Express one zone bucket from pyiceberg [iceberg-python]

2025-01-26 Thread via GitHub
github-actions[bot] closed issue #928: Accessing S3 Express one zone bucket from pyiceberg URL: https://github.com/apache/iceberg-python/issues/928 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Auth Manager API part 5: SigV4 Auth Manager [iceberg]

2025-01-26 Thread via GitHub
jbonofre commented on PR #11995: URL: https://github.com/apache/iceberg/pull/11995#issuecomment-2614277137 The flink test failure seems unrelated. I will try to trigger a new run. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] Log exception when FileIO import fails [iceberg-python]

2025-01-26 Thread via GitHub
rshkv commented on code in PR #1578: URL: https://github.com/apache/iceberg-python/pull/1578#discussion_r1929836366 ## tests/io/test_io.py: ## @@ -281,6 +282,11 @@ def test_import_file_io_does_not_exist() -> None: assert _import_file_io("pyiceberg.does.not.exist.FileIO", {}

Re: [I] KeyError raised when calling inspect.entries() [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu closed issue #1574: KeyError raised when calling inspect.entries() URL: https://github.com/apache/iceberg-python/issues/1574 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [I] KeyError raised when calling inspect.entries() [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu closed issue #1574: KeyError raised when calling inspect.entries() URL: https://github.com/apache/iceberg-python/issues/1574 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Return an empty dict if nan values is not provided by the catalog [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu merged PR #1575: URL: https://github.com/apache/iceberg-python/pull/1575 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [I] Support for timestamp downcasting when loading data to iceberg tables [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu commented on issue #1045: URL: https://github.com/apache/iceberg-python/issues/1045#issuecomment-2614533976 hey folks, looks like there are currently 2 open PR on this issue * #1569 * #1572 Let's standardize on one of them and add a test case (see my comment [here](h

Re: [PR] REST: AuthManager API [iceberg]

2025-01-26 Thread via GitHub
ebyhr commented on PR #10753: URL: https://github.com/apache/iceberg/pull/10753#issuecomment-2614594328 How about removing this PR from [1.8.0 milestone](https://github.com/apache/iceberg/milestone/50?closed=1) since it was closed without merge? -- This is an automated message from the

Re: [I] Overwrite with Filter Conditions Example - Large Amount of Filter Conditions [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu commented on issue #1571: URL: https://github.com/apache/iceberg-python/issues/1571#issuecomment-2614599557 > I'm using this code to build out the filter_condition, then assigning that to overwrite_filter. What I've noticed is that if I have 1000 records, I'm hitting a maximum r

Re: [PR] Core: Add missing REST endpoint definitions [iceberg]

2025-01-26 Thread via GitHub
ebyhr commented on PR #11756: URL: https://github.com/apache/iceberg/pull/11756#issuecomment-2614600635 This PR seems troublesome because it prevents other query engines from upgrading to 1.8.0 if they have tests with older versions. For instance, Trino can't upgrade to this version because

Re: [I] BaseCommitService consumes 100% CPU when idle [iceberg]

2025-01-26 Thread via GitHub
lliangyu-lin commented on issue #12086: URL: https://github.com/apache/iceberg/issues/12086#issuecomment-2614589247 I feel one potential approach to address this could be using ```BlockingQueue```, which allows the commit service thread to sleep until new work is offered in the ```completed

Re: [I] Accessing S3 Express one zone bucket from pyiceberg [iceberg-python]

2025-01-26 Thread via GitHub
github-actions[bot] commented on issue #928: URL: https://github.com/apache/iceberg-python/issues/928#issuecomment-2614651523 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apac

Re: [PR] Spark 3.4: Backport Spark actions and procedures for RewriteTablePath [iceberg]

2025-01-26 Thread via GitHub
amogh-jahagirdar merged PR #12111: URL: https://github.com/apache/iceberg/pull/12111 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [PR] Spark 3.4: Backport Spark actions and procedures for RewriteTablePath [iceberg]

2025-01-26 Thread via GitHub
dramaticlly commented on PR #12111: URL: https://github.com/apache/iceberg/pull/12111#issuecomment-2614682439 Thank you @amogh-jahagirdar for reviewing! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[I] [CI] use version 19 of clang-tools in cpp-linter-action [iceberg-cpp]

2025-01-26 Thread via GitHub
zhjwpku opened a new issue, #41: URL: https://github.com/apache/iceberg-cpp/issues/41 cpp-linter-action use version 14 clang-tools by default [0], while working on #40, cpp-linter-action complains about the format, I use clang-format@19 on my mac(installed by brew install clang-format), so

Re: [PR] Log exception when FileIO import fails [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu commented on code in PR #1578: URL: https://github.com/apache/iceberg-python/pull/1578#discussion_r1929821411 ## pyiceberg/io/__init__.py: ## @@ -316,7 +316,7 @@ def _import_file_io(io_impl: str, properties: Properties) -> Optional[FileIO]: class_ = getattr(

Re: [PR] chore(deps): Bump uuid from 1.12.0 to 1.12.1 [iceberg-rust]

2025-01-26 Thread via GitHub
liurenjie1024 merged PR #913: URL: https://github.com/apache/iceberg-rust/pull/913 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ic

Re: [PR] chore(deps): Bump aws-sdk-s3tables from 1.4.0 to 1.6.0 [iceberg-rust]

2025-01-26 Thread via GitHub
liurenjie1024 merged PR #912: URL: https://github.com/apache/iceberg-rust/pull/912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ic

Re: [PR] backport c++23 std::expected [iceberg-cpp]

2025-01-26 Thread via GitHub
zhjwpku commented on code in PR #40: URL: https://github.com/apache/iceberg-cpp/pull/40#discussion_r1929955037 ## src/iceberg/expected.h: ## @@ -0,0 +1,2332 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the

Re: [PR] Add data type/schema field/schema [iceberg-cpp]

2025-01-26 Thread via GitHub
zhjwpku commented on code in PR #31: URL: https://github.com/apache/iceberg-cpp/pull/31#discussion_r1929955889 ## src/iceberg/type.h: ## @@ -0,0 +1,411 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTI

Re: [PR] Spark : Derive Stats From Manifest on the Fly [iceberg]

2025-01-26 Thread via GitHub
jeesou commented on PR #11615: URL: https://github.com/apache/iceberg/pull/11615#issuecomment-2614906052 HI @huaxingao , @RussellSpitzer, kindly have a look at the PR and suggest any update if there. -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [PR] Use Snapshot's statistics file in SparkScan [iceberg]

2025-01-26 Thread via GitHub
jeesou commented on code in PR #11040: URL: https://github.com/apache/iceberg/pull/11040#discussion_r1930017945 ## api/src/main/java/org/apache/iceberg/Table.java: ## @@ -373,4 +374,14 @@ default Snapshot snapshot(String name) { return null; } + + /** + * Returns th

Re: [PR] Spark : Derive Stats From Manifest on the Fly [iceberg]

2025-01-26 Thread via GitHub
huaxingao commented on PR #11615: URL: https://github.com/apache/iceberg/pull/11615#issuecomment-2615031769 Sorry, I've been really busy recently. I'll try to take a look soon. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [I] [DISCUSS] Exceptions vs status codes [iceberg-cpp]

2025-01-26 Thread via GitHub
zhjwpku commented on issue #14: URL: https://github.com/apache/iceberg-cpp/issues/14#issuecomment-2614827285 I've create a PR #40 to backport std::expected, I'm looking forward to hearing all of your feedback. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] backport c++23 std::expected [iceberg-cpp]

2025-01-26 Thread via GitHub
lidavidm commented on code in PR #40: URL: https://github.com/apache/iceberg-cpp/pull/40#discussion_r1929975364 ## src/iceberg/expected.h: ## @@ -0,0 +1,2332 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See th

Re: [PR] Reduce 'Scanning table' log verbosity for long IN list [iceberg]

2025-01-26 Thread via GitHub
raunaqmorarka commented on code in PR #5908: URL: https://github.com/apache/iceberg/pull/5908#discussion_r1930020478 ## api/src/main/java/org/apache/iceberg/expressions/ExpressionUtil.java: ## @@ -258,6 +270,23 @@ public String predicate(UnboundPredicate pred) { } } +

Re: [PR] update PartitionSpec with snapshot'schema [iceberg]

2025-01-26 Thread via GitHub
pvary commented on PR #11196: URL: https://github.com/apache/iceberg/pull/11196#issuecomment-2614939708 @lurnagao-dahua: Could you please link the dev list discussion? Were there any comments on your message? -- This is an automated message from the Apache Git Service. To respond to the m

Re: [PR] Spec: Update partition stats for V3 [iceberg]

2025-01-26 Thread via GitHub
ajantha-bhat commented on code in PR #12098: URL: https://github.com/apache/iceberg/pull/12098#discussion_r1929579528 ## format/spec.md: ## @@ -927,20 +927,21 @@ These rows must be sorted (in ascending manner with NULL FIRST) by `partition` f The schema of the partition stat

Re: [PR] Spark 3.4: Backport Spark actions and procedures for RewriteTablePath [iceberg]

2025-01-26 Thread via GitHub
amogh-jahagirdar commented on code in PR #12111: URL: https://github.com/apache/iceberg/pull/12111#discussion_r1929803827 ## spark/v3.4/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteTablePathsAction.java: ## @@ -0,0 +1,1081 @@ +/* + * Licensed to the Apache Sof

[PR] build(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.17.54 to 1.17.55 [iceberg-go]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #272: URL: https://github.com/apache/iceberg-go/pull/272 Bumps [github.com/aws/aws-sdk-go-v2/credentials](https://github.com/aws/aws-sdk-go-v2) from 1.17.54 to 1.17.55. Commits https://github.com/aws/aws-sdk-go-v2/commit/676a8b1bf0174

[PR] build(deps): bump github.com/substrait-io/substrait-go/v3 from 3.2.1 to 3.5.0 [iceberg-go]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #273: URL: https://github.com/apache/iceberg-go/pull/273 Bumps [github.com/substrait-io/substrait-go/v3](https://github.com/substrait-io/substrait-go) from 3.2.1 to 3.5.0. Release notes Sourced from https://github.com/substrait-io/substra

Re: [PR] Log exception when FileIO import fails [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu commented on code in PR #1578: URL: https://github.com/apache/iceberg-python/pull/1578#discussion_r1929839265 ## tests/io/test_io.py: ## @@ -281,6 +282,11 @@ def test_import_file_io_does_not_exist() -> None: assert _import_file_io("pyiceberg.does.not.exist.FileIO

Re: [PR] refactor(catalog): restructure catalog package [iceberg-go]

2025-01-26 Thread via GitHub
zeroshade merged PR #266: URL: https://github.com/apache/iceberg-go/pull/266 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [PR] build(deps): bump github.com/substrait-io/substrait-go/v3 from 3.2.1 to 3.5.0 [iceberg-go]

2025-01-26 Thread via GitHub
zeroshade merged PR #273: URL: https://github.com/apache/iceberg-go/pull/273 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.73.2 to 1.74.1 [iceberg-go]

2025-01-26 Thread via GitHub
zeroshade merged PR #271: URL: https://github.com/apache/iceberg-go/pull/271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2 from 1.33.0 to 1.34.0 [iceberg-go]

2025-01-26 Thread via GitHub
dependabot[bot] commented on PR #269: URL: https://github.com/apache/iceberg-go/pull/269#issuecomment-2614561258 Looks like github.com/aws/aws-sdk-go-v2 is up-to-date now, so this is no longer needed. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] Spec: Adds in missing ChangeLog metadata columns - Reassigns Row Line… [iceberg]

2025-01-26 Thread via GitHub
aokolnychyi commented on code in PR #12100: URL: https://github.com/apache/iceberg/pull/12100#discussion_r1929856814 ## format/spec.md: ## @@ -337,8 +337,11 @@ The set of metadata columns is: | **`2147483546 file_path`** | `string` | Path of a file, used in position

Re: [PR] Log exception when FileIO import fails [iceberg-python]

2025-01-26 Thread via GitHub
rshkv commented on code in PR #1578: URL: https://github.com/apache/iceberg-python/pull/1578#discussion_r1929846312 ## tests/io/test_io.py: ## @@ -281,6 +282,11 @@ def test_import_file_io_does_not_exist() -> None: assert _import_file_io("pyiceberg.does.not.exist.FileIO", {}

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2 from 1.33.0 to 1.34.0 [iceberg-go]

2025-01-26 Thread via GitHub
dependabot[bot] closed pull request #269: build(deps): bump github.com/aws/aws-sdk-go-v2 from 1.33.0 to 1.34.0 URL: https://github.com/apache/iceberg-go/pull/269 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] build(deps): bump google.golang.org/api from 0.217.0 to 0.218.0 [iceberg-go]

2025-01-26 Thread via GitHub
zeroshade merged PR #270: URL: https://github.com/apache/iceberg-go/pull/270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.17.54 to 1.17.55 [iceberg-go]

2025-01-26 Thread via GitHub
zeroshade merged PR #272: URL: https://github.com/apache/iceberg-go/pull/272 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [I] Log exception when FileIO import fails [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu closed issue #1577: Log exception when FileIO import fails URL: https://github.com/apache/iceberg-python/issues/1577 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Log exception when FileIO import fails [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu merged PR #1578: URL: https://github.com/apache/iceberg-python/pull/1578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@i

Re: [I] Log exception when FileIO import fails [iceberg-python]

2025-01-26 Thread via GitHub
kevinjqliu closed issue #1577: Log exception when FileIO import fails URL: https://github.com/apache/iceberg-python/issues/1577 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] Log exception when FileIO import fails [iceberg-python]

2025-01-26 Thread via GitHub
rshkv opened a new pull request, #1578: URL: https://github.com/apache/iceberg-python/pull/1578 Closes #1577. Log the underlying exception when a FileIO import fails. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] build(deps): bump github.com/aws/aws-sdk-go-v2 from 1.33.0 to 1.34.0 [iceberg-go]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #269: URL: https://github.com/apache/iceberg-go/pull/269 Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) from 1.33.0 to 1.34.0. Commits https://github.com/aws/aws-sdk-go-v2/commit/676a8b1bf0174c8763e19d99b68b

[PR] build(deps): bump google.golang.org/api from 0.217.0 to 0.218.0 [iceberg-go]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #270: URL: https://github.com/apache/iceberg-go/pull/270 Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.217.0 to 0.218.0. Release notes Sourced from https://github.com/googleapis/google-api-go-cli

[PR] chore(deps): Bump aws-sdk-s3tables from 1.4.0 to 1.6.0 [iceberg-rust]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #912: URL: https://github.com/apache/iceberg-rust/pull/912 Bumps [aws-sdk-s3tables](https://github.com/awslabs/aws-sdk-rust) from 1.4.0 to 1.6.0. Commits See full diff in https://github.com/awslabs/aws-sdk-rust/commits";>compare view

[PR] chore(deps): Bump uuid from 1.12.0 to 1.12.1 [iceberg-rust]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #913: URL: https://github.com/apache/iceberg-rust/pull/913 Bumps [uuid](https://github.com/uuid-rs/uuid) from 1.12.0 to 1.12.1. Release notes Sourced from https://github.com/uuid-rs/uuid/releases";>uuid's releases. 1.12.1 What's C

[PR] chore(deps): Bump arrow-array from 53.3.0 to 53.4.0 [iceberg-rust]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #915: URL: https://github.com/apache/iceberg-rust/pull/915 Bumps [arrow-array](https://github.com/apache/arrow-rs) from 53.3.0 to 53.4.0. Changelog Sourced from https://github.com/apache/arrow-rs/blob/main/CHANGELOG-old.md";>arrow-array's

[PR] chore(deps): Bump aws-sdk-glue from 1.76.0 to 1.79.0 [iceberg-rust]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #916: URL: https://github.com/apache/iceberg-rust/pull/916 Bumps [aws-sdk-glue](https://github.com/awslabs/aws-sdk-rust) from 1.76.0 to 1.79.0. Commits See full diff in https://github.com/awslabs/aws-sdk-rust/commits";>compare view

[PR] chore(deps): Bump aws-config from 1.5.13 to 1.5.15 [iceberg-rust]

2025-01-26 Thread via GitHub
dependabot[bot] opened a new pull request, #914: URL: https://github.com/apache/iceberg-rust/pull/914 Bumps [aws-config](https://github.com/smithy-lang/smithy-rs) from 1.5.13 to 1.5.15. Commits See full diff in https://github.com/smithy-lang/smithy-rs/commits";>compare view

[PR] backport c++23 std::expected [iceberg-cpp]

2025-01-26 Thread via GitHub
zhjwpku opened a new pull request, #40: URL: https://github.com/apache/iceberg-cpp/pull/40 After studied [0], [1] and [2], I'm inclined to backport [0] to iceberg-cpp, the main reason is that [0] has exactly the same APIs as std::expected, [1] provide some extra member functions like `map`