Re: [PR] Spec: Clarify multi-arg transform behavior for different versions [iceberg]

2024-02-06 Thread via GitHub
szehon-ho commented on code in PR #9661: URL: https://github.com/apache/iceberg/pull/9661#discussion_r1481028685 ## format/spec.md: ## @@ -1130,14 +1140,11 @@ Each partition field in the fields list is stored as an object. See the table fo |**`hour`**|`JSON string: "hour"`|`"h

Re: [PR] Website: Add release schedule on the releases page [iceberg]

2024-02-06 Thread via GitHub
ajantha-bhat commented on code in PR #9666: URL: https://github.com/apache/iceberg/pull/9666#discussion_r1481007795 ## site/docs/releases.md: ## @@ -77,6 +77,15 @@ Apache Iceberg 1.4.3 was released on December 27, 2023. The main issue it solves - Core: Expired Snapshot files i

[PR] Centralized table properties management [iceberg-python]

2024-02-06 Thread via GitHub
HonahX opened a new pull request, #388: URL: https://github.com/apache/iceberg-python/pull/388 Fixes #365 My initial plan was to add the names and defaults of all table properties. However, upon further consideration, I think it may be better to add properties as needed. -- This

Re: [PR] Spark: Handle concurrently dropped view during CREATE OR REPLACE [iceberg]

2024-02-06 Thread via GitHub
nastra merged PR #9623: URL: https://github.com/apache/iceberg/pull/9623 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

Re: [PR] Spark: Handle concurrently dropped view during CREATE OR REPLACE [iceberg]

2024-02-06 Thread via GitHub
nastra commented on PR #9623: URL: https://github.com/apache/iceberg/pull/9623#issuecomment-1931442034 Thanks for reviewing @amogh-jahagirdar -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Build: Bump com.azure:azure-sdk-bom from 1.2.18 to 1.2.20 [iceberg]

2024-02-06 Thread via GitHub
Fokko commented on PR #9571: URL: https://github.com/apache/iceberg/pull/9571#issuecomment-1931424443 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Bump Azurite container [iceberg]

2024-02-06 Thread via GitHub
nastra merged PR #9668: URL: https://github.com/apache/iceberg/pull/9668 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

Re: [I] Allow non-stringly typed table properties [iceberg-python]

2024-02-06 Thread via GitHub
Fokko commented on issue #376: URL: https://github.com/apache/iceberg-python/issues/376#issuecomment-1931421594 @jonashaag Ahh, thanks, it already felt like I was missing a piece. We should accept everything that can coerce into a string. I like to follow the idea of being liberal in what y

Re: [PR] Spark: Move the Writer to a visitor [iceberg]

2024-02-06 Thread via GitHub
Fokko merged PR #9440: URL: https://github.com/apache/iceberg/pull/9440 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apach

[PR] Aliyun: Add security token to OSS client properties [iceberg]

2024-02-06 Thread via GitHub
wgtmac opened a new pull request, #9671: URL: https://github.com/apache/iceberg/pull/9671 Currently the default DefaultAliyunClientFactory requires users to pass AccessKey pair to have access to OSS. However, in many cases organizations use Security Token Service (STS) to generate temporary

Re: [I] Allow non-stringly typed table properties [iceberg-python]

2024-02-06 Thread via GitHub
jonashaag commented on issue #376: URL: https://github.com/apache/iceberg-python/issues/376#issuecomment-1931409952 > convert them to a string The code you are showing converts them *from* a string. I meant the other end: ``` create_table(..., properties={"write.parque

Re: [I] Allow non-stringly typed table properties [iceberg-python]

2024-02-06 Thread via GitHub
Fokko commented on issue #376: URL: https://github.com/apache/iceberg-python/issues/376#issuecomment-1931406963 Yes, that's what we are doing here: https://github.com/apache/iceberg-python/blob/853a77c5d24280a1048ebcef9a9bfe0cedb642ca/pyiceberg/io/pyarrow.py#L1766-L1773 > It is

Re: [PR] Build: Bump pydantic from 2.6.0 to 2.6.1 [iceberg-python]

2024-02-06 Thread via GitHub
Fokko merged PR #386: URL: https://github.com/apache/iceberg-python/pull/386 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [I] Allow non-stringly typed table properties [iceberg-python]

2024-02-06 Thread via GitHub
jonashaag commented on issue #376: URL: https://github.com/apache/iceberg-python/issues/376#issuecomment-1931400715 Do you think we should automatically convert them to a string if safe? It is just really awkward to set eg the compression level as a string -- This is an automated message

Re: [PR] Build: Bump boto3 from 1.34.27 to 1.34.34 [iceberg-python]

2024-02-06 Thread via GitHub
Fokko merged PR #385: URL: https://github.com/apache/iceberg-python/pull/385 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

[PR] [WIP] Migrate Write sub-classes in spark-extensions to JUnit5 and AsserJ style [iceberg]

2024-02-06 Thread via GitHub
tomtongue opened a new pull request, #9670: URL: https://github.com/apache/iceberg/pull/9670 Migrate the following "Write" sub-classes in spark-extensions to JUnit 5 and AssertJ style along with https://github.com/apache/iceberg/pull/9613, and https://github.com/apache/iceberg/issues/9086.

Re: [PR] Docs: Add/Update Snowflake docs to new docs site [iceberg]

2024-02-06 Thread via GitHub
scottteal commented on PR #9557: URL: https://github.com/apache/iceberg/pull/9557#issuecomment-1931358065 @bitsondatadev doesn't look like this PR made it into the docs switch. I submitted a new PR editing the correct files post-switch #9669 -- This is an automated message from the Apach

[PR] Docs: Add/update Snowflake [iceberg]

2024-02-06 Thread via GitHub
scottteal opened a new pull request, #9669: URL: https://github.com/apache/iceberg/pull/9669 My last pull request wasn't merged before docs were switched, so submitting this one editing the correct files post-switch Old PR: #9557 FYI @bitsondatadev -- This is an automated

Re: [PR] Hive: Refactor hive-table commit operation to be used for other operations like view [iceberg]

2024-02-06 Thread via GitHub
nk1506 commented on code in PR #9461: URL: https://github.com/apache/iceberg/pull/9461#discussion_r1480936905 ## core/src/main/java/org/apache/iceberg/util/MetastoreOperationsUtil.java: ## @@ -0,0 +1,113 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * o

Re: [PR] Hive: Refactor hive-table commit operation to be used for other operations like view [iceberg]

2024-02-06 Thread via GitHub
nk1506 commented on code in PR #9461: URL: https://github.com/apache/iceberg/pull/9461#discussion_r1480936118 ## core/src/main/java/org/apache/iceberg/BaseMetastoreOperations.java: ## @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or mor

Re: [PR] Docs: Add/Update Snowflake docs to new docs site [iceberg]

2024-02-06 Thread via GitHub
scottteal closed pull request #9557: Docs: Add/Update Snowflake docs to new docs site URL: https://github.com/apache/iceberg/pull/9557 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [I] duckdb don't seems to read the iceberg table [iceberg-python]

2024-02-06 Thread via GitHub
Fokko commented on issue #387: URL: https://github.com/apache/iceberg-python/issues/387#issuecomment-1931335871 Thanks for reporting this, including an example. It looks like there is an issue with the local URI's. Let me dig into this right away! -- This is an automated message from the

Re: [PR] Build: Bump boto3 from 1.34.27 to 1.34.34 [iceberg-python]

2024-02-06 Thread via GitHub
Fokko commented on PR #385: URL: https://github.com/apache/iceberg-python/pull/385#issuecomment-1931307824 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Build: Bump pydantic from 2.6.0 to 2.6.1 [iceberg-python]

2024-02-06 Thread via GitHub
Fokko commented on PR #386: URL: https://github.com/apache/iceberg-python/pull/386#issuecomment-1931308007 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Build: Bump ray from 2.7.2 to 2.9.2 [iceberg-python]

2024-02-06 Thread via GitHub
Fokko merged PR #384: URL: https://github.com/apache/iceberg-python/pull/384 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [PR] feat: Bump version 0.2.0 to prepare for release. [iceberg-rust]

2024-02-06 Thread via GitHub
Xuanwo commented on PR #181: URL: https://github.com/apache/iceberg-rust/pull/181#issuecomment-1931274760 > It would be better not to bump release version on main branch. All following commits (snapshot version) will carry this release version. It's okay for the rust ecosystem that we

Re: [PR] feat: Bump version 0.2.0 to prepare for release. [iceberg-rust]

2024-02-06 Thread via GitHub
manuzhang commented on PR #181: URL: https://github.com/apache/iceberg-rust/pull/181#issuecomment-1931257984 It would be better not to bump release version on main branch. All following commits (snapshot version) will carry this release version. -- This is an automated message from the Ap

[I] duckdb don't seems to read the iceberg table [iceberg-python]

2024-02-06 Thread via GitHub
djouallah opened a new issue, #387: URL: https://github.com/apache/iceberg-python/issues/387 ### Apache Iceberg version main (development) ### Please describe the bug 🐞 ok, I generated some data using the new release which is a fantastic works , but duckdb don't seems to

Re: [PR] Spec: Clarify multi-arg transform behavior for different versions [iceberg]

2024-02-06 Thread via GitHub
advancedxy commented on code in PR #9661: URL: https://github.com/apache/iceberg/pull/9661#discussion_r1480822510 ## format/spec.md: ## @@ -1130,14 +1140,11 @@ Each partition field in the fields list is stored as an object. See the table fo |**`hour`**|`JSON string: "hour"`|`"

Re: [PR] Spec: Clarify multi-arg transform behavior for different versions [iceberg]

2024-02-06 Thread via GitHub
advancedxy commented on code in PR #9661: URL: https://github.com/apache/iceberg/pull/9661#discussion_r1480813301 ## format/spec.md: ## @@ -1117,7 +1117,17 @@ Partition specs are serialized as a JSON object with the following fields: |**`spec-id`**|`JSON int`|`0`| |**`fields`

Re: [PR] Build: Bump io.delta:delta-standalone_2.12 from 0.6.0 to 3.1.0 [iceberg]

2024-02-06 Thread via GitHub
HonahX merged PR #9636: URL: https://github.com/apache/iceberg/pull/9636 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

Re: [I] support partition spec update in pyiceberg [iceberg-python]

2024-02-06 Thread via GitHub
syun64 commented on issue #124: URL: https://github.com/apache/iceberg-python/issues/124#issuecomment-1931105967 Duplicate of https://github.com/apache/iceberg-python/issues/193 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] support partition spec update in pyiceberg [iceberg-python]

2024-02-06 Thread via GitHub
syun64 closed issue #124: support partition spec update in pyiceberg URL: https://github.com/apache/iceberg-python/issues/124 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Add support for writing `large_string` and `int16` [iceberg-python]

2024-02-06 Thread via GitHub
syun64 commented on issue #378: URL: https://github.com/apache/iceberg-python/issues/378#issuecomment-1931096455 > I have a locally patched version that simply maps `large_string` to `string` but I got problems with batches > 2 GiB. Not sure if that's related. I'm now forcing batches to be

Re: [PR] Add `syun64` as collaborator [iceberg-python]

2024-02-06 Thread via GitHub
HonahX merged PR #383: URL: https://github.com/apache/iceberg-python/pull/383 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] Build: Bump io.delta:delta-standalone_2.12 from 0.6.0 to 3.1.0 [iceberg]

2024-02-06 Thread via GitHub
HonahX commented on PR #9636: URL: https://github.com/apache/iceberg/pull/9636#issuecomment-1931083432 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Build: Bump io.delta:delta-spark_2.12 from 3.0.0 to 3.1.0 [iceberg]

2024-02-06 Thread via GitHub
HonahX merged PR #9631: URL: https://github.com/apache/iceberg/pull/9631 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

Re: [PR] Support usage of Separate OIDC Authorization Server URI [iceberg]

2024-02-06 Thread via GitHub
syun64 commented on code in PR #8976: URL: https://github.com/apache/iceberg/pull/8976#discussion_r1480763887 ## core/src/main/java/org/apache/iceberg/rest/auth/OAuth2Properties.java: ## @@ -27,6 +27,9 @@ private OAuth2Properties() {} /** A credential to exchange for a token

Re: [PR] Support usage of Separate OIDC Authorization Server URI [iceberg]

2024-02-06 Thread via GitHub
flyrain commented on code in PR #8976: URL: https://github.com/apache/iceberg/pull/8976#discussion_r1480763167 ## core/src/main/java/org/apache/iceberg/rest/auth/OAuth2Properties.java: ## @@ -27,6 +27,9 @@ private OAuth2Properties() {} /** A credential to exchange for a token

Re: [PR] Support usage of Separate OIDC Authorization Server URI [iceberg]

2024-02-06 Thread via GitHub
syun64 commented on code in PR #8976: URL: https://github.com/apache/iceberg/pull/8976#discussion_r1480757774 ## core/src/main/java/org/apache/iceberg/rest/auth/OAuth2Properties.java: ## @@ -27,6 +27,9 @@ private OAuth2Properties() {} /** A credential to exchange for a token

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-06 Thread via GitHub
geruh commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1480721880 ## open-api/rest-catalog-open-api.yaml: ## @@ -1070,6 +1127,35 @@ paths: summary: List all view identifiers underneath a given namespace description: Return

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-06 Thread via GitHub
geruh commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1480721494 ## open-api/rest-catalog-open-api.yaml: ## @@ -448,6 +476,35 @@ paths: summary: List all table identifiers underneath a given namespace description: Return

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-06 Thread via GitHub
geruh commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1480721880 ## open-api/rest-catalog-open-api.yaml: ## @@ -1070,6 +1127,35 @@ paths: summary: List all view identifiers underneath a given namespace description: Return

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-06 Thread via GitHub
geruh commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1480721494 ## open-api/rest-catalog-open-api.yaml: ## @@ -448,6 +476,35 @@ paths: summary: List all table identifiers underneath a given namespace description: Return

Re: [I] Make field access by name work for Avro schema and record apis in Spark module [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #572: URL: https://github.com/apache/iceberg/issues/572#issuecomment-1930994905 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Make field access by name work for Avro schema and record apis in Avro generics module [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #570: Make field access by name work for Avro schema and record apis in Avro generics module URL: https://github.com/apache/iceberg/issues/570 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [I] Support other data formats in Iceberg Pig reader [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #542: URL: https://github.com/apache/iceberg/issues/542#issuecomment-1930994820 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Make field access by name work for Avro schema and record apis in Avro generics module [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #570: URL: https://github.com/apache/iceberg/issues/570#issuecomment-1930994851 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Iceberg Pig reader should support all catalogs [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #541: Iceberg Pig reader should support all catalogs URL: https://github.com/apache/iceberg/issues/541 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] Support External name mapping in Iceberg generic single message encoder [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #500: Support External name mapping in Iceberg generic single message encoder URL: https://github.com/apache/iceberg/issues/500 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [I] Should issue an error/warning message when no data file to delete [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #492: Should issue an error/warning message when no data file to delete URL: https://github.com/apache/iceberg/issues/492 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [I] Respect commit.manifest.min-count-to-merge while appending manifests [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #490: Respect commit.manifest.min-count-to-merge while appending manifests URL: https://github.com/apache/iceberg/issues/490 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] TimestampWriter isn't being used [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #475: URL: https://github.com/apache/iceberg/issues/475#issuecomment-1930994543 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] TimestampWriter isn't being used [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #475: TimestampWriter isn't being used URL: https://github.com/apache/iceberg/issues/475 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [I] Write a dataFrame to a table while after add an 'optional longtype' column , then get some dirty data from the new column [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #463: URL: https://github.com/apache/iceberg/issues/463#issuecomment-1930994482 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] PARTITION_DATA_ID_START is hard-coded [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #449: URL: https://github.com/apache/iceberg/issues/449#issuecomment-1930994459 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] PARTITION_DATA_ID_START is hard-coded [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #449: PARTITION_DATA_ID_START is hard-coded URL: https://github.com/apache/iceberg/issues/449 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [I] Adding support for time-based partitioning on long column type [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #417: URL: https://github.com/apache/iceberg/issues/417#issuecomment-1930994431 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Adding support for time-based partitioning on long column type [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #417: Adding support for time-based partitioning on long column type URL: https://github.com/apache/iceberg/issues/417 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] Make field access by name work for Avro schema and record apis in Spark module [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #572: Make field access by name work for Avro schema and record apis in Spark module URL: https://github.com/apache/iceberg/issues/572 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [I] Make field access by name work for Avro schema and record apis in Iceberg generics module [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #571: URL: https://github.com/apache/iceberg/issues/571#issuecomment-1930994879 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Make field access by name work for Avro schema and record apis in Iceberg generics module [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #571: Make field access by name work for Avro schema and record apis in Iceberg generics module URL: https://github.com/apache/iceberg/issues/571 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [I] Iceberg Pig reader should support all catalogs [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #541: URL: https://github.com/apache/iceberg/issues/541#issuecomment-1930994798 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Support other data formats in Iceberg Pig reader [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #542: Support other data formats in Iceberg Pig reader URL: https://github.com/apache/iceberg/issues/542 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] Update ORC version in Iceberg [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #515: URL: https://github.com/apache/iceberg/issues/515#issuecomment-1930994738 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Update ORC version in Iceberg [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #515: Update ORC version in Iceberg URL: https://github.com/apache/iceberg/issues/515 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

Re: [I] Remove withPartitionPath from the public API [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #507: URL: https://github.com/apache/iceberg/issues/507#issuecomment-1930994703 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Support External name mapping in Iceberg generic single message encoder [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #500: URL: https://github.com/apache/iceberg/issues/500#issuecomment-1930994667 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Remove withPartitionPath from the public API [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #507: Remove withPartitionPath from the public API URL: https://github.com/apache/iceberg/issues/507 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [I] Should issue an error/warning message when no data file to delete [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #492: URL: https://github.com/apache/iceberg/issues/492#issuecomment-1930994597 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Respect commit.manifest.min-count-to-merge while appending manifests [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #490: URL: https://github.com/apache/iceberg/issues/490#issuecomment-1930994568 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] add optional stringType column after a new long type column ,when write data get an exception [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #464: add optional stringType column after a new long type column ,when write data get an exception URL: https://github.com/apache/iceberg/issues/464 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [I] add optional stringType column after a new long type column ,when write data get an exception [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] commented on issue #464: URL: https://github.com/apache/iceberg/issues/464#issuecomment-1930994512 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Write a dataFrame to a table while after add an 'optional longtype' column , then get some dirty data from the new column [iceberg]

2024-02-06 Thread via GitHub
github-actions[bot] closed issue #463: Write a dataFrame to a table while after add an 'optional longtype' column , then get some dirty data from the new column URL: https://github.com/apache/iceberg/issues/463 -- This is an automated message from the Apache Git Service. To respond to th

[PR] Build: Bump pydantic from 2.6.0 to 2.6.1 [iceberg-python]

2024-02-06 Thread via GitHub
dependabot[bot] opened a new pull request, #386: URL: https://github.com/apache/iceberg-python/pull/386 Bumps [pydantic](https://github.com/pydantic/pydantic) from 2.6.0 to 2.6.1. Release notes Sourced from https://github.com/pydantic/pydantic/releases";>pydantic's releases.

[PR] Build: Bump boto3 from 1.34.27 to 1.34.34 [iceberg-python]

2024-02-06 Thread via GitHub
dependabot[bot] opened a new pull request, #385: URL: https://github.com/apache/iceberg-python/pull/385 Bumps [boto3](https://github.com/boto/boto3) from 1.34.27 to 1.34.34. Changelog Sourced from https://github.com/boto/boto3/blob/develop/CHANGELOG.rst";>boto3's changelog.

[PR] Build: Bump ray from 2.7.2 to 2.9.2 [iceberg-python]

2024-02-06 Thread via GitHub
dependabot[bot] opened a new pull request, #384: URL: https://github.com/apache/iceberg-python/pull/384 Bumps [ray](https://github.com/ray-project/ray) from 2.7.2 to 2.9.2. Release notes Sourced from https://github.com/ray-project/ray/releases";>ray's releases. Ray-2.9.2 T

Re: [I] DOCS: Report CSS and styling issues on the new site. [iceberg]

2024-02-06 Thread via GitHub
bitsondatadev commented on issue #9643: URL: https://github.com/apache/iceberg/issues/9643#issuecomment-1930911765 Looks like that's also happening on the main site, thanks for reporting Manu. -- This is an automated message from the Apache Git Service. To respond to the message, please lo

Re: [PR] Core: only trim slash when warehouse location is not root path [iceberg]

2024-02-06 Thread via GitHub
amogh-jahagirdar merged PR #9619: URL: https://github.com/apache/iceberg/pull/9619 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ic

Re: [PR] Core: only trim slash when warehouse location is not root path [iceberg]

2024-02-06 Thread via GitHub
amogh-jahagirdar commented on PR #9619: URL: https://github.com/apache/iceberg/pull/9619#issuecomment-1930907632 I'll go ahead and merge, thanks @nastra for the review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] Spec: Clarify multi-arg transform behavior for different versions [iceberg]

2024-02-06 Thread via GitHub
szehon-ho commented on code in PR #9661: URL: https://github.com/apache/iceberg/pull/9661#discussion_r1480608962 ## format/spec.md: ## @@ -1117,7 +1117,17 @@ Partition specs are serialized as a JSON object with the following fields: |**`spec-id`**|`JSON int`|`0`| |**`fields`*

Re: [PR] Support usage of Separate OIDC Authorization Server URI [iceberg]

2024-02-06 Thread via GitHub
flyrain commented on code in PR #8976: URL: https://github.com/apache/iceberg/pull/8976#discussion_r1480395309 ## core/src/main/java/org/apache/iceberg/rest/auth/OAuth2Properties.java: ## @@ -27,6 +27,9 @@ private OAuth2Properties() {} /** A credential to exchange for a token

Re: [I] Allow non-stringly typed table properties [iceberg-python]

2024-02-06 Thread via GitHub
Fokko commented on issue #376: URL: https://github.com/apache/iceberg-python/issues/376#issuecomment-1930783804 But we convert it to an int when setting the level? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] Failure to delete with merge-on-read in branch and main branch [iceberg]

2024-02-06 Thread via GitHub
edgarRd commented on issue #7635: URL: https://github.com/apache/iceberg/issues/7635#issuecomment-1930771143 Thanks for fixing this issue, @amogh-jahagirdar! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] Allow non-stringly typed table properties [iceberg-python]

2024-02-06 Thread via GitHub
jonashaag commented on issue #376: URL: https://github.com/apache/iceberg-python/issues/376#issuecomment-1930746984 See the example in my post. The pydantic Schema doesn't allow for non strings currently -- This is an automated message from the Apache Git Service. To respond to the messa

Re: [I] python dependency nightmare [iceberg-python]

2024-02-06 Thread via GitHub
djouallah closed issue #375: python dependency nightmare URL: https://github.com/apache/iceberg-python/issues/375 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [I] Allow non-stringly typed table properties [iceberg-python]

2024-02-06 Thread via GitHub
Fokko commented on issue #376: URL: https://github.com/apache/iceberg-python/issues/376#issuecomment-1930727193 @jonashaag Can you give an example? Table properties are encoded as strings by default. -- This is an automated message from the Apache Git Service. To respond to the message, p

[PR] Arrow: Support large-string [iceberg-python]

2024-02-06 Thread via GitHub
Fokko opened a new pull request, #382: URL: https://github.com/apache/iceberg-python/pull/382 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [I] Add support for writing `large_string` and `int16` [iceberg-python]

2024-02-06 Thread via GitHub
jonashaag commented on issue #378: URL: https://github.com/apache/iceberg-python/issues/378#issuecomment-1930710374 I have a locally patched version that simply maps `large_string` to `string` but I got problems with batches > 2 GiB. Not sure if that's related. I'm not forcing batches to be

Re: [I] Add support for writing `large_string` and `int16` [iceberg-python]

2024-02-06 Thread via GitHub
Fokko commented on issue #378: URL: https://github.com/apache/iceberg-python/issues/378#issuecomment-1930699161 I think we can support large-string today. `int16` is a bit more interesting case since it is not natively supported by Iceberg. -- This is an automated message from the

Re: [PR] Build: Bump org.roaringbitmap:RoaringBitmap from 1.0.0 to 1.0.1 [iceberg]

2024-02-06 Thread via GitHub
Fokko merged PR #9317: URL: https://github.com/apache/iceberg/pull/9317 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apach

Re: [PR] Build: Bump mkdocs-material-extensions from 1.3 to 1.3.1 [iceberg]

2024-02-06 Thread via GitHub
Fokko merged PR #9160: URL: https://github.com/apache/iceberg/pull/9160 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apach

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-06 Thread via GitHub
danielcweeks commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1480417942 ## open-api/rest-catalog-open-api.yaml: ## @@ -448,6 +476,35 @@ paths: summary: List all table identifiers underneath a given namespace description:

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-06 Thread via GitHub
danielcweeks commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1480414300 ## open-api/rest-catalog-open-api.yaml: ## @@ -212,6 +212,34 @@ paths: schema: type: string example: "accounting%1Ftax" +

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-06 Thread via GitHub
danielcweeks commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1480414300 ## open-api/rest-catalog-open-api.yaml: ## @@ -212,6 +212,34 @@ paths: schema: type: string example: "accounting%1Ftax" +

Re: [PR] Build: Bump mkdocs-material-extensions from 1.3 to 1.3.1 [iceberg]

2024-02-06 Thread via GitHub
Fokko commented on PR #9160: URL: https://github.com/apache/iceberg/pull/9160#issuecomment-1930577692 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Build: Bump io.delta:delta-core_2.12 from 2.2.0 to 2.4.0 [iceberg]

2024-02-06 Thread via GitHub
dependabot[bot] commented on PR #8786: URL: https://github.com/apache/iceberg/pull/8786#issuecomment-1930577355 Looks like io.delta:delta-core_2.12 is no longer a dependency, so this is no longer needed. -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [PR] Build: Bump io.delta:delta-core_2.12 from 2.2.0 to 2.4.0 [iceberg]

2024-02-06 Thread via GitHub
dependabot[bot] closed pull request #8786: Build: Bump io.delta:delta-core_2.12 from 2.2.0 to 2.4.0 URL: https://github.com/apache/iceberg/pull/8786 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] Build: Bump io.delta:delta-standalone_2.12 from 0.6.0 to 3.0.0 [iceberg]

2024-02-06 Thread via GitHub
Fokko commented on PR #8895: URL: https://github.com/apache/iceberg/pull/8895#issuecomment-1930577240 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Build: Bump io.delta:delta-core_2.12 from 2.2.0 to 2.4.0 [iceberg]

2024-02-06 Thread via GitHub
Fokko commented on PR #8786: URL: https://github.com/apache/iceberg/pull/8786#issuecomment-1930576952 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

  1   2   >