Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-07 Thread via GitHub
rahil-c commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1482207982 ## open-api/rest-catalog-open-api.yaml: ## @@ -212,6 +212,34 @@ paths: schema: type: string example: "accounting%1Ftax" +- na

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-07 Thread via GitHub
rahil-c commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r148698 ## open-api/rest-catalog-open-api.yaml: ## @@ -212,6 +212,34 @@ paths: schema: type: string example: "accounting%1Ftax" +- na

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-07 Thread via GitHub
rahil-c commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1482223624 ## open-api/rest-catalog-open-api.yaml: ## @@ -448,6 +476,35 @@ paths: summary: List all table identifiers underneath a given namespace description: Retur

Re: [PR] Add pagination to open api spec for listing of namespaces, tables, views [iceberg]

2024-02-07 Thread via GitHub
rahil-c commented on code in PR #9660: URL: https://github.com/apache/iceberg/pull/9660#discussion_r1482226957 ## open-api/rest-catalog-open-api.yaml: ## @@ -1070,6 +1127,35 @@ paths: summary: List all view identifiers underneath a given namespace description: Retu

Re: [I] Don't use internal Spark classes to migrate existing tables to Iceberg [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #595: URL: https://github.com/apache/iceberg/issues/595#issuecomment-1933148527 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Broadcast Join Failure [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #621: Broadcast Join Failure URL: https://github.com/apache/iceberg/issues/621 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] Broadcast Join Failure [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #621: URL: https://github.com/apache/iceberg/issues/621#issuecomment-1933148650 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Views on top of Iceberg tables [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #644: Views on top of Iceberg tables URL: https://github.com/apache/iceberg/issues/644 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [I] Fix Filter and Projection unit tests on vectorized-read branch [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #660: Fix Filter and Projection unit tests on vectorized-read branch URL: https://github.com/apache/iceberg/issues/660 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] Fix Filter and Projection unit tests on vectorized-read branch [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #660: URL: https://github.com/apache/iceberg/issues/660#issuecomment-1933149035 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Use uncompressed page size to set initial size for Arrow data buffers [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #661: Use uncompressed page size to set initial size for Arrow data buffers URL: https://github.com/apache/iceberg/issues/661 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] Add namespace support in Iceberg Catalog [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #672: URL: https://github.com/apache/iceberg/issues/672#issuecomment-1933149253 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] upsertion/deletion for tables with primary key [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #893: URL: https://github.com/apache/iceberg/issues/893#issuecomment-1933149587 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. T

Re: [I] Support notification on table writes [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #926: URL: https://github.com/apache/iceberg/issues/926#issuecomment-1933149616 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. T

Re: [I] Bypass the conversion to/from intermediate format if not needed [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #943: URL: https://github.com/apache/iceberg/issues/943#issuecomment-1933149645 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. T

Re: [I] Add an iceberg-mr-runtime module [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #890: URL: https://github.com/apache/iceberg/issues/890#issuecomment-1933149543 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. T

Re: [I] TestDataFrameWrites fails due to OOM errors with ORC [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #964: URL: https://github.com/apache/iceberg/issues/964#issuecomment-1933149692 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. T

Re: [I] Fix Parquet's fallback field id assignment [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #586: URL: https://github.com/apache/iceberg/issues/586#issuecomment-1933148411 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Don't use internal Spark classes to migrate existing tables to Iceberg [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #595: Don't use internal Spark classes to migrate existing tables to Iceberg URL: https://github.com/apache/iceberg/issues/595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] Views on top of Iceberg tables [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #644: URL: https://github.com/apache/iceberg/issues/644#issuecomment-1933148794 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Fix Parquet's fallback field id assignment [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #586: Fix Parquet's fallback field id assignment URL: https://github.com/apache/iceberg/issues/586 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [I] Prefetch parquet data pages [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #647: URL: https://github.com/apache/iceberg/issues/647#issuecomment-1933148910 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Prefetch parquet data pages [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #647: Prefetch parquet data pages URL: https://github.com/apache/iceberg/issues/647 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [I] Use uncompressed page size to set initial size for Arrow data buffers [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #661: URL: https://github.com/apache/iceberg/issues/661#issuecomment-1933149145 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Git

Re: [I] Add namespace support in Iceberg Catalog [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #672: Add namespace support in Iceberg Catalog URL: https://github.com/apache/iceberg/issues/672 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] BuildORCProjection does not preserve field ids for container types [iceberg]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #962: URL: https://github.com/apache/iceberg/issues/962#issuecomment-1933149665 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. T

Re: [PR] Docs: Add/update Snowflake [iceberg]

2024-02-07 Thread via GitHub
danielcweeks merged PR #9669: URL: https://github.com/apache/iceberg/pull/9669 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceber

[I] Reorder query engines in docs as alphanumeric. [iceberg]

2024-02-07 Thread via GitHub
bitsondatadev opened a new issue, #9681: URL: https://github.com/apache/iceberg/issues/9681 @Fokko @RussellSpitzer @nastra @ajantha-bhat, is there any reason we shouldn't just make the query engines in the docs page alphanumeric? Potentially give them their own order as @flyrain sugge

Re: [PR] Fix: add required rust version in cargo.toml [iceberg-rust]

2024-02-07 Thread via GitHub
dp-0 commented on code in PR #193: URL: https://github.com/apache/iceberg-rust/pull/193#discussion_r1482309823 ## Cargo.toml: ## @@ -26,6 +26,7 @@ homepage = "https://rust.iceberg.apache.org/"; repository = "https://github.com/apache/iceberg-rust"; license = "Apache-2.0" +ru

Re: [PR] Centralized table properties management [iceberg-python]

2024-02-07 Thread via GitHub
HonahX commented on PR #388: URL: https://github.com/apache/iceberg-python/pull/388#issuecomment-1933296601 > this is awesome! Slight nit, it is better code organization-wise to move the properties to something like `table/properties.py`? just so that properties are easier to find. `table/_

Re: [PR] Build: Bump mkdocs-material from 9.5.7 to 9.5.8 [iceberg-python]

2024-02-07 Thread via GitHub
HonahX merged PR #395: URL: https://github.com/apache/iceberg-python/pull/395 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] Common metadata for TableMetadata and ViewMetadata [iceberg]

2024-02-07 Thread via GitHub
nk1506 commented on PR #9682: URL: https://github.com/apache/iceberg/pull/9682#issuecomment-1933319863 cc: @szehon-ho , @nastra , @pvary -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] Core: HadoopTable needs to skip file cleanup after task failure under some boundary conditions. [iceberg]

2024-02-07 Thread via GitHub
BsoBird commented on code in PR #9546: URL: https://github.com/apache/iceberg/pull/9546#discussion_r1482396696 ## core/src/main/java/org/apache/iceberg/hadoop/HadoopTableOperations.java: ## @@ -149,26 +183,71 @@ public void commit(TableMetadata base, TableMetadata metadata) {

Re: [PR] Core: HadoopTable needs to skip file cleanup after task failure under some boundary conditions. [iceberg]

2024-02-07 Thread via GitHub
BsoBird commented on code in PR #9546: URL: https://github.com/apache/iceberg/pull/9546#discussion_r1482412713 ## core/src/main/java/org/apache/iceberg/hadoop/HadoopTableOperations.java: ## @@ -149,26 +183,71 @@ public void commit(TableMetadata base, TableMetadata metadata) {

Re: [PR] Support for pushdown like filter (endsWith and contains) [iceberg]

2024-02-07 Thread via GitHub
yabola commented on PR #9683: URL: https://github.com/apache/iceberg/pull/9683#issuecomment-1933402920 I have an example of performance comparison. Table : `p_lineorder_ice` has partition column `LO_ORDERDATE`. 1. pushdown partition column test sql: select * from ice.ssb10.p_

Re: [I] Reorder query engines in docs as alphanumeric. [iceberg]

2024-02-07 Thread via GitHub
manuzhang commented on issue #9681: URL: https://github.com/apache/iceberg/issues/9681#issuecomment-1933426258 We have dedicated docs for Spark, Flink and Hive while those for other engines are links to their own sites. I think our own docs should come first. -- This is an automated messa

Re: [I] Reorder query engines in docs as alphanumeric. [iceberg]

2024-02-07 Thread via GitHub
ajantha-bhat commented on issue #9681: URL: https://github.com/apache/iceberg/issues/9681#issuecomment-1933434166 +1 for reordering, maybe moving query engines under a section "engines" similar to "integrations" can also help in declutter the contents. And we may also need a s

[I] Iceberg table data vanishes overnight. [iceberg]

2024-02-07 Thread via GitHub
ajsalunkhe opened a new issue, #9684: URL: https://github.com/apache/iceberg/issues/9684 ### Apache Iceberg version 1.2.0 ### Query engine Athena ### Please describe the bug 🐞 I am able to write data to iceberg and post that if I run a SELECT query the data

Re: [PR] Spec: Clarify multi-arg transform behavior for different versions [iceberg]

2024-02-07 Thread via GitHub
advancedxy commented on code in PR #9661: URL: https://github.com/apache/iceberg/pull/9661#discussion_r1482479258 ## format/spec.md: ## @@ -1130,14 +1140,11 @@ Each partition field in the fields list is stored as an object. See the table fo |**`hour`**|`JSON string: "hour"`|`"

Re: [PR] Arrow: Support `int8` and `int16` types [iceberg-python]

2024-02-07 Thread via GitHub
Fokko merged PR #391: URL: https://github.com/apache/iceberg-python/pull/391 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [I] Add support for writing `large_string` and `int16` [iceberg-python]

2024-02-07 Thread via GitHub
Fokko closed issue #378: Add support for writing `large_string` and `int16` URL: https://github.com/apache/iceberg-python/issues/378 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] Bug Fix: Rest Catalog update partition spec and sort order when fresh schema is created [iceberg-python]

2024-02-07 Thread via GitHub
Fokko merged PR #392: URL: https://github.com/apache/iceberg-python/pull/392 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

<    1   2