Re: [PR] Remove `as visitors` import [iceberg-python]

2024-03-31 Thread via GitHub
HonahX merged PR #567: URL: https://github.com/apache/iceberg-python/pull/567 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] typealias for table version [iceberg-python]

2024-03-31 Thread via GitHub
MehulBatra commented on code in PR #566: URL: https://github.com/apache/iceberg-python/pull/566#discussion_r1546000951 ## pyiceberg/typedef.py: ## @@ -199,3 +200,6 @@ def __repr__(self) -> str: def record_fields(self) -> List[str]: """Return values of all the field

Re: [I] reset catalog can't reslove s3 domain name [iceberg]

2024-03-31 Thread via GitHub
ming12713 closed issue #7709: reset catalog can't reslove s3 domain name URL: https://github.com/apache/iceberg/issues/7709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] reset catalog can't reslove s3 domain name [iceberg]

2024-03-31 Thread via GitHub
ming12713 commented on issue #7709: URL: https://github.com/apache/iceberg/issues/7709#issuecomment-2029217628 > > > > Is there anyone who solved this issue? > > > > > > > > > Try to add env variable to the rest container: `CATALOG_S3_PATH__STYLE__ACCESS: true` > > > It'll be

Re: [I] Unable to load an iceberg table from aws glue catalog [iceberg-python]

2024-03-31 Thread via GitHub
geruh commented on issue #515: URL: https://github.com/apache/iceberg-python/issues/515#issuecomment-2029207168 Your glue calls look, fine but your S3 calls are the problem. I was able to reproduce the issue by having the incorrect region for my AWS profile at `./aws/config` and passing in

Re: [PR] Fix day timestamp micro [iceberg-rust]

2024-03-31 Thread via GitHub
marvinlanhenke commented on code in PR #312: URL: https://github.com/apache/iceberg-rust/pull/312#discussion_r1545981170 ## crates/iceberg/src/transform/temporal.rs: ## @@ -175,7 +200,7 @@ impl TransformFunction for Day { .as_any() .downcast_ref

Re: [PR] Fix day timestamp micro [iceberg-rust]

2024-03-31 Thread via GitHub
marvinlanhenke commented on PR #312: URL: https://github.com/apache/iceberg-rust/pull/312#issuecomment-2029196013 @liurenjie1024 as discussed in #311 PTAL. I also left a comment in transform - I haven't found a better way yet, to handle the `unwrap()` here. Perhaps you have an ide

Re: [PR] Fix day timestamp micro [iceberg-rust]

2024-03-31 Thread via GitHub
marvinlanhenke commented on code in PR #312: URL: https://github.com/apache/iceberg-rust/pull/312#discussion_r1545981170 ## crates/iceberg/src/transform/temporal.rs: ## @@ -175,7 +200,7 @@ impl TransformFunction for Day { .as_any() .downcast_ref

[PR] Fix day timestamp micro [iceberg-rust]

2024-03-31 Thread via GitHub
marvinlanhenke opened a new pull request, #312: URL: https://github.com/apache/iceberg-rust/pull/312 ### Which issue does this PR close? Closes #311 ### Rationale for this change Align timestamp conversion with Java implementation. Unblock #309 ### What changes are include

Re: [I] Bug: `fn day_timestamp_micro` produces wrong results [iceberg-rust]

2024-03-31 Thread via GitHub
marvinlanhenke commented on issue #311: URL: https://github.com/apache/iceberg-rust/issues/311#issuecomment-2029173981 @liurenjie1024 I'll try to get to submit a PR this evening. Still need to handle unwrap properly. -- This is an automated message from the Apache Git Service. To resp

Re: [I] reset catalog can't reslove s3 domain name [iceberg]

2024-03-31 Thread via GitHub
sg-c0de commented on issue #7709: URL: https://github.com/apache/iceberg/issues/7709#issuecomment-2029161591 > > > Is there anyone who solved this issue? > > > > > > Try to add env variable to the rest container: `CATALOG_S3_PATH__STYLE__ACCESS: true` > > It'll be [converted](

Re: [I] Read Parquet data file with projection [iceberg-rust]

2024-03-31 Thread via GitHub
liurenjie1024 commented on issue #244: URL: https://github.com/apache/iceberg-rust/issues/244#issuecomment-2029081596 > @liurenjie1024 Thanks for reviewing and merging #245. > > > Implement sth like [ArrowProjectionVisitor in python](https://github.com/apache/iceberg-python/blob/afdfa

Re: [I] Read Parquet data file with projection [iceberg-rust]

2024-03-31 Thread via GitHub
viirya commented on issue #244: URL: https://github.com/apache/iceberg-rust/issues/244#issuecomment-2029070755 @liurenjie1024 Thanks for reviewing and merging #245. > Implement sth like [ArrowProjectionVisitor in python](https://github.com/apache/iceberg-python/blob/afdfa351119090f09d

Re: [PR] feat: support uri redirect in rest client [iceberg-rust]

2024-03-31 Thread via GitHub
liurenjie1024 commented on PR #310: URL: https://github.com/apache/iceberg-rust/pull/310#issuecomment-2029061150 cc @flyrain Would you take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] Bug: `fn day_timestamp_micro` produces wrong results [iceberg-rust]

2024-03-31 Thread via GitHub
liurenjie1024 commented on issue #311: URL: https://github.com/apache/iceberg-rust/issues/311#issuecomment-2029057550 Do you mind to submit a pr to fix it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] Bug: `fn day_timestamp_micro` produces wrong results [iceberg-rust]

2024-03-31 Thread via GitHub
liurenjie1024 commented on issue #311: URL: https://github.com/apache/iceberg-rust/issues/311#issuecomment-2029056694 Hi, @marvinlanhenke Thanks for the debug, yes we should align with java/python implementation carefully. -- This is an automated message from the Apache Git Service. To re

Re: [I] Read Parquet data file with projection [iceberg-rust]

2024-03-31 Thread via GitHub
liurenjie1024 closed issue #244: Read Parquet data file with projection URL: https://github.com/apache/iceberg-rust/issues/244 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] feat: Read Parquet data file with projection [iceberg-rust]

2024-03-31 Thread via GitHub
liurenjie1024 commented on PR #245: URL: https://github.com/apache/iceberg-rust/pull/245#issuecomment-2029035942 > > Thanks @viirya for this pr, looks great! It would be better to report the error as `FeatureNotSupport` to make it more friendly to user, what do you think? > > Thank y

Re: [PR] feat: Read Parquet data file with projection [iceberg-rust]

2024-03-31 Thread via GitHub
liurenjie1024 merged PR #245: URL: https://github.com/apache/iceberg-rust/pull/245 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ic

Re: [I] Update site docs to have a CustomCatalog page for python [iceberg-python]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #15: URL: https://github.com/apache/iceberg-python/issues/15#issuecomment-2028961777 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occu

Re: [I] Support fan-out reads in PyIceberg [iceberg-python]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #16: URL: https://github.com/apache/iceberg-python/issues/16#issuecomment-2028961767 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occu

Re: [PR] Migrate TableTestBase related classes to JUnit5 and delete TableTestBase [iceberg]

2024-03-31 Thread via GitHub
tomtongue commented on PR #10063: URL: https://github.com/apache/iceberg/pull/10063#issuecomment-2028961091 @nastra Migrate all classes related to `TableTestBase`. Could you review? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [I] trion very slow [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2351: URL: https://github.com/apache/iceberg/issues/2351#issuecomment-2028960909 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] TimeZone‘s ERROR on testInsertSupportedTypes [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2356: URL: https://github.com/apache/iceberg/issues/2356#issuecomment-2028960916 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Flink: move away from InternalSerializers for cloning RowData [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] closed issue #2184: Flink: move away from InternalSerializers for cloning RowData URL: https://github.com/apache/iceberg/issues/2184 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] now it can delete [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2183: URL: https://github.com/apache/iceberg/issues/2183#issuecomment-2028960774 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Flink : migrate existing hive table to iceberg table [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2162: URL: https://github.com/apache/iceberg/issues/2162#issuecomment-2028960753 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Flink : migrate existing hive table to iceberg table [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] closed issue #2162: Flink : migrate existing hive table to iceberg table URL: https://github.com/apache/iceberg/issues/2162 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] Internal Tests Cannot us ORC or Avro Datasource Writers [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2360: URL: https://github.com/apache/iceberg/issues/2360#issuecomment-2028960936 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] hive cannot get data from iceberg table [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2357: URL: https://github.com/apache/iceberg/issues/2357#issuecomment-2028960925 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Iceberg Extensions Parser Should Allow Generic Expressions as Call Args [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2348: URL: https://github.com/apache/iceberg/issues/2348#issuecomment-2028960896 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Provide full unit tests for flink savepoints workflow [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] closed issue #2190: Provide full unit tests for flink savepoints workflow URL: https://github.com/apache/iceberg/issues/2190 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] Provide full unit tests for flink savepoints workflow [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2190: URL: https://github.com/apache/iceberg/issues/2190#issuecomment-2028960798 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Flink: move away from InternalSerializers for cloning RowData [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2184: URL: https://github.com/apache/iceberg/issues/2184#issuecomment-2028960789 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Flink: Can't use flink sql to create hive catalog [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2181: URL: https://github.com/apache/iceberg/issues/2181#issuecomment-2028960759 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] now it can delete [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] closed issue #2183: now it can delete URL: https://github.com/apache/iceberg/issues/2183 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [I] Flink: Can't use flink sql to create hive catalog [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] closed issue #2181: Flink: Can't use flink sql to create hive catalog URL: https://github.com/apache/iceberg/issues/2181 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] Another hive connection leak issue from spark [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] closed issue #2137: Another hive connection leak issue from spark URL: https://github.com/apache/iceberg/issues/2137 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] Another hive connection leak issue from spark [iceberg]

2024-03-31 Thread via GitHub
github-actions[bot] commented on issue #2137: URL: https://github.com/apache/iceberg/issues/2137#issuecomment-2028960741 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [PR] Build: Bump org.glassfish.jaxb:jaxb-runtime from 2.3.3 to 2.3.9 [iceberg]

2024-03-31 Thread via GitHub
Fokko merged PR #9988: URL: https://github.com/apache/iceberg/pull/9988 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apach

Re: [PR] Build: Bump software.amazon.awssdk:bom from 2.25.18 to 2.25.21 [iceberg]

2024-03-31 Thread via GitHub
Fokko merged PR #10072: URL: https://github.com/apache/iceberg/pull/10072 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa

Re: [I] Bug: `fn day_timestamp_micro` produces wrong results [iceberg-rust]

2024-03-31 Thread via GitHub
marvinlanhenke commented on issue #311: URL: https://github.com/apache/iceberg-rust/issues/311#issuecomment-2028903379 cc @liurenjie1024 Prototype for the fix can be seen in #309, however I still have to handle unwrap and change the return type to `Result`. This should be enough, howeve

[PR] Remove `as visitors` import [iceberg-python]

2024-03-31 Thread via GitHub
Fokko opened a new pull request, #567: URL: https://github.com/apache/iceberg-python/pull/567 I think this is more verbose than required. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] Introduce two properties for reading the connection timeout and socke… [iceberg]

2024-03-31 Thread via GitHub
harishch1998 commented on code in PR #10053: URL: https://github.com/apache/iceberg/pull/10053#discussion_r1545794426 ## core/src/main/java/org/apache/iceberg/rest/HTTPClient.java: ## @@ -448,6 +443,43 @@ static HttpRequestInterceptor loadInterceptorDynamically( return inst

Re: [PR] typealias for table version [iceberg-python]

2024-03-31 Thread via GitHub
Fokko commented on code in PR #566: URL: https://github.com/apache/iceberg-python/pull/566#discussion_r1545787435 ## pyiceberg/typedef.py: ## @@ -199,3 +200,6 @@ def __repr__(self) -> str: def record_fields(self) -> List[str]: """Return values of all the fields of

Re: [I] Unable to load an iceberg table from aws glue catalog [iceberg-python]

2024-03-31 Thread via GitHub
kevinjqliu commented on issue #515: URL: https://github.com/apache/iceberg-python/issues/515#issuecomment-2028858620 https://github.com/apache/iceberg/issues/6820 similar sounding issue -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [I] Unable to load an iceberg table from aws glue catalog [iceberg-python]

2024-03-31 Thread via GitHub
kevinjqliu commented on issue #515: URL: https://github.com/apache/iceberg-python/issues/515#issuecomment-2028855896 The `load_table` operation is doing a couple of different things. Let's verify each step. Getting the "glue table" object, using the `_get_glue_table` function `

Re: [PR] feat: Read Parquet data file with projection [iceberg-rust]

2024-03-31 Thread via GitHub
viirya commented on PR #245: URL: https://github.com/apache/iceberg-rust/pull/245#issuecomment-2028854180 > Thanks @viirya for this pr, looks great! It would be better to report the error as `FeatureNotSupport` to make it more friendly to user, what do you think? Thank you @liurenjie

[PR] typealias for table version [iceberg-python]

2024-03-31 Thread via GitHub
MehulBatra opened a new pull request, #566: URL: https://github.com/apache/iceberg-python/pull/566 Create TypeAlias for the version method return, to ensure the type safety, readability & maintainability. -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [I] reset catalog can't reslove s3 domain name [iceberg]

2024-03-31 Thread via GitHub
sg-c0de commented on issue #7709: URL: https://github.com/apache/iceberg/issues/7709#issuecomment-2028827829 > > > Is there anyone who solved this issue? > > > > > > Try to add env variable to the rest container: `CATALOG_S3_PATH__STYLE__ACCESS: true` > > It'll be [converted](

Re: [I] reset catalog can't reslove s3 domain name [iceberg]

2024-03-31 Thread via GitHub
springbearpro commented on issue #7709: URL: https://github.com/apache/iceberg/issues/7709#issuecomment-2028825632 @sg-c0de Thanks. Saved my day. I can't find it in the iceberg document though. -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [I] Unable to load an iceberg table from aws glue catalog [iceberg-python]

2024-03-31 Thread via GitHub
arookieds commented on issue #515: URL: https://github.com/apache/iceberg-python/issues/515#issuecomment-2028709117 > Can you double-check the AWS settings? Your AWS profile looks like it can access the Glue catalog and read its content. Does it have permission to read the underlying s3 fil

[PR] Build: add gradle wrapper validation action [iceberg]

2024-03-31 Thread via GitHub
sullis opened a new pull request, #10073: URL: https://github.com/apache/iceberg/pull/10073 https://github.com/gradle/wrapper-validation-action/blob/main/README.md -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [I] Don't allow time-travel via TIMESTAMP AS OF on branch [iceberg]

2024-03-31 Thread via GitHub
nastra closed issue #10058: Don't allow time-travel via TIMESTAMP AS OF on branch URL: https://github.com/apache/iceberg/issues/10058 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] Spark: Don't allow branch_ usage with TIMESTAMP AS OF [iceberg]

2024-03-31 Thread via GitHub
nastra merged PR #10059: URL: https://github.com/apache/iceberg/pull/10059 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap