Re: [I] Scan does not work as expected [iceberg-rust]

2024-08-19 Thread via GitHub
Xuanwo commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2296930200 I believe this should have been fixed. Please feel free to open new issues if still exists. -- This is an automated message from the Apache Git Service. To respond to the message

Re: [I] Scan does not work as expected [iceberg-rust]

2024-08-19 Thread via GitHub
Xuanwo closed issue #495: Scan does not work as expected URL: https://github.com/apache/iceberg-rust/issues/495 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] Scan does not work as expected [iceberg-rust]

2024-08-09 Thread via GitHub
sdd commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2278895420 I have fixed the issue where errors were not returned to the user, in https://github.com/apache/iceberg-rust/pull/535 -- This is an automated message from the Apache Git Service. To

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-31 Thread via GitHub
sdd commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2260978153 > Correctly writing data into iceberg is not supported yet, so we need external systems such as spark to ingest data. Putting pre generated parquet files maybe an approach, but that r

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-30 Thread via GitHub
liurenjie1024 commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2258512349 > > Me and @ZENOTME did integration tests in icelake before, and I have to say that without sql engine support, it's painful to maintain those tests. > > I agree that

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-29 Thread via GitHub
ndrluis commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2256624974 > Got it. So, we need to support presign in the REST catalog. Could you help by creating an issue for this? I'll review this section and draft a plan for its implementation.

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-29 Thread via GitHub
Xuanwo commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2256378008 > Me and @ZENOTME did integration tests in icelake before, and I have to say that without sql engine support, it's painful to maintain those tests. I agree that we need a SQL

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-29 Thread via GitHub
Xuanwo commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2256126041 > It's a presign process, but it's not the client's responsibility to presign. The get config will return the s3.signer.uri, and the load table will return s3.remote-signing-enable

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-29 Thread via GitHub
liurenjie1024 commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2256072271 > I'm not comfortable closing this issue without a regression test that guarantees the expected behavior. +1 on this. Currently we don't have regression tests on the w

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-29 Thread via GitHub
ndrluis commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2256052967 @Xuanwo > Hi, does remote signing means presign in s3? Yes and no. I'm not sure if this is the flow, because I haven't found any documentation; this is based on my un

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-28 Thread via GitHub
Xuanwo commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2254952953 I'm guessing https://github.com/apache/iceberg-rust/pull/498 should close this issue. Would you like to verify it? -- This is an automated message from the Apache Git Service. To

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-28 Thread via GitHub
Xuanwo commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2254928209 Hi, does `remote signing` means `presign` in s3? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-28 Thread via GitHub
ndrluis commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2254686134 To scan with remote-signing we need to implement this https://github.com/apache/iceberg/blob/main/aws/src/main/java/org/apache/iceberg/aws/s3/signer/S3V4RestSignerClient.jav

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-28 Thread via GitHub
ndrluis commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2254673245 I encountered an 'access denied' problem. The FileIO does not receive the S3 credentials. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-28 Thread via GitHub
ndrluis commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2254669702 I found the problem. I don’t know how to solve it, but I will try. The `while let Some(Ok(task)) = tasks.next().await statement` is hiding some errors. In my previous attemp

Re: [I] Scan does not work as expected [iceberg-rust]

2024-07-28 Thread via GitHub
ndrluis commented on issue #495: URL: https://github.com/apache/iceberg-rust/issues/495#issuecomment-2254661198 I performed another test using the Tabular catalog, attempting to scan the sandbox warehouse in the examples namespace, specifically targeting the nyc_taxi_yellow table, but it re