Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-06 Thread via GitHub
sungwy closed issue #992: table.scan queries failing sometimes when result is empty URL: https://github.com/apache/iceberg-python/issues/992 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-06 Thread via GitHub
sungwy closed issue #992: table.scan queries failing sometimes when result is empty URL: https://github.com/apache/iceberg-python/issues/992 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-06 Thread via GitHub
ndrluis commented on issue #992: URL: https://github.com/apache/iceberg-python/issues/992#issuecomment-2271461297 @grobgl, I tested your branch with the example provided here, and your solution fixed the problem. I'll double-check why the test you wrote in your pull request is not failing o

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-06 Thread via GitHub
ndrluis commented on issue #992: URL: https://github.com/apache/iceberg-python/issues/992#issuecomment-2271413306 I believe the issue is not that it returns an empty result, because if you filter for a value that does not exist, like `dataset_5`, it will not return an error. However, if you

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-05 Thread via GitHub
kevinjqliu commented on issue #992: URL: https://github.com/apache/iceberg-python/issues/992#issuecomment-2270291709 Thank you. I was able to reproduce the error with ``` requested_columns=['*'] scan = table.scan( selected_fields = (requested_columns), row_filt

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-05 Thread via GitHub
jurossiar commented on issue #992: URL: https://github.com/apache/iceberg-python/issues/992#issuecomment-2269581909 Seems that @grobgl was able to reproduce it -> https://github.com/grobgl/iceberg-python/commit/9f28f5ad94fd2f6a480b4cb788e730e57cc5c94c -- This is an automated message from

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-05 Thread via GitHub
jurossiar commented on issue #992: URL: https://github.com/apache/iceberg-python/issues/992#issuecomment-2269572366 > Here's what I ran based on the video, I cannot reproduce the issue using 0.7.0. > > In Jupyter, > > ``` > !pip install pyiceberg==0.7.0 --force -q > ```

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-05 Thread via GitHub
jurossiar commented on issue #992: URL: https://github.com/apache/iceberg-python/issues/992#issuecomment-2269566492 Sorry! I've just saw the messages. I appended [example.zip](https://github.com/user-attachments/files/16474537/example.zip) where you can create the example from scratch. I

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-02 Thread via GitHub
kevinjqliu commented on issue #992: URL: https://github.com/apache/iceberg-python/issues/992#issuecomment-2266222080 > Reading the exception, it looks like some files do not have the table_id filled in. That's my theory as well. Can you run ``` table.inspect.files().to_panda

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-02 Thread via GitHub
kevinjqliu commented on issue #992: URL: https://github.com/apache/iceberg-python/issues/992#issuecomment-2266221072 Here's what I ran based on the video, I cannot reproduce the issue using 0.7.0. In Jupyter, ``` !pip install pyiceberg==0.7.0 --force -q ``` With pyiceberg

Re: [I] table.scan queries failing sometimes when result is empty [iceberg-python]

2024-08-02 Thread via GitHub
ndrluis commented on issue #992: URL: https://github.com/apache/iceberg-python/issues/992#issuecomment-2266204995 Hello @jurossiar, I ran some tests and was unable to reproduce the error. Reading the exception, it looks like some files do not have the table_id filled in. Could you cr