Re: [I] add support for DuckDB views as a valid data format [iceberg-python]

djouallah closed issue #407: add support for DuckDB views as a valid data format URL: https://github.com/apache/iceberg-python/issues/407 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] add support for DuckDB views as a valid data format [iceberg-python]

corleyma commented on issue #407: URL: https://github.com/apache/iceberg-python/issues/407#issuecomment-1970543473 Sounds like the ask here is for similar functionality in duckdb as was implemented in polars scan_iceberg. -- This is an automated message from the Apache Git Service. To res

Re: [I] add support for DuckDB views as a valid data format [iceberg-python]

djouallah commented on issue #407: URL: https://github.com/apache/iceberg-python/issues/407#issuecomment-1938101894 here is a reproducible example, in real life I loaded 2100 files which generate an OOM. https://colab.research.google.com/drive/1yultO4Wc94kJMhnTzwa5Gcrfp8VeDubg#scrollTo=T

Re: [I] add support for DuckDB views as a valid data format [iceberg-python]

amogh-jahagirdar commented on issue #407: URL: https://github.com/apache/iceberg-python/issues/407#issuecomment-1938083316 @djouallah Thanks for reporting, could you provide some more specifics on the tests you are running which are exceeding memory? If you're able to share queries, the sca