djouallah commented on issue #407: URL: https://github.com/apache/iceberg-python/issues/407#issuecomment-1938101894
here is a reproducible example, in real life I loaded 2100 files which generate an OOM. https://colab.research.google.com/drive/1yultO4Wc94kJMhnTzwa5Gcrfp8VeDubg#scrollTo=TZ29HGpXx6BN for duckdb views, I mean a way to get data from duckdb for Python Iceberg without necessarily materialized it. think of it as arrow dataset, not table -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
