Fokko opened a new issue, #2303:
URL: https://github.com/apache/iceberg-python/issues/2303

   ### Feature Request / Improvement
   
   Umbrelly issue. Today we have tightly coupled query planning in Python. This 
works well but runs into limitations when it comes to concurrency and 
performance. Having pluggable query planning will allow for:
   
   - **Python based query planning** which is working today and is proven.
   - **Iceberg-Rust based query planning** as suggeted in 
https://github.com/apache/iceberg-python/issues/2159#issuecomment-3033339213. 
   - **REST Catalog server side planning** this leverages the REST Catalog to 
plan the query, rather than the client. First issue can be found here: 
https://github.com/apache/iceberg-python/issues/2302.
   
   As an API, I think it makes sense to follow the Server Side planning. So a 
`PlanTableScanRequest` as an input, and the 
[ScanTasks](https://github.com/apache/iceberg/blob/68a241615e104d97a86c932c381d7dfac802d769/open-api/rest-catalog-open-api.py#L1290)
 as the output.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to