liurenjie1024 commented on issue #22: URL: https://github.com/apache/iceberg-rust/issues/22#issuecomment-1958474795
> As DataFusion already implemented mature expression system and evaluation framework, I'm wondering if it is possibly or it is better option to reuse it in iceberg-rust instead re-implementing another expression + evaluation etc.? Hi, @viirya I thought about this option, but I didn't choose it for several reasons: 1. `iceberg-rust`'s position is similar to iceberg java, e.g. it's a library which will be used by many engines, such as datafusion, polars, daft, risingwave, databend, etc. 2. Expression system usually binds with type system. 3. Iceberg don't need a general purpose expression system like datafusion, which may make things complicated. For example, we don't need subquery. 4. There are some iceberg specific things like transform, sorting, and I'm not sure how much effort it will take to make it compatible with datafusion expression. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
