Re: [PR] Table Scan: Add Row Group Skipping and Row Selection Filtering [iceberg-rust]

2024-08-19 Thread via GitHub
sdd commented on PR #558: URL: https://github.com/apache/iceberg-rust/pull/558#issuecomment-2295818208 Hey @liurenjie1024 - I've removed the row selection change and will raise that in a follow-up PR instead. -- This is an automated message from the Apache Git Service. To respond to the m

Re: [PR] Table Scan: Add Row Group Skipping and Row Selection Filtering [iceberg-rust]

2024-08-18 Thread via GitHub
liurenjie1024 commented on PR #558: URL: https://github.com/apache/iceberg-rust/pull/558#issuecomment-2295199077 Thanks @sdd for this pr. I just skimmed through it and thought that it's great! My suggestion is to split this pr into two smaller ones: one for row group and one for page index.

[PR] Table Scan: Add Row Group Skipping and Row Selection Filtering [iceberg-rust]

2024-08-16 Thread via GitHub
sdd opened a new pull request, #558: URL: https://github.com/apache/iceberg-rust/pull/558 This PR introduces two more advanced features that can improve performance when executing table reads on parquet-backed tables when using a filter predicate: "row group filtering" and "row selection sk