Anurag-S1ngh opened a new pull request, #4402: URL: https://github.com/apache/iceberg-python/pull/4402
## Summary PyIceberg never wrote Parquet page indexes, so readers that support them cannot skip non-matching pages during predicate evaluation. PyArrow already supports this with `ParquetWriter(write_page_index=True)`. ## Changes - Add the `write.parquet.page-index-enabled` table property, default `false`, so current output and file sizes are preserved. - Pass `write_page_index` from `_get_parquet_writer_kwargs` to the Parquet writer. - Document the property in the write options table. ## Testing - Added a test that writes with the property off and on, and checks `has_column_index` and `has_offset_index` on the resulting row group. - `make test` passes (4695 passed, 5 skipped). Closes #3847 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
