JeonDaehong opened a new pull request, #18207: URL: https://github.com/apache/iceberg/pull/18207
Backport of #18027 to Spark 3.5, 4.0, and 4.1, as noted in that PR. Both changed files are byte-identical to the Spark 4.2 versions merged in #18027: * `ColumnarBatchUtil.buildRowIdMapping` and `buildIsDeleted` traverse the position delete index once over the batch range instead of probing it once per row when the scan has no equality deletes. * `TestColumnarBatchUtil` adds the range-traversal test cases from #18027. The core API (`PositionDeleteIndex.forEachInRange`) is already on main, so this PR touches only the three Spark modules. Locally, `TestColumnarBatchUtil` passes on Spark 4.1 (17/17). The performance measurements are documented in #18027 and #18026 and were not re-run on the older Spark versions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
