gortiz opened a new pull request, #10372: URL: https://github.com/apache/pinot/pull/10372
Before this PR, `ScanBasedDocIdIterator.applyAnd` was always applied using windows of OPTIMAL_ITERATOR_BATCH_SIZE, which is defined as 256. At StarTree we found some inefficiencies when fetching data from slower backends (for example when a network request is needed). Therefore we would like to be able to decide the window size depending on the situation. This PR is a little bit larger than expected because we also needed to modify `ValueMatcher` in order to do not contain a buffer of predefined size. Instead is the caller the one that creates and supply the buffer that has to be used. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org