2010YOUY01 commented on PR #24353: URL: https://github.com/apache/datafusion/pull/24353#issuecomment-5289265786
> I found that `FilterExec` could buffer small filtered results indefinitely when its input was unbounded Was that only to buffer up to `batch_size` from the configuration? I think this is still intended for streaming input. It's a convention for each operator to produce reasonably large output batches, which helps downstream operators vectorize. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
