andygrove commented on issue #25758: URL: https://github.com/apache/datafusion/issues/25758#issuecomment-5858005811
I'd like to propose #25383 for 55.2.0. The backport is #25814. On 55.1.0, a final aggregate that has spilled can fail with `ResourcesExhausted` while replaying its spill files. The spill merge reserves as much memory as the pool will give it, and the stream that aggregates the merged rows cannot spill. Comet hits this under memory pressure (apache/datafusion-comet#6254), and #25423 is the same failure in `aggregate_memory_spill.slt`. #25814 is stacked on #25805, the #24740 backport, because #25383 builds on #24740. So #25805 needs to go in first. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
