asolimando commented on PR #26000: URL: https://github.com/apache/datafusion/pull/26000#issuecomment-6265078225
> Agreed — that matches the goal of the issue. > > I'll add a config option so users can prefer the lower-memory path when the system is under load, while keeping the faster rewrite as the default (or configurable either way). > > Working on the setting + tests now. From the measurements above, the problem could be framed as a CBO rule, but unfortunately at the logical planner level we have no statistics, so we can't do anything better than writing a config-knob here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
