Dear Apache Doris Development Community, Thank you for the update and the link to the branch!
Could you kindly let us know when the next release of Apache Doris, including the disk spill feature, is expected to be available? On Tue, Dec 10, 2024 at 10:07 AM Joice Jacob <joicejacob1...@gmail.com> wrote: > Dear Apache Doris Development Community, > > Our team is very satisfied with the performance of Apache Doris, but we > have a few concerns that we would like to clarify. > > We are planning to replace Hive with Doris for our use cases. In Hive, > queries typically complete successfully using the available resources, even > under constrained conditions. Most of our queries are small; however, we > have some offline reporting use cases that require computing data for 3, 6, > 9, or 15 months. > > In Doris, we have observed that queries fail when resources are > insufficient. This poses a challenge, as scaling the cluster to accommodate > large queries isn't feasible due to their infrequent execution. Even when > the Doris cluster is entirely free, large queries sometimes fail due to > resource limitations. > > Our question is: > > > 1. Is there any configuration in Doris that can ensure queries > complete successfully when resources are constrained, rather than failing? > 2. Can we expect a feature in future releases that allows large > queries to gracefully utilize available resources and complete without > failing, even when memory is limited? > > We appreciate your insights and guidance on this matter. > > Best regards, >