Have you try to `analyze` the table before doing the query? The error you encountered means the memory is not enought the run the query. There are several reasons: 1. Query plan is not optimized(eg, should use shuffle join instead of broadcast join), you can try `analyze` the table first. 2. If it still not work, may be you have to upgrade your machine's memory.
-- Best Regards Mingyu Chen Email: morning...@apache.org At 2023-12-16 23:46:11, "Annamaraja, Sai Krishna" <sai.k.annamar...@accenture.com.INVALID> wrote: >Hi Mingyu Chen, > >Please find the details below: > > > 1. Doris version: 2.0.2 > 2. Cluster info: We have installed Doris on Azure virtual machine. Below > are the details of it > >vCPU's: 4 >RAM: 16GB > >Storage: 1 TB Premium SSD LRS > >Please let me know if you need anything else. > >Thanks & Regards, >Sai Krishna. A > >From: Mingyu Chen <morning...@163.com> >Sent: Tuesday, December 12, 2023 7:14 PM >To: dev@doris.apache.org >Cc: Misra, Kapildev <kapildev.mi...@accenture.com>; Annamaraja, Sai Krishna ><sai.k.annamar...@accenture.com> >Subject: [External] Re:Need Technical support > >CAUTION: External email. Be cautious with links and attachments. > >Please provide the followings so that we I can help you: > >1. Doris version >2. You cluster info, cpu, mem, number of BE/FE nodes, etc. >3. you can also try analyzing the table before query, see: >https://doris.apache.org/docs/query-acceleration/statistics<https://urldefense.com/v3/__https:/doris.apache.org/docs/query-acceleration/statistics__;!!OrxsNty6D4my!_XqLeVqQs_zguXGqUh5MhYkuDrjiIUUzZjgsO88qXbvRcjC-2dj_SnhVhDSoM3CcVDMeiStJxC90kISF6UDakOMiDzQ$> > > > > > >-- >Best Regards >Mingyu Chen > >Email: >morning...@apache.org<mailto:morning...@apache.org> > > > >At 2023-12-12 18:39:11, "Phadke, Trushna" ><trushna.dipak.pa...@accenture.com.INVALID<mailto:trushna.dipak.pa...@accenture.com.INVALID>> > wrote: > >>Hello Team, > >> > >>Good afternoon. I am Trushna, and for our team, I am doing a POC on Apache >>Doris, we are kind of checking if it provides us expected performance. > >>During this POC , I pushed some of the data(141 GB) to Doris and was trying >>to execute one complex query, where I am getting below error: > >> > >>Execution failed: Error Failed to execute sql: java.sql.SQLException: errCode >>= 2, detailMessage = (172.18.2.11)[CANCELLED]Process has no memory available, >>cancel top memory usage query: query memory tracker >><Query#Id=fbae8e88030b43f9-95bac64a06eb90bd> consumption 10.01 GB, backend >>172.18.2.11 process memory used 12.11 GB exceed limit 12.45 GB or sys mem >>available 1.52 GB less than low water mark 1.56 GB. Execute again after >>enough memory, details see be.INFO. > >> > >> > >>On searching this, I got few suggestions to put some parameters in be.conf >>and fe.config file (parameters like be_mem_limit, be_low_water_mark), which I >>did try, but I am still stuck at same issue. > >>Can you guys help me to understand which config parameters can settle this >>issue, or any other method you suggest, Please guide me. > >> > >> > >>Thank you, > >>Trushna Phadke. > >> > >> > >> > >> > >> > >>________________________________ > >> > >>This message is for the designated recipient only and may contain privileged, >>proprietary, or otherwise confidential information. If you have received it >>in error, please notify the sender immediately and delete the original. Any >>other use of the e-mail by you is prohibited. Where allowed by local law, >>electronic communications with Accenture and its affiliates, including e-mail >>and instant messaging (including content), may be scanned by our systems for >>the purposes of information security, AI-powered support capabilities, and >>assessment of internal compliance with Accenture policy. Your privacy is >>important to us. Accenture uses your personal data only in compliance with >>data protection laws. For further information on how Accenture processes your >>personal data, please see our privacy statement at >>https://www.accenture.com/us-en/privacy-policy. > >>______________________________________________________________________________________ > >> > >>http://www.accenture.com
