[GitHub] [incubator-doris] whatsgh opened a new issue #5509: Doris 聚合模型bitmap聚合类型性能差的问题

[GitBox]

whatsgh opened a new issue #5509:
URL: https://github.com/apache/incubator-doris/issues/5509


   doris 版本0.13
   表结构：
   
![image](https://user-images.githubusercontent.com/18162700/110923751-312a0780-835c-11eb-9c72-85ec117bce38.png)
   base 表一天差不多1亿左右数据，rollup表聚合后是一天1万条左右
   分区字段是dayStr，分桶字段是channel、pageId，分桶数是10
   问题：命中相同的rollup表，用bitmap聚合的时间是不用bitmap聚合的50-100倍左右。不清楚哪块的问题造成bitmap性能这么差
   以下是bitmap聚合查询sql和耗时：
   select dayStr dt,hourStr hour,channel,pageId,eventId,sum(pv) 
pv,bitmap_count(bitmap_union(uv)) uv   from aggr_user_action_event_rt_v2  where 
dayStr=20210312 and hourStr=9 and channel != '-'  group by dayStr,   hourStr,   
channel,   pageId,   eventId;
   
![image](https://user-images.githubusercontent.com/18162700/110924957-96322d00-835d-11eb-80ac-2de7f188a88f.png)
   以下是不加bitmap聚合查询sql和耗时：
   select dayStr dt,hourStr hour,channel,pageId,eventId,sum(pv) pv   from 
aggr_user_action_event_rt_v2  where dayStr=20210312 and hourStr=9 and channel 
!= '-'  group by dayStr,   hourStr,   channel,   pageId,   eventId;
   
![image](https://user-images.githubusercontent.com/18162700/110925078-b8c44600-835d-11eb-8b64-f605f507da1c.png)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org