blackfox1983 opened a new issue #2974: 精准uv查询性能过长 URL: https://github.com/apache/incubator-doris/issues/2974 版本：2.13左右更新的master版本代码 测试表： CREATE TABLE `uv_bitmap` ( `sub_trade_id` int(11) NULL COMMENT "", `trade_id` int(11) NULL COMMENT "", `course_id` int(11) NULL COMMENT "", `user_id` bitmap BITMAP_UNION NOT NULL COMMENT "" ) ENGINE=OLAP AGGREGATE KEY(`sub_trade_id`, `trade_id`, `course_id`) COMMENT "OLAP" DISTRIBUTED BY HASH(`sub_trade_id`) BUCKETS 2 PROPERTIES ( "storage_type" = "COLUMN" ); | 数据规模：~2亿 sql : select bitmap_count(bitmap_union(user_id)) from uv_bitmap; 耗时 90s-120s explain select bitmap_count(bitmap_union(user_id)) from uv_bitmap; +------------------------------------------------------------------------------------------------------------+ | Explain String | +------------------------------------------------------------------------------------------------------------+ | PLAN FRAGMENT 0 | | OUTPUT EXPRS:bitmap_count(<slot 1>) | | | PARTITION: UNPARTITIONED | | | | RESULT SINK | | | | 3:AGGREGATE (merge finalize) | | | output: bitmap_union(<slot 1>) | | | group by: | | | tuple ids: 1 | | | | | 2:EXCHANGE | | tuple ids: 1 | | | | PLAN FRAGMENT 1 | | OUTPUT EXPRS: | | PARTITION: RANDOM | | | | STREAM DATA SINK | | EXCHANGE ID: 02 | | UNPARTITIONED | | | | 1:AGGREGATE (update serialize) | | | output: bitmap_union(`user_id`) | | | group by: | | | tuple ids: 1 | | | | | 0:OlapScanNode | | TABLE: uv_bitmap | | **PREAGGREGATION: OFF**. Reason: aggExpr.getChild(0)[aggExpr.getChild(0).toSql()] is not Numeric CastExpr | | partitions=1/1 | | rollup: uv_bitmap | | buckets=2/2 | | cardinality=234779482 | | avgRowSize=10.024232 | | numNodes=4 | | tuple ids: 0 这个查询模式是否有点过长了。我理解doris的性能这个级别的数据应该在ms级。 （druid 25亿数据，1秒左右返回的）
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
