kaijchen opened a new pull request, #20178: URL: https://github.com/apache/doris/pull/20178
## Proposed changes Assign a `flush_serial_id` to `MemTable` early in `DeltaWriter`, and exec the flush in parallel. In this way, we can improve the stream load peformance of 1 tablet unique key tables by around 100%. Stream load 7.5G tpch lineitem table into a 1 tablet unique key table (3 BE, 16C 64G): | replicas | load time (before) | load time (after) | | --- | --- | --- | | 1 | 118s | 50s | | 3 | 161s | 60s | ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
