zbtzbtzbt opened a new pull request, #15796: URL: https://github.com/apache/doris/pull/15796
# Proposed changes delete skiplist for dup table when data load. ## Problem summary when load data, data will be insert into skiplist in memtable, for each row skiplist need to **Find** and **Sort**, which time cost is O(log(n)), I don't think it's a good way. There are two ways to insert data into memtable: 1. insert into skiplist: **O(log(n))**, when need flush, the data is already sorted 2. insert into a block(append only): **O(1)**, when need flush, sort once. this pr implement way2 for duplicate table: **append data to a block and sort when need flush.** I don't know how good or bad it turned out This pr needs to use the community's testing framework So I submit first to see the result. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
