zhengshengjun commented on PR #16036: URL: https://github.com/apache/doris/pull/16036#issuecomment-1396376921
The background is described in this issue: [15723](https://github.com/apache/doris/issues/15723), where users always use Apache Druid to satisfy such lambada requirements. But changing behavior to make Doris dropping data not belonged to current time window automatically like Druid is not flexible. So we demand a ability to support mutable/immutable partition, the PR works this way: 1. Support mutable property for a partition. 2. The mutable property of a partition is passed from FE to BE in a load procedure 3. If a record's partition is immutable, we mark this row as "un selected" which will not be included in computation of 'max_filter_ratio', so that data write to immutable partition will be neglected and not cause load failure. Use Example: Add immutable partition or modify an partition to be immutable: - alter table test_tbl add [temporary] partition xxx values less than ('xxx') ('mutable' = 'true'); - alter table test_tbl modify partition xx set ('mutable' = 'false'); The result of show partitions:  Write 5 records into table, two of then belongs to immutable partition, the stream load result will be:  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
