zoy-bot opened a new issue, #48970: URL: https://github.com/apache/doris/issues/48970
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version doris-2.1.6-rc04 ### What's Wrong? - 问题描述 2.1.6版本下创建的表，合并策略为time_series，启用了二次合并"time_series_compaction_level_threshold" = "2"，同时配置 "time_series_compaction_goal_size_mbytes" = "1024"，实际在数据写入、合并完成后仍然有大量低于1024M的dat文件，导致数据文件过多性能未达预期。 - 主要表配置 ``` CREATE TABLE `mytable` ( `in_date` datetime(3) NOT NULL COMMENT '采集时间', `send_date` datetime(3) NULL COMMENT '发送时间', `id` varchar(40) NOT NULL COMMENT '数据ID' INDEX idx_inverted_send_date (`send_date`) USING INVERTED COMMENT 'idx_inverted_send_date', INDEX idx_inverted_log_id (`id`) USING INVERTED PROPERTIES("parser" = "unicode", "support_phrase" = "true") COMMENT 'idx_inverted_log_id', ) ENGINE=OLAP DUPLICATE KEY(`in_date`) COMMENT 'mytable' PARTITION BY RANGE(`in_date`)() DISTRIBUTED BY RANDOM BUCKETS 64 PROPERTIES ( "replication_allocation" = "tag.location.default: 1", "bloom_filter_columns" = "id", "is_being_synced" = "false", "dynamic_partition.enable" = "true", "dynamic_partition.time_unit" = "DAY", "dynamic_partition.time_zone" = "Asia/Shanghai", "dynamic_partition.start" = "-190", "dynamic_partition.end" = "2", "dynamic_partition.prefix" = "p", "dynamic_partition.replication_allocation" = "tag.location.default: 1", "dynamic_partition.buckets" = "64", "dynamic_partition.create_history_partition" = "true", "dynamic_partition.history_partition_num" = "100", "dynamic_partition.storage_medium" = "SSD", "storage_format" = "V2", "inverted_index_storage_format" = "v2", "light_schema_change" = "true", "compaction_policy" = "time_series", "time_series_compaction_goal_size_mbytes" = "1024", "time_series_compaction_file_count_threshold" = "2000", "time_series_compaction_time_threshold_seconds" = "1800", "time_series_compaction_empty_rowsets_threshold" = "5", "time_series_compaction_level_threshold" = "2", "disable_auto_compaction" = "false", "enable_single_replica_compaction" = "false" ); ``` 合并后的tablet信息 <img width="1187" alt="Image" src="https://github.com/user-attachments/assets/c9ab3589-5647-4bea-9733-b2b7b96a4ca3"; /> ### What You Expected? 在启用二次合并"time_series_compaction_level_threshold" = "2"的表上，数据文件可以按配置 "time_series_compaction_goal_size_mbytes" = "1024"进行多次合并，从而减少小文件数量，提升性能 ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
