geoffreytran commented on issue #39511: URL: https://github.com/apache/doris/issues/39511#issuecomment-2351798514
Sure, group commit is currently used for aggregating inserts on a **unique key** table in group commit **sync mode**. It currently works on Doris <=2.1, but does not appear to be working under the 3.0 storage decoupled mode. I've not had a chance yet to test with 3.0.1 which looks like there are fixes related to group commit. ```sql create table if not exists test_table ( workspace_id int not null comment "Workspace id", anonymous_id varchar(64) comment "Anonymous id", user_id varchar(64) comment "User id", tenant_id int not null comment "Tenant id", created_at datetime not null default current_timestamp(0) comment "Created at" ) engine=olap unique key (workspace_id, anonymous_id, user_id) distributed by hash(workspace_id, anonymous_id) properties ( "replication_allocation" = "tag.location.default: 3", "bloom_filter_columns" = "anonymous_id, user_id", "enable_unique_key_merge_on_write" = "true", "store_row_column" = "true", "light_schema_change" = "true", "group_commit_interval_ms" = "1000" ); ``` ```sql set enable_insert_strict = true, group_commit = sync_mode; insert into test_table (workspace_id, anonymous_id, user_id, tenant_id, created_at) values (1, 'test', 'test', 1, '2023-01-01 00:00:00'); insert into test_table (workspace_id, anonymous_id, user_id, tenant_id, created_at) values (1, 'test', 'test', 1, '2023-01-01 00:00:00'); insert into test_table (workspace_id, anonymous_id, user_id, tenant_id, created_at) values (1, 'test', 'test', 1, '2023-01-01 00:00:00'); ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org