morningman opened a new pull request #1546: Fix bugs of Broker load URL: https://github.com/apache/incubator-doris/pull/1546 1. Use same UUID as query ID and load ID of a load execution plan. Each load execution plan has a load ID, and as a plan, there is also a query ID. We can use same UUID as query ID and load ID, for tracing the load process more easily. 2. Change the load ID when retrying a load execution plan. When a load execution plan retry, the load ID should be changed, otherwise BE can not distinguish the old and new load requests. 3. Cancel the running loading task when cancelling the broker load. When user cancel a broker load, the running loading task should also be cancelled, or it may occupies the worker thread for a long time. 4. Remove the unnecessary query report when doing load execution plan. Only the last query report is needed. 5. Add a new BE config `tablet_writer_rpc_timeout_sec`. It is used for RPC of tablet sink. The default is 600 seconds. which is long enough for flushing about 6GB data. The long timeout config will reduce the possibility of encountering `fail to send batch` error when loading. 6. Use `streaming_load_max_mb` instead of `mini_load_max_mb` in BE config. 7. Add more logs for tracing a broker load process easily.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
