morningman opened a new issue #1557: Support loading data into mutil tables in one load execution plan URL: https://github.com/apache/incubator-doris/issues/1557 Currently, Doris only supports loading data into one table in a load execution plan. Which means if user want to load the data from a file to, for example, 4 tables, it has to generate 4 load execution plans, and each plan will read the data from file alone. It is inefficient. So I would like to implement a new load execution plan which contains 2 new plan nodes: 1. DataDuplicateNode DataDuplicateNode will get data from its child (such as BrokerScanNode), and duplicate these data for target tuples. 2. MultiOlapTableSink MultiOlapTableSink is a DataSink, which contains several OlapTableSink. It should be the sink of DataDuplicateNode. The plan fragment should looks like: ``` +--------------------------+ |PlanFragment | | | | +-------------------+ | | |MultiOlapTableSink | | | | | | | | OlapTableSink +-----> TabletsChannel | | | | | | OlapTableSink +-----> TabletsChannel | | | | | | OlapTableSink +-----> TabletsChannel | +---------^---------+ | | | | | | 2. Send | | | | | +--------+--------+ | | | | | | |DataDuplicateNode| | | | | | | +--------+--------+ | | | | | | 1. GetNext| | | | | +--------v--------+ | | | | | | | BrokerScanNode | | | | | | | +-----------------+ | +--------------------------+ ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
