morningman edited a comment on issue #3063: (#3061) [Spark Load] Doris Support Using Hive Table to Build Global Dict URL: https://github.com/apache/incubator-doris/pull/3063#issuecomment-599387357 Draw a flow, just for review. ``` +-----+ |Doris| +--^--+ | 5. Load to Doris | 2. For each distinct column, | Create a GroupBy table | | +------------+ | +-------------->GroupBy Tbl1| 1. Extract/Transferm | | +------------+ +-------------------+ +--------+-----+---+ +------------+ | Source Data Table +-------------------->intermediate Table+---------->GroupBy Tbl2| +-------------------+ +--------^-----+---+ +------------+ | | +------------+ | +-------------->GroupBy Tbl3| | +-----+------+ 4. Use updated GlobalDictTable | | to update intermediate table. | | 3. Use GroupBy table to (change distinct column's value | | update GlobalDict Table to encoded integer) | | | +-------v-------+ +------------------+GlobalDictTable| +---------------+ ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
