wangbo commented on issue #3010: Spark load etl interface URL: https://github.com/apache/incubator-doris/issues/3010#issuecomment-592314531 > I think JobConf should add the level relation(tree) of rollup indexes which can be decided better in FE. > Level relation for rollup data conversion is the strategy in ETL, if we update the strategy later, we can only update the ETL code, so i think it is better to deal with it in ETL. I think we can make a ``RollupUtil```,it read input info(table schema) and calculate the rollup relation,then we can package it into a jar which would be submitted with spark jar. So we can use it both in Fe and ```EtLJob```.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
