wangbo edited a comment on issue #3010: Spark load etl interface URL: https://github.com/apache/incubator-doris/issues/3010#issuecomment-592321522 ### 1. add spark job optimize args in jobConfig Every Spark ETL job has different input data,so they have different resource requirements. It's better to add a spark job submit args info in job config in order to adjust every job's usage. User can adjust respective job config to make job running successfully. ### 2. Job Retry In the initial implementation version,I wonder whether we need to support retry interface ,or user need to resubmit the whole job when job failed due to spark memory exceeds and so on. ### 3. What does Fe going to do with interface getEtlFiles? Just a little question.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
