jackjlli opened a new pull request #6203: URL: https://github.com/apache/incubator-pinot/pull/6203
## Description Currently there is no way to track the status of any job like segmentCreationJob, segmentPushJob in Hadoop or Spark, which are run outside of Pinot cluster. This PR adds submitJobStatus API in PinotTableRestletResource, so that the job status can be tracked in Pinot controller, and some of the fields can be emitted as metrics. After this API gets added, those jobs can make the API call to update the job status in Pinot cluster. E.g. ``` $ curl 'http://localhost:9000/tables/testTable/jobStatus?jobStatus=jobName%3DsegmentCreationJob%3BjobExecutionTime%3D1000%3BjobFailed%3D1%3BerrorMessage%3DNullPointerException' \ -X 'POST' {"status":"Successfully submitted job status for Table: testTable"} ``` The job execution time and job failed will be emitted as metrics as they appear in ControllerGauge. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
