ramabme commented on pull request #7300: URL: https://github.com/apache/pinot/pull/7300#issuecomment-898649318
Add an initial implementation of debug endpoint to get information about the minion PinotTasks queued and information about the subtasks running under each PinotTask batch. The endpoint has a verbositylevel. By default we print only high level summary for completed tasks. For incomplete subtasks prints more detail. If verbositylevel is set to >=10 , prints for all tasks. An example output with default verbosity - the first and the third PinotTask are completed tasks with only high level info , { "Task_RealtimeToOfflineSegmentsTask_1628833546894": { "subTaskInfos": null, "subTaskCount": { "waiting": 0, "error": 0, "total": 1, "running": 0, "completed": 1 }, "startTime": "2021-08-12 22:46:12 PDT", "taskState": "COMPLETED", "executionStartTime": "2021-08-12 22:46:12 PDT" }, "Task_RealtimeToOfflineSegmentsTask_1628833651118": { "subTaskInfos": [ { "startTime": "2021-08-12 22:47:57 PDT", "info": "", "taskConfig": { "configs": { "uploadURL": "http://localhost:18998/segments", "downloadURL": "http://localhost:18998/segments/mytable/mytable__0__5__20210813T0544Z,http://localhost:18998/segments/mytable/mytable__1__5__20210813T0544Z", "windowStartMs": "1388707200000", "segmentName": "mytable__0__5__20210813T0544Z,mytable__1__5__20210813T0544Z", "windowEndMs": "1388793600000", "tableName": "mytable_REALTIME" }, "taskType": "RealtimeToOfflineSegmentsTask" }, "state": "RUNNING", "participant": "Minion_192.168.1.21_9514", "finishTime": null, "taskId": "Task_RealtimeToOfflineSegmentsTask_1628833651118_0" } ], "subTaskCount": { "waiting": 0, "error": 0, "total": 1, "running": 1, "completed": 0 }, "startTime": "2021-08-12 22:47:57 PDT", "taskState": "IN_PROGRESS", "executionStartTime": "2021-08-12 22:47:57 PDT" }, "Task_RealtimeToOfflineSegmentsTask_1628833502672": { "subTaskInfos": null, "subTaskCount": { "waiting": 0, "error": 0, "total": 1, "running": 0, "completed": 1 }, "startTime": "2021-08-12 22:45:14 PDT", "taskState": "COMPLETED", "executionStartTime": "2021-08-12 22:45:14 PDT" } } -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org