pabrahamusa edited a comment on issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493#issuecomment-769222122
@kishoreg @fx19880617 , it crashed again and Pino server stopped consuming messaging and query started to give incorrect results. The errors I can see are below ``` my-pinot-broker-0 broker 2021/01/28 14:15:07.151 ERROR [QueryRouter] [jersey-server-managed-async-executor-3] Caught exception while sending request 549 to server: my-pinot-server-0_R, marking query failed my-pinot-broker-0 broker 2021/01/28 14:15:10.917 ERROR [QueryRouter] [jersey-server-managed-async-executor-3] Caught exception while sending request 550 to server: my-pinot-server-0_R, marking query failed my-pinot-broker-0 broker 2021-01-28T14:15:10.918+0000: 64927.313: Total time for which application threads were stopped: 0.0000965 seconds, Stopping threads too2021/01/28 14:15:11.008 ERROR [QueryRouter] [jersey-server-managed-async-executor-3] Caught exception while sending request 551 to server: my-pinot-server-0_R, marking query failed my-pinot-broker-0 broker 2021/01/28 14:15:12.104 ERROR [DataTableHandler] [nioEventLoopGroup-2-6] Caught exception while handling response from server: my-pinot-server-1_R my-pinot-broker-0 broker 2021/01/28 14:15:12.106 ERROR [DataTableHandler] [nioEventLoopGroup-2-6] Channel for server: my-pinot-server-1_R is now inactive, marking server down my-pinot-broker-0 broker 2021/01/28 14:20:30.912 ERROR [DataTableHandler] [nioEventLoopGroup-2-4] Channel for server: my-pinot-server-0_R is now inactive, marking server down ```` , Stopping threads took: 0.0000264 seconds 2021-01-28T14:29:13.291+0000: 2021/01/28 14:29:13.301 WARN [SegmentColumnarIndexCreator] [Thread-7] Caught exception java.io.IOException: No space left on device while refreshing realtime lucene reader for segment: sblog__0__515__20210128T1354Z sb-pinot-controller-0sb-pinot-server-0 server 21.588: Total time for which application threads were stopped: 0.0003119 seconds, Stopping threads took: 0.0001239 seconds ```` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org