gortiz opened a new pull request, #16257: URL: https://github.com/apache/pinot/pull/16257
I've found a bug in MSE when unsupported UDFs are used. Specifically, when servers receive the stage and the UDF is not found, it is not possible to create the operator. Given the submit process is now async, the broker doesn't receive the message. This means that: - Other opchains will be sending and waiting for data to/from the erroneous stage, which will block the correct opchains. - The broker will be waiting for a block that will never arrive. The simplest and IMHO more correct solution is to send the error through the MseBlock.nextBlock() operator. This is achieved in this PR by introducing a new ErrorOperator, which is utilized in PlanNodeToOpChain whenever an error occurs during MseOperator generation. This is done for all operators but the sending mailbox, in which case, if there is an error, we cannot send the generated error -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
