dario-liberman commented on issue #11775: URL: https://github.com/apache/pinot/issues/11775#issuecomment-1761997985
> @dario-liberman Thanks for providing the context! The docs you referenced are actually window functions, and here are some discussions around it #7213. It is not really possible to achieve it with single-stage engine (we can potentially bring everything back to broker, but it is not a scale solution when the table is large). We already have it implemented in the multi-stage engine, and we should explore if this feature can fit into that. cc @walterddr > > @alexch2000 I don't think a new transform function can solve the moving time window problem because this calculation cannot fit into single-stage engine model. I work together with @alexch2000 - I actually suggested this approach so we can have moving windows in single stage. The trick is to take advantage of multivalued group by in Pinot. By assigning each row to multiple windows, one achieves the hopping window behaviour. This function is most useful when one groups by it, similar to how one groups by the regular date time convert to achieve a tumble window. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
