npawar commented on pull request #5681: URL: https://github.com/apache/incubator-pinot/pull/5681#issuecomment-657255805
> > > With this, do you think it's possible to support placeholders of some intermediate transform result, without adding them to the schema? > > > Also, can the filter use the transformed column? In other words, is the filtering pre-transformation or post-transformation? > > > > > > Yes, it should be possible now to add placeholders for intermediate results. **Those intermediate results can be used in filter** Filtering is post-transformation, and so any of the results of transformation can be used in filter. > > Glad to know that. Shall we consider pre-transformation filtering on the conditions not involving transform as well, so that we can save some compute cycles on the transformation? > > > However the intermediate results cannot be used in other transform functions at the moment, because we don't follow any particular order while executing the transform functions. This will be supported in the future, when we work on derived columns: #5509 Yes we could certainly make that optimization. Will bring those changes slowly in future PRs. That might bring in additional config, and best if handled on its own. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
