gortiz commented on issue #14196: URL: https://github.com/apache/pinot/issues/14196#issuecomment-2597012194
Please let me know if I'm wrong, but the dynamic broadcast is currently limited to semi-joins. Am I right? What we would like to do is to apply dynamic filtering even for inner-joins where the right relation is being used to project columns (as it is used in Trino). For example: ```mermaid flowchart BT InnerJoin ExchangeLeft ExchangeRight ScanA ScanB ExtraB[...] ExchangeLeft --> InnerJoin ScanA --> ExchangeLeft ExchangeRight --> InnerJoin ExtraB --> ExchangeRight ScanB --> ExtraB ``` Will be transformed into something like: ```mermaid flowchart BT InnerJoin ExchangeLeft ExchangeRight["ExchangeRight (spool)"] ScanA ScanB ExtraB[...] ExchangeLeft --> InnerJoin ExchangeRight --> InnerJoin ExtraB --> ExchangeRight ScanB --> ExtraB FilterIn --> ExchangeLeft ScanA --> FilterIn ExchangeRight -->|only keys and pipeline breaker| FilterIn ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org