chenlica commented on issue #4329: URL: https://github.com/apache/texera/issues/4329#issuecomment-4145853190
Then the discussion is no longer about the semantics about these operators. It's more related to scheduling, which is a topic related to the Pasta compiler. @Xiao-zhen-Liu can chime in. In the new diagram you provided, we can materialize each output port for SP1 and SP2. There is a dependency between the two input ports of the Join operator. Interestingly @Xiao-zhen-Liu and I discussed such a case yesterday in a different context. I believe we can solve the problem by forcing the "up port" run first. I believe it's a different topic, and deserves a separate discussion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
