@tqchen I'm looking into the following approach: * Initially, the tuple and its fields are marked as Injective, so that they can be fused as much as possible. * Later, if we detect that a tuple is the root of its group in [this line](https://github.com/dmlc/tvm/blob/master/src/relay/pass/fuse_ops.cc#L825), we do all necessary patchwork to make each tuple fields become root in its group and return the tuple itself as a isolated node.
I think this approach requires minimum code change. The patchwork only includes updating some pointers (parent, root_ref, etc). -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmlc/tvm/issues/3039#issuecomment-484388597
