Hi, @tqchen Is there any plan on the "**Fully Featured Relay AOT**" Compiler?
We have a dynamic-shaped model, which is memory-intensive (the execution time of a single operator is short), the vm's approach is hard to meet our performance requirements, the overhead is too large compared to the operators execution time. So, we want a solution to minimize the overhead introduced by the extra code related to shape calculation and memory management. AOT solution sounds like a good choice, since we can inline the computation related to shape calculation and eliminate the overhead related to interact with the VM. --- [Visit Topic](https://discuss.tvm.apache.org/t/guideline-relay-aot/5977/12) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/dd5902f55b572044c0d1ad0ac6393bbf08e67c77a56e5229b8fd0a07dc9509b6).