I have a tensorflow model. The cpu inference performance is poor when the batch is 500 online. After using TVM optimization, the performance of 500 times is much worse than tensorflow. Can TVM support batch inference?
--- [Visit Topic](https://discuss.tvm.ai/t/can-tvm-now-support-batched-inference/6405/1) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.ai/email/unsubscribe/c89306b5c08d2ce3979c25335ccf9a91c36ef82edcabf65062750bf82cfb62c6).
