I was trying to run different models in Relay and there is one issue with the executor.evaluate() API. TVM will only take the input with a shape exactly like the input shape of the model, instead of a smaller batch size. And that is commonly acceptable on other frameworks like Keras or PyTorch. For example, instead of doing:
`tvm_out = executor.evaluate()(tvm.nd.array(input_data), **params)` can we do `tvm_out = executor.evaluate()(tvm.nd.array(input_data[:1000]), **params)` in TVM? --- [Visit Topic](https://discuss.tvm.ai/t/use-smaller-input-size-for-relay-execute/6357/1) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.ai/email/unsubscribe/d27b796d593c71cf882480c3adc737a55c36942e0e79322c16f8b297587580bb).