I was trying to run different models in Relay and there is one issue with the 
executor.evaluate() API. TVM will only take the input with a shape exactly like 
the input shape of the model, instead of a smaller batch size. And that is 
commonly acceptable on other frameworks like Keras or PyTorch. For example, 
instead of doing:

`tvm_out = executor.evaluate()(tvm.nd.array(input_data), **params)`

can we do 

`tvm_out = executor.evaluate()(tvm.nd.array(input_data[:1000]), **params)`

in TVM?





---
[Visit 
Topic](https://discuss.tvm.ai/t/use-smaller-input-size-for-relay-execute/6357/1)
 to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click 
here](https://discuss.tvm.ai/email/unsubscribe/d27b796d593c71cf882480c3adc737a55c36942e0e79322c16f8b297587580bb).

Reply via email to