[Apache TVM Discuss] [Questions] What't the arguments order of TVM generated cuda kernel?

2020-11-09 Thread luchangli via Apache TVM Discuss
Do someone knows where are the codes that specify the order of the cuda kernel arguments list or map the build args to the cuda kernel arguments? --- [Visit Topic](https://discuss.tvm.apache.org/t/whatt-the-arguments-order-of-tvm-generated-cuda-kernel/8422/2) to respond. You are receivin

[Apache TVM Discuss] [Questions] What't the arguments order of TVM generated cuda kernel?

2020-11-09 Thread luchangli via Apache TVM Discuss
The arguments list of The tvm.build and Function is the same, however, it is not the same with the generated cuda kernel. For the cuda kernel, I found some times the outputs arguments is before the inputs, while some times it's not. Can I get the order or mapping of the cuda kernel arguments ?

[Apache TVM Discuss] [Questions] Why the mobilenet workload result is all 0.001

2020-11-09 Thread forrest via Apache TVM Discuss
from tvm import relay from tvm.relay import testing import numpy as np from infrastructure import get_ref_result batch_size = 1 num_class = 1000 image_shape = (3, 224, 224) data_shape = (batch_size,) + image_shape out_shape = (batch_size, num_class) dtype="float32" mod, params = relay.testing.m

[Apache TVM Discuss] [Questions] [VM] The performance degradation of VM runtime and Dynamic Shape support compared to Graph Runtime

2020-11-09 Thread Cuiqing Li via Apache TVM Discuss
have you tried some pre-trained model instead of a model created from scratch using relay which has dynamic shape input, how is that performance using vm runtime? --- [Visit Topic](https://discuss.tvm.apache.org/t/vm-the-performance-degradation-of-vm-runtime-and-dynamic-shape-support-comp

[Apache TVM Discuss] [Questions] Doubt in loadbuffer parameters in VTA matrix multiplication tutorial

2020-11-09 Thread Rahul shrivastava via Apache TVM Discuss
I am going through the VTA tutorial for matrix multiplication given in https://tvm.apache.org/docs/vta/tutorials/matrix_multiply.html A_2 is the input vector tensor and B_2 is the weight tensor. As we can see in the lowered code below, the last parameter's value (which corresponds to memory st

[Apache TVM Discuss] [Questions] How can I test the performance of a single operator?

2020-11-09 Thread Tristan Konolige via Apache TVM Discuss
To test without a config, remove the `autotvm.apply_history_best` with statement. `params` is a dictionary mapping from the name of a weight to the actual values of the weight. In this case, you have no weights, so it is just the empty dictionary. --- [Visit Topic](https://discuss.tvm.a

[Apache TVM Discuss] [Questions] Difference with ONNX

2020-11-09 Thread Jhagege via Apache TVM Discuss
Hi, just learned about TVM and seems like a very interesting project. Does it have similar design goals to ONNX ? i.e: Portability and efficient inference on different target hardwares ? Would be glad to understand if they are located on different layers in the Inference stack, and how their p