[Apache TVM Discuss] [Questions] Can tvm deploy the model on the Intel VPUs (such as Neural Compute Stick)

2022-02-14 Thread Zitong Xu via Apache TVM Discuss
Hi all, Is there any tvm benchmark for compiling TensorFlow models targeting the Intel VPUs such as Neural Compute Stick? Thanks a lot! --- [Visit Topic](https://discuss.tvm.apache.org/t/can-tvm-deploy-the-model-on-the-intel-vpus-such-as-neural-compute-stick/12082/1) to respond. You a

[Apache TVM Discuss] [Questions] Can we get device_type from runtime module?

2021-12-30 Thread Xu via Apache TVM Discuss
Hello, I compiled my relay graph to a DSO library, json graph and a parameter binary file like below: graph, lib, lowered_params = relay.build(mod, target="opencl", target_host="llvm --runtime=c++, params=params) lib.export_library(os.path.join(build_dir, name+".so")) When I'm deploying this

[Apache TVM Discuss] [Questions] How to I use prefetch with GPU codegen

2020-10-12 Thread Zhiying Xu via Apache TVM Discuss
I am facing the same problem with prefetching data from shared mem to registers. Did you solve this? --- [Visit Topic](https://discuss.tvm.apache.org/t/how-to-i-use-prefetch-with-gpu-codegen/7294/2) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe

[Apache TVM Discuss] [Questions] Prefetch shared memory to registers

2020-10-12 Thread Zhiying Xu via Apache TVM Discuss
Hi, everyone For cuda target, I first fetch data from global memory to shared memory, then I want to achieve software pipeline by prefetching some data from shared memory to registers since shared memory request may consume tens of cycles and sometimes even longer. However, the underlying pr

[Apache TVM Discuss] [Questions] Matrix multiplication example for Cuda

2020-10-04 Thread Le Xu via Apache TVM Discuss
Hi! I have been studying how TVM works and I tried out this (https://github.com/apache/incubator-tvm/blob/master/tutorials/autotvm/tune_simple_template.py) tutorial example from the website and it seems like running this example with cuda (or OpenCL) produces errors like: > Cannot find config

[Apache TVM Discuss] [Questions] Profiling TVM Module

2020-09-10 Thread Zhiying Xu via Apache TVM Discuss
Thanks for your reply. I see TVM's C++ API now, I'll try. --- [Visit Topic](https://discuss.tvm.apache.org/t/profiling-tvm-module/7870/5) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.apache.or

[Apache TVM Discuss] [Questions] Profiling TVM Module

2020-09-10 Thread Zhiying Xu via Apache TVM Discuss
I see, but perf can only give a summary of statistics, which include all the program and thereby many noise for profling a Module. Seems there are no tools that we can inspect the cache behavior just for a python code region. --- [Visit Topic](https://discuss.tvm.apache.org/t/profiling-tvm

[Apache TVM Discuss] [Questions] Profiling TVM Module

2020-09-10 Thread Zhiying Xu via Apache TVM Discuss
Hey, I want to profile the TVM module, e.g: cache-misses, LL-CACHE-MISSES etc. How can I do this? --- [Visit Topic](https://discuss.tvm.apache.org/t/profiling-tvm-module/7870/1) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [c