[TVM Discuss] [Questions] Do TVM runtime threads occupy CPU persistently? How to sleep them in time?

2020-04-02 Thread seavid via TVM Discuss
I read the code runtime/thread_pool.cc, found that enviroment var TVM_THREAD_POOL_SPIN_COUNT control the number of iterations to spin before thread sleep, it's really work in my tests. --- [Visit Topic](https://discuss.tvm.ai/t/do-tvm-runtime-threads-occupy-cpu-persistently-how-to-sleep-t

[TVM Discuss] [Questions] Do TVM runtime threads occupy CPU persistently? How to sleep them in time?

2020-04-01 Thread seavid via TVM Discuss
I have deployed some models in RK 3288, which completed in for example 5ms. But I found that the TVM threads seems consume CPU continuously after the model inference completed. I tested by the following code: tvm::runtime::Module mod = (*tvm::runtime::Registry::Get("tvm.graph_runtime.crea