Hello,

I have read some posts from forum,but I still confused about that. 
1) If I want to using Relay to build a simple network and heterogeneous 
execution some Ops on gpu and others on cpu. There seem to be two different 
ways.

* One is through relay.annotation.on_device, relay.device_copy  and 
relay.transform.RewriteAnnotatedOps. After that, relay graph will rewrite, and 
I can do relay.build.
But my TVM version is 0.8, it seems not working.  Or Is my usage wrong? I'm not 
sure how to do in current version.
* Another way is part of BYOC, but I just want to try heterogeneous execution 
on gpu and cpu. It doesn't seem to be needed?

2) I want to check that do heterogeneous execution what difference will be on 
the json. I have read some code about Jsonreader and graph_executor. I guess if 
i do heterogeneous execution,json will have some tvm_op which func_name is 
"__copy" to copy data between device,and device_index will denote every node 
should execution on which device. Is my guess correct?

I'm new to TVM, any help or suggestions are massively appreciated!





---
[Visit 
Topic](https://discuss.tvm.apache.org/t/how-to-do-heterogeneous-execution-on-cpu-and-gpu/11561/1)
 to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click 
here](https://discuss.tvm.apache.org/email/unsubscribe/a68180dff30d51b59e919e40cb7813da4a26cb0296b0fd90fe19273c8213f2a9).

Reply via email to