[Apache TVM Discuss] [Questions] Confused about kMaxNumGPUs in runtime

2021-11-24 Thread shiy10 via Apache TVM Discuss
Any help ? Besides this, I am also confused about the multi-thread runtime. Obviously the runtime uses C++ threads, but [how cuda kernel launches](https://discuss.tvm.apache.org/t/how-cuda-kernel-is-launched-in-tvm-stack/6167/7?u=shiy10) says tvm supports no runtime concurrency. --- [Vis

[Apache TVM Discuss] [Questions] If target = 'c', how to execute the c program?

2021-11-24 Thread LK via Apache TVM Discuss
Thank you for your reply very much. --- [Visit Topic](https://discuss.tvm.apache.org/t/if-target-c-how-to-execute-the-c-program/11519/19) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.apache.o

[Apache TVM Discuss] [Questions] How to add my custom Relay node to pattern matcher? [EthosU example]

2021-11-24 Thread Lily Orth-Smith via Apache TVM Discuss
I'm also a bit confused about your question, can you clarify what custom_relay_op_3 is, and its relationship to custom_relay_op_1 and custom_relay_op_2? --- [Visit Topic](https://discuss.tvm.apache.org/t/how-to-add-my-custom-relay-node-to-pattern-matcher-ethosu-example/11498/6) to respon

[Apache TVM Discuss] [Questions] If target = 'c', how to execute the c program?

2021-11-24 Thread Andrew Reusch via Apache TVM Discuss
sorry I should clarify. `libtvm_runtime.so` means the TVM C++ runtime library. Compiled TVM models need to be ran using a TVM runtime (there are two--the TVM C++ runtime or the TVM C runtime). The TVM runtime handles details such as calling the compiled operator functions in graph order and me

[Apache TVM Discuss] [Questions] How to add my custom Relay node to pattern matcher? [EthosU example]

2021-11-24 Thread Mark Shields via Apache TVM Discuss
cc @mikepapadim, who's reworking FuseOps to be more Composite+patterns like. --- [Visit Topic](https://discuss.tvm.apache.org/t/how-to-add-my-custom-relay-node-to-pattern-matcher-ethosu-example/11498/5) to respond. You are receiving this because you enabled mailing list mode. To unsubscr

[Apache TVM Discuss] [Questions] How to add my custom Relay node to pattern matcher? [EthosU example]

2021-11-24 Thread Andrew Reusch via Apache TVM Discuss
@cron I think you're asking about how to express a situation where a subgraph of two adjacent Relay operators may match two patterns in the graph partitioning logic. could you elaborate on the exact problem you're having? I think the ordering logic should be sufficient to handle this, but it'd

[Apache TVM Discuss] [Questions] How to add my custom Relay node to pattern matcher? [EthosU example]

2021-11-24 Thread Matt Barrett via Apache TVM Discuss
Hi, Apologies for the delayed reply. I don't entirely follow your question on pattern matching - it seems like what you're talking about there is already possible. Regarding the query about the Ethos-U partitioning/legalizing flow, I think the two routes are essentially equivalent. We partit