[TVM Discuss] [Development/RFC] [BYOC][runtime] JSON runtime for BYOC

2020-06-10 Thread Junru Shao via TVM Discuss
An alternative approach might be just using an Array to store key-value pairs, but the problem around is that we need extra effort serializing/deserializing Map from/to Arrays --- [Visit Topic](https://discuss.tvm.ai/t/byoc-runtime-json-runtime-for-byoc/6579/20) to respond. You are rece

[TVM Discuss] [Development/RFC] [BYOC][runtime] JSON runtime for BYOC

2020-06-10 Thread Zhi via TVM Discuss
I thought about array as well. Passing array to initialize is relatively simple. The more tricky part is packing the data and passing them around using packedfunc. --- [Visit Topic](https://discuss.tvm.ai/t/byoc-runtime-json-runtime-for-byoc/6579/19) to respond. You are receiving this b

[TVM Discuss] [Development/RFC] [BYOC][runtime] JSON runtime for BYOC

2020-06-10 Thread tqchen via TVM Discuss
We want to think about alternative ways to pass in the meta data, for example we could call initialize using array instead of Map. While it is OK to use Map in runtime, we will face a similar issue in ucontrollers where it is harder to pass in a Map structure --- [Visit Topic](https://di

[TVM Discuss] [Development/RFC] [RFC][VTA] Support for Cloud Devices (OpenCL-compatible)

2020-06-10 Thread Thierry via TVM Discuss
Thank you for the reply @remotego, I agree with your views. As you mentioned, using OpenCL is a good way to bootstrap an accelerator design quickly. I myself did that with VTA when I wrote it in HLS as a grad student, so I see its value! There are definitely strong pros/cons of HDLs vs. HLS la

[TVM Discuss] [Development/RFC] [BYOC][runtime] JSON runtime for BYOC

2020-06-10 Thread Zhi via TVM Discuss
cc @junrushao1994 as well --- [Visit Topic](https://discuss.tvm.ai/t/byoc-runtime-json-runtime-for-byoc/6579/17) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.ai/email/unsubscribe/e9cc785a0991

[TVM Discuss] [Development/RFC] [RFC][VTA] Support for Cloud Devices (OpenCL-compatible)

2020-06-10 Thread zhang hao (4paradigm) via TVM Discuss
Hi, I think the runtime support here (https://github.com/apache/incubator-tvm/pull/3554) is for uop and instructions sync via PCIe. However, if we want to run a full network (e.g., Resnet), we're still missing layer-wise synchronization/device_copy if two adjacent layers are resident in diff

[TVM Discuss] [Development/RFC] [RFC][VTA] Support for Cloud Devices (OpenCL-compatible)

2020-06-10 Thread Liangfu Chen via TVM Discuss
Considering runtime support, I think the answer is yes, see https://github.com/apache/incubator-tvm/pull/3554 . However, to run the VTA tutorials on PCIe based FPGAs, driver-level support is not yet implemented. --- [Visit Topic](https://discuss.tvm.ai/t/rfc-vta-support-for-cloud-devices-

Re: [apache/incubator-tvm] [RFC] Improve quantized convolution performance for armv8 architectures (#5754)

2020-06-10 Thread Zhao Wu
cc @ajtulloch -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/apache/incubator-tvm/pull/5754#issuecomment-642375802

Re: [apache/incubator-tvm] [RFC] Improve quantized convolution performance for armv8 architectures (#5754)

2020-06-10 Thread Zhao Wu
Thanks for the great work! I have some quick question: 1. Have you tested various models arm cpu? (like A53, A72, A55, A75 and so on). According to fb qnnpack blog, it is not always could get best performance using `umul` compared with `smlal` instruction (used by now). (https://engineering.fb.c

[TVM Discuss] [Development/RFC] [BYOC][runtime] JSON runtime for BYOC

2020-06-10 Thread Zhi via TVM Discuss
Here is the draft PR: https://github.com/apache/incubator-tvm/pull/5770 We may need to use Map to save the variable to constant/NDArray mapping. Should we move the `ModuleInitWrapper` out of runtime because it otherwise needs to have map in the runtime namespace? I used `SourceMetadataModule`

[TVM Discuss] [Development/RFC] [RFC][VTA] Support for Cloud Devices (OpenCL-compatible)

2020-06-10 Thread elnaz92 via TVM Discuss
Hi It seems that there is already runtime support for PCIe based FPGAs (https://discuss.tvm.ai/t/tvm-monthly-july-2019/3600). Is that right? @liangfu @thierry @hjiang @remotego @zhanghaohit Thank you --- [Visit Topic](https://discuss.tvm.ai/t/rfc-vta-support-for-cloud-devices-opencl

[TVM Discuss] [Development/RFC] [RFC][Relay][Topi] Hashtable support

2020-06-10 Thread Junru Shao via TVM Discuss
I am working on a POD-C compliant hash map [[link](https://github.com/apache/incubator-tvm/pull/5740)], which might be helpful some how. However, representing those stuff in Relay IR is still challenging. --- [Visit Topic](https://discuss.tvm.ai/t/rfc-relay-topi-hashtable-support/5842/13

[TVM Discuss] [Development/RFC] Dynamic Ops in Relay

2020-06-10 Thread Josh Fromm via TVM Discuss
Just wanted to add a +1 to A1 as it seems like the best way to gradually move TVM towards dynamism without breaking things in the meantime. --- [Visit Topic](https://discuss.tvm.ai/t/dynamic-ops-in-relay/6909/11) to respond. You are receiving this because you enabled mailing list mode. To

[TVM Discuss] [Development/RFC] Dynamic Ops in Relay

2020-06-10 Thread tqchen via TVM Discuss
Seems we have converged on A1 with the additional clarifications in this thread :slight_smile: --- [Visit Topic](https://discuss.tvm.ai/t/dynamic-ops-in-relay/6909/10) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here]

[TVM Discuss] [Development/RFC] [RFC][Relay][Topi] Hashtable support

2020-06-10 Thread Zhao Wu via TVM Discuss
@lfengad Could we follow up this? Because we have supported String and Array now. --- [Visit Topic](https://discuss.tvm.ai/t/rfc-relay-topi-hashtable-support/5842/12) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here

[TVM Discuss] [Development/RFC] [VTA] Using VTA on a platform withrouth a CPU core

2020-06-10 Thread elnaz92 via TVM Discuss
Hi, I'm new to TVM and want to use VTA on our Intel Stratix10 FPGA. I have some questions regarding that, any feedback would be greatly appreciated. 1- Considering that there is no hard core on our FPGA board, how should we use the runtime? Should we just keep it on the host side/compile mach

[TVM Discuss] [Development/RFC] Dynamic Ops in Relay

2020-06-10 Thread Lixiaoquan via TVM Discuss
Now I think dynamic rank support should be a separated issue. Maybe we can discuss that in another thread. --- [Visit Topic](https://discuss.tvm.ai/t/dynamic-ops-in-relay/6909/9) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [c