[TVM Discuss] [Development/RFC] [RFC][VTA] Support for Cloud Devices (OpenCL-compatible)

2020-06-04 Thread Remotego (4paradigm) via TVM Discuss
Hi hjiang, Thank you very much for your reply! I will try to clarify the two questions you mentioned: > “any OpenCL-compatible devices” and “vendor-specific optimization” are > conflict, could you give more detail about what the plan here to balance this > 2 parts and how to reduce related c

[TVM Discuss] [Development] Conflict with XGBoost when Thrust is enabled

2020-06-04 Thread Junru Shao via TVM Discuss
@hcho3 looks like another symbol conflict? --- [Visit Topic](https://discuss.tvm.ai/t/conflict-with-xgboost-when-thrust-is-enabled/6889/2) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.ai/emai

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread Krzysztof Parzyszek via TVM Discuss
I guess that's ok. Let's see how it works and we can refine it later if needed. --- [Visit Topic](https://discuss.tvm.ai/t/rfc-tvm-target-specification/6844/33) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https

[TVM Discuss] [Development] Conflict with XGBoost when Thrust is enabled

2020-06-04 Thread Wuwei Lin via TVM Discuss
When `USE_THRUST=ON`, unknown CUDA error happened: ``` File "/home/ubuntu/tvm/src/runtime/cuda/cuda_device_api.cc", line 108 CUDA: Check failed: e == cudaSuccess || e == cudaErrorCudartUnloading: unknown error ``` It can be reproduced with the following script ``` import numpy as np import tvm

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread tqchen via TVM Discuss
In most cases we do need to generate the host code together with the device code before we are going to run it. One way to resolve this problem is for re-targettable build is to not specify `target_host` in the program(as they can be optional before split-host-device), and then manually re-sp

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread tqchen via TVM Discuss
fair pt, how about the `llvmjit` and `llvmcpu` proposal? --- [Visit Topic](https://discuss.tvm.ai/t/rfc-tvm-target-specification/6844/31) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.ai/email/

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread Krzysztof Parzyszek via TVM Discuss
Going back to the `target_host` question. Another argument against is that a specific device can be present in different systems with different host processors. This would necessitate having different targets for the same device, if `target_host` is a part of the target description. I don't

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread Krzysztof Parzyszek via TVM Discuss
[quote="tqchen, post:28, topic:6844"] Another way to think about it is that llvm itself is a target, and we happened to have a JIT engine locally for that target. [/quote] This is precisely the point of view that I strongly disagree with. The code that runs is not LLVM IR, it must be compiled

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread tqchen via TVM Discuss
I think there is still value of JIT to be present, as a lot of our current examples depend on it. Another way to think about it is that llvm itself is a target, and we happened to have a JIT engine locally for that target. We can discuss the alternatives, for example, introduce an llvmjit tar

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread Krzysztof Parzyszek via TVM Discuss
The question is "what do we want the target to guarantee?". If we want "llvm" to include both CPU and JIT, then it should always mean that both features are present. Whether the target is local or not is a feature of the runtime environment and not the compiler. On that note, I think we sho

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread tqchen via TVM Discuss
I agree with your concern, one thing we could do is to add default set of keys for an target id, when keys are not explicitly present. For example, cuda will always have cuda and gpu attached to its key during creation time. We cannot automatically add uncommon keys like tensorcore though. Bu

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread tqchen via TVM Discuss
Right now the jit an cpu does not necessarily conflict with each other, as if the target is local, it can be exported normally as a library, if it is a cross compilation target, then we cannot directly execute, but still is able to export to an library. So llvm right now means cpu, and jit if

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread Haichen Shen via TVM Discuss
Keys are an important field in the target to make other modules work. Since the target can be created from json, I'm worried if people forget to add certain keys in the target, it might cause some undesired behavior. --- [Visit Topic](https://discuss.tvm.ai/t/rfc-tvm-target-specification/6

[TVM Discuss] [Development/RFC] [RFC] TVM Target Specification

2020-06-04 Thread Krzysztof Parzyszek via TVM Discuss
Another thought is that we should **remove "llvm" as a target**. Right now target = "llvm" means "cpu", but it also means "jit". We should replace it with something that has a clear meaning, and should be independent of whether the LLVM framework is used to generate code for it or not.

[TVM Discuss] [Development/RFC] [BYOC][runtime] JSON runtime for BYOC

2020-06-04 Thread tqchen via TVM Discuss
I don't think that would become a problem, under the new module serialization https://tvm.apache.org/docs/dev/introduction_to_module_serialization.html We will simply recover several DSOModules, all of them share the same library --- [Visit Topic](https://discuss.tvm.ai/t/byoc-runtime-jso

[TVM Discuss] [Development] Per-axis quantization support for TFLite

2020-06-04 Thread Ramana Radhakrishnan via TVM Discuss
Thanks that sounds like it should be relatively straightforward to integrate. Ramana --- [Visit Topic](https://discuss.tvm.ai/t/per-axis-quantization-support-for-tflite/6726/4) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [c

[TVM Discuss] [Development/RFC] [RFC][Tensor Core] Optimization of Winograd conv2d on Tensor Core

2020-06-04 Thread Blueskyltx via TVM Discuss
Hi Shawn_Inspur, This RFC does not support int8, How should I make it work in int8? Thanks --- [Visit Topic](https://discuss.tvm.ai/t/rfc-tensor-core-optimization-of-winograd-conv2d-on-tensor-core/6543/4) to respond. You are receiving this because you enabled mailing list mode. To unsubs