[TVM Discuss] [RFC] About the tensorization interface

2019-07-24 Thread Thierry via TVM Discuss
what do you mean exaclty by "imperfect loop tiling"? On the first issue, tensorization lets us essentially inline high-performance code that implements a matrix-matrix or matrix-vector multiplication inner-loop body. This is very useful when targeting special hardware intrinsics, like perform

[TVM Discuss] [Development] Why no constant(immediate) tensor in TVM IR?

2019-07-24 Thread dixing via TVM Discuss
There is immediate int/uint/float, why we can't have immediate tensor in TVM IR? On some special platforms, some small constant tensors, such as bias, is prefered to be embedded into instruction to get better performance. But I found there seems no chance to do this if we do not have constant

Re: [dmlc/tvm] [RFC] Add AVX512VNNI support for TVM (#3388)

2019-07-24 Thread Jian Weng
I am not sure if tensorize is a good way to suport VNNI: 1. VNNI is not true tensorization, though reduction dimension is introduced. It still operates on 1-D inputs. Due to the design of `tensorization` interface, you need to provide the declared intrin the shape of tensors offloaded, but esse

Re: [dmlc/tvm] [RFC] Add AVX512VNNI support for TVM (#3388)

2019-07-24 Thread Tianqi Chen
@jianyuh can you look into the CI error? -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmlc/tvm/pull/3388#issuecomment-514855270

[dmlc/tvm] [QNN] [RFC] - Adding QNN operators with simple lowering (#3617)

2019-07-24 Thread Animesh Jain
Relevant QNN Dialect RFC - #3591 Some QNN operators like Requantize and Conv2D are more amenable to going through C++ lowering pass. A couple of factors where C++ implementation seems better is - when new operator is conceptually very different from existing operators (Requantize), when input/

[TVM Discuss] [Development] Where vs Select operators in the Tensorflow frontend

2019-07-24 Thread Yong Wu via TVM Discuss
@ydy Where needs to wait dynamism is supported (a few guys are working on dynamism actively) --- [Visit Topic](https://discuss.tvm.ai/t/where-vs-select-operators-in-the-tensorflow-frontend/3373/10) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe

Re: [dmlc/tvm] [RFC][TVM] Extend TensorComputeOp to allow scalar inputs (#2606)

2019-07-24 Thread Tianqi Chen
https://github.com/dmlc/tvm/pull/3391 -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmlc/tvm/issues/2606#issuecomment-514746663

Re: [dmlc/tvm] [RFC][TVM] Extend TensorComputeOp to allow scalar inputs (#2606)

2019-07-24 Thread Tianqi Chen
Closed #2606. -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmlc/tvm/issues/2606#event-2507239534

Re: [dmlc/tvm] [Relay][RFC] Improve testing infrastructure of Relay (#2884)

2019-07-24 Thread Tianqi Chen
Closed #2884. -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmlc/tvm/issues/2884#event-2507237464

Re: [dmlc/tvm] [Relay][RFC] Improve testing infrastructure of Relay (#2884)

2019-07-24 Thread Tianqi Chen
Duplicated with #3154 -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmlc/tvm/issues/2884#issuecomment-514746407

Re: [dmlc/tvm] [Relay][RFC] VM Object and Intepreter value (#3209)

2019-07-24 Thread Tianqi Chen
https://github.com/dmlc/tvm/pull/3391 -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmlc/tvm/issues/3209#issuecomment-514746069

Re: [dmlc/tvm] [Relay][RFC] VM Object and Intepreter value (#3209)

2019-07-24 Thread Tianqi Chen
Closed #3209. -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmlc/tvm/issues/3209#event-2507234264

Re: [dmlc/tvm] [RFC] [Contrib] [Runtime] Minimal runtime (~12kb .text on ARMv7/x86) for subset of TVM models (#3567)

2019-07-24 Thread Andrew Tulloch
@weberlo eg CPU CNNs like mobilenet, resnet, etc. One thing not supported is eg tvm.extern since we don’t support packed funcs. -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmlc/tvm/pull/3567#issuecomm