[Apache TVM Discuss] [Development/RFC] [RFC][Quantization] A new quantization framework in TVM: initial RFC (1/4)

2021-04-26 Thread M1k3 via Apache TVM Discuss
[quote="electriclilies, post:21, topic:9775, full:true"] @mikeseven Yes, the goal is to create a fully quantized graph, and we do recognize that this transformation will change the output of the graph. For this reason, we're not going to present the rewrite as a Relay pass. And I definitely agr

[Apache TVM Discuss] [Development/RFC] [RFC][Quantization] A new quantization framework in TVM: initial RFC (1/4)

2021-04-25 Thread M1k3 via Apache TVM Discuss
I'd like to make sure the end goal of this framework is to create a fully quantized graph, ie with all operators in affine space. Unlike the usual transformation contraint in TVM that graph rewrite doesn't change outcome, for quantization, it obviously does. Statistics must be available to he

[Apache TVM Discuss] [Development/RFC] [C/C++ runtime] multimodel support

2020-11-25 Thread M1k3 via Apache TVM Discuss
Thanks for splitting the proposal. Replying about F1 Yes we can generate multiple libraries but the issue is linking them together. Specifically, there is no way to differentiate inputs vs params/weights. There is no way to know the name of the outputs as they have been mangled after simplifi

[Apache TVM Discuss] [Development/RFC] [C/C++ runtime] multimodel support

2020-11-24 Thread M1k3 via Apache TVM Discuss
In scenarios where multiple models are used back to back, with multiple inputs and outputs, TVM doesn't produce helpful native libraries to connect them: - `get_num_inputs()` returns all tensors instead of only the inputs of the model - `get_output(id)` has no support for strings. And since out

[Apache TVM Discuss] [Development] ScatterND missing

2020-10-26 Thread M1k3 via Apache TVM Discuss
ScatterND is used in TFLite and ONNX, notably on Yolo v5 models. @jainris asked for it in August too but it doesn't seem to be available in latest code. Is there any plan to support it? Thanks, --mike --- [Visit Topic](https://discuss.tvm.apache.org/t/scatternd-missing/8292/1) to respo

[Apache TVM Discuss] [Development/RFC] [RFC] CSE Optimization

2020-10-17 Thread M1k3 via Apache TVM Discuss
I suppose CSE would solve my question earlier where 2 identical adds with the same tensor shapes where not simplified as 1 add with both tensors added? --- [Visit Topic](https://discuss.tvm.apache.org/t/rfc-cse-optimization/8130/7) to respond. You are receiving this because you enabled ma