So you want to run on CPU instead of GPU? What's the error you are seeing after changing the target? The inference script in my repo won't work because I think some of the convolution layouts are not supported yet in CPU x86 computation. If you want to run the quantized NNs on CPU, you may need to tweak the data layout depending on what's supported now.
--- [Visit Topic](https://discuss.tvm.apache.org/t/rfc-tensorcore-int4-end-to-end-inference/7534/25) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/49213db6cdf4ce21c64df40bd5f6d766e34f2362dd85e4ed993e9ba00e847ba3).
