I'd like to ask if there is any plan or any simple way to enable block (NCHWc) 
data format for whole model instead of plain (NCHW)?

After some playing with TVM it seems that the preferred data type is plain. 
Significant exceptions are for Intel CPU and Intel Graphics scheduler which are 
capable of converting from plain to block and back, but it's not optimal as 
overall approach.

It appears that Intel HW prefers  block data format and it would be profitable 
for performance to remove those conversions all together. The idea was to add 
on the model reading stage decision if model should be converted to block or 
plain, but it requires a lot of other changes down the compilation pipeline.

Could anyone comment here what's the plan or solution?





---
[Visit 
Topic](https://discuss.tvm.ai/t/use-block-data-format-for-whole-model/3693/1) 
to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click 
here](https://discuss.tvm.ai/email/unsubscribe/7253a99ac35bd9126ce8395a7f34abfc84720c4378b8fb733f941bfc197795d8).

Tianqi Chen, UW, Seattle, WA, 98105, United States
http://tracking.discuss.tvm.ai/tracking/unsubscribe?msgid=ht_vxQhU7PXcyVoX-puCVQ2

Reply via email to