[Apache TVM Discuss] [Questions] Saving compiled model to a .tar file using Python API

2021-06-21 Thread Josh Fromm via Apache TVM Discuss
Yes `TVMCPackage` (between the `compile` and `run` steps) sounds like what you want. It's the deployable artifact. `TVMCModel` is the high level graph definition. If you wanted to tune a model for a few different hardware targets you could use the one `TVMCModel` to produce several `TVMCPackag

[Apache TVM Discuss] [Questions] Saving compiled model to a .tar file using Python API

2021-06-21 Thread Caleb via Apache TVM Discuss
Ultimately, I'm trying to save off a tuned model as an executable (or something similar). I'm wondering if this should be done between the `tune` and `compile` steps, or between the `compile` and `run` steps. However, I'm a little confused on the difference between the `TVMCModel` and `TVMCPac

[Apache TVM Discuss] [Questions] Questions about TVM executors and its APIs

2021-06-21 Thread Yuchen Jin via Apache TVM Discuss
Interesting findings! I think we should unify these two sets of APIs because they show different behaviors and can confuse the users a lot. I did some measurements on the VM executor recently and found that the code generated by the second style(`relay.build_module.create_executor`) is much wo

[Apache TVM Discuss] [Questions] Recall curve score for XGBoost

2021-06-21 Thread Jorge Sierra via Apache TVM Discuss
Hello ! I have been reading the `custom_callback` function that autotvm uses to train the XGBoost cost model. There are a few things that I would like to ask for clarification if possible: 1. The `init` function checks if the model (bst) has a `best_score` attribute which as I understand mea

[Apache TVM Discuss] [Questions] Questions about TVM executors and its APIs

2021-06-21 Thread Jiawei Liu via Apache TVM Discuss
Another thing is that I am still confused about the executors... There are "graph", "debug" (interpreter), "vm", "aot" ... Some executor cannot support dynamic shapes (i.e., graph). The default optimization passes of them are not the same. I think any instructions on which one should users p

[Apache TVM Discuss] [Questions] Questions about TVM executors and its APIs

2021-06-21 Thread Jiawei Liu via Apache TVM Discuss
Hi @yuchenj, thank you for your kind reply! I want to confirm some follow-up questions and report some issues. It seems in your mentioned line (`Optimize` function, `build_module.cc:303`), a set of (default I think) passes are given. Is that the case: in `BuildRelay` we will collect some **de