[Apache TVM Discuss] [Development] Two missing pieces for training

2021-06-09 Thread Altan Haan via Apache TVM Discuss
hey sorry for the delayed reply- in terms of the timeline we are trying to upstream and open source the work around Q3 this year, and in the mean time I'm going to be starting upstreaming TVM improvements. Generally we still could use a good amount of training operator coverage (gradients, los

[Apache TVM Discuss] [Development/RFC] [RFC] Register OPs from python site and followup

2021-05-07 Thread Altan Haan via Apache TVM Discuss
I also wish we could easily add hot pluggable **Relay** operators (whether for testing, easily supporting additional ops, etc.). Unfortunately I believe the main reason (or at least one major reason) this is currently not available is because type relations (and basically all the type inferenc

[Apache TVM Discuss] [Development/RFC] DataLoader -- an API to wrap datasets from other machine learning frameworks

2021-03-30 Thread Altan Haan via Apache TVM Discuss
Thanks, the batched inputs thing makes sense, I misunderstood! I also didn't mean to imply that batch size itself is unnecessary- I do think it's a fairly universal concept for data loading (except for perhaps dynamic models where the input shape changes for each instance, but in this case you

[Apache TVM Discuss] [Development/RFC] [RFC] Rename GraphRuntime and ilk to e.g. GraphExecutor

2021-03-30 Thread Altan Haan via Apache TVM Discuss
perhaps we should rename the existing GraphExecutor? https://github.com/apache/tvm/blob/main/python/tvm/relay/build_module.py#L366 --- [Visit Topic](https://discuss.tvm.apache.org/t/rfc-rename-graphruntime-and-ilk-to-e-g-graphexecutor/9255/15) to respond. You are receiving this because y

[Apache TVM Discuss] [Development/RFC] DataLoader -- an API to wrap datasets from other machine learning frameworks

2021-03-27 Thread Altan Haan via Apache TVM Discuss
Commenting to agree that I like the approach, and strongly believe this will be useful (e.g. for reducing the boilerplate involved with setting up datasets for TVM training, since common datasets already exist in PyTorch or TF). Also agree with Tianqi about the NDArray/DLPack interfacing as we