[Apache TVM Discuss] [Development] [RFC] Standalone Code Generation and C Runtime for STM32 bare-metal devices

2021-03-29 Thread Andrew Reusch via Apache TVM Discuss
hi @stoa, Thanks for the elaborate RFC here! You bring up a bunch of great points. This is a really strong proposal and I think overall fairly well aligned with the direction I want to take microTVM. Particularly since similar code has been posted to the forum before, it would be great to h

[Apache TVM Discuss] [Development/RFC] [RFC] Rename GraphRuntime and ilk to e.g. GraphExecutor

2021-03-29 Thread Andrew Reusch via Apache TVM Discuss
PR 7365 has landed -- heads-up that at `main`, GraphRuntime is now named GraphExecutor! VM version to follow. --- [Visit Topic](https://discuss.tvm.apache.org/t/rfc-rename-graphruntime-and-ilk-to-e-g-graphexecutor/9255/14) to respond. You are receiving this because you enabled mailing li

[Apache TVM Discuss] [Development/RFC] [RFC] TensorIR: A schedulable IR for TVM

2021-03-29 Thread Junru Shao via Apache TVM Discuss
@masahi Yeah. We should allow to embed IR fragments, functions that produce IR fragments, or replace some tokens with caller specified IR fragments into the script :-) --- [Visit Topic](https://discuss.tvm.apache.org/t/rfc-tensorir-a-schedulable-ir-for-tvm/7872/61) to respond. You are r

[Apache TVM Discuss] [Development/RFC] [RFC] TensorIR: A schedulable IR for TVM

2021-03-29 Thread masahi via Apache TVM Discuss
@junrushao1994 If by "meta programming" you mean an ability to call python function from script to generate other code, and embed the generated code into the calling context, then YES, we absolutely need this! I think it's called "splicing" or "unquote" in the literature. The lack of such fe

[Apache TVM Discuss] [Development/RFC] DataLoader -- an API to wrap datasets from other machine learning frameworks

2021-03-29 Thread Lily Orth-Smith via Apache TVM Discuss
@altanh Thanks for the input. I think you're right, knowledge of the layout is not required, and I can remove that. With regard to your concern about the list of ndarrays -- the ndarrays in the list are meant to be batched (I should make this clearer in the documentation, though). The intenti

[Apache TVM Discuss] [Development/RFC] [RFC] TensorIR: A schedulable IR for TVM

2021-03-29 Thread Junru Shao via Apache TVM Discuss
Yeah, to fully replace IRBuilder, there are still some missing elements of TVM script: meta programming and hygiene macros. Let's consider the support after the upstreaming is done :-) CC @tqchen --- [Visit Topic](https://discuss.tvm.apache.org/t/rfc-tensorir-a-schedulable-ir-for-tvm/787

[Apache TVM Discuss] [Development] [RFC] Standalone Code Generation and C Runtime for STM32 bare-metal devices

2021-03-29 Thread Arthur Stoutchinin via Apache TVM Discuss
# Standalone code generator and C runtime for STM32 bare-metal devices ## Background This RFC aims to collect the TVM community feedback on the following subjects: - Standalone compilation targeting embedded bare-metal platforms - ML user API for embedded applications - Integration of the TVM w

[Apache TVM Discuss] [Development/RFC] [RFC] TensorIR: A schedulable IR for TVM

2021-03-29 Thread Siyuan Feng via Apache TVM Discuss
Thanks for such a great suggestion. Yes, we do support IRBuilder for TensorIR. However, it is not recommended. Because it is likely to generate illegal or opaque IR (which lacks some of the information). Besides, there are so many attributes/annotations (e.g block read/write regions and block

[Apache TVM Discuss] [Development/RFC] [RFC] TensorIR: A schedulable IR for TVM

2021-03-29 Thread Siyuan Feng via Apache TVM Discuss
Thanks, @yzh119. Currently, we have not considered the cross-kernel schedule in TensorIR. But it may be possible if we make it as one large kernel. Could you please show an example? (e.g. the IR before and after the schedule) --- [Visit Topic](https://discuss.tvm.apache.org/t/rfc-tensorir