[microTVM] Change apps/microtvm/zephyr_cmsisnn to a microTVM tutorial

[mehrdadh]

In the current state of TVM, Zephyr microtvm project API supports CMSIS-NN and ARM FVP. We could change this directory to a tutorial and use microtvm transport layer with AOT Executor.

cc @Mousius @alanmacd @gromero @leandron

[gromero]

I have no objections to that, but I'd like to know thoughts from @Mousius :-)

[Mousius]

The demo intentionally didn't use the Project API so as to demonstrate how to integrate TVM into an existing project rather than generating it in TVM. I think it's valuable to keep it as is so people can use it as a reference for how to use TVM without generating the entire project?

[gromero]

@mehrdadh I think @Mousius is right, I forgot that we actually have basically two use cases. For instance, one if the user just got a new board and wants to promptly use the Project API to select a platform and a board and run a model without caring about details like RTOS, etc. The other, which is actually demonstrate by the demo in question, is more about how to integrate TVM into an existing project, not necessary Zephyr, or Arduino etc. So I agree with @Mousius to keep it the way it's now :-)

[mehrdadh]

@Mousius @gromero I agree, it makes sense to keep this for the standalone deployment story. I think this has the potential to be more generic and not just specific to use CMSIS. We could change this to be a standalone deployment of microTVM with Zephyr.