tinyML Summit 2022: Compiling TinyML Models with microTVM

tinyML Summit 2022
Software/Tools Session
Compiling TinyML Models with microTVM
Andrew REUSCH, Software Engineer, OctoML

Apache TVM is an open source deep-learning compiler that accepts models from popular frameworks like TFLite, ONNX, or PyTorch and compiles them for devices ranging from datacenter GPUs to mobile phones to bare-metal microcontrollers. In this talk, I’ll describe TVM’s architecture-agnostic approach to the model deployment problem and introduce microTVM, a project within Apache TVM that targets deeply-embedded TinyML applications. I’ll also give an update of our recent efforts around interpreter-free model execution, static memory planning, and heterogeneous compute support.