The TinyML examples written in C++

The TinyML examples in C++, ported to the ESP32 can be found at https://github.com/espressif/tflite-micro-esp-examples/tree/master/examples. There you also find the procedures to actually build the programs. In fact there are two methods of building:

• use thee Espressif esp-idf build system
• use the Arduino IDE
• use the MicroPython interface to TensorFlow MicroPython Examples

Arduino

For the Arduino SDK (Software Development Kit) you can install the TensorFlowLite_ESP32 library, which does not only contain the TensforFlowLite library but also the examples

• hello_world
• wake word detection
• person detection
• ... and even some older version of magic wand, which is not available elsewhere

The Hello World application with esp-idf

Let's start with the hello_world example. This example uses a pre-built model that has gone through the training process and it has been quantized to reduce its size such that it can be loaded into the small micro-controller memory. Building, training and quantization is described at https://github.com/tensorflow/tflite-micro/tree/main/tensorflow/lite/micro/examples/hello_world.

We must first tell the idf.py that we are using an ESP32S3 chip:

idf.py set-target esp32s3

After that we may have to clean previous builds:

idf.py fullclean

and finally we can build the hello_world program:

idf.py build

Once the program is built we can flash it and connect the serial monitor to see the results:

idf.py flash monitor

The program repeatedly runs the induction for 20 angle values between 0 and 2Π. These values can easily be captured by redirecting the output to a file. I then used an editor to prepare the data to be plotted with gnuplot.

idf.py flash monitor | tee results.txt

Finally I wrote a simple Python program calculating the correct 20 sine values, which allows to compare them to the results from TinyML.

Creating the model and training it

When working with Machine Learning, data play a primordal role because data are used to train the model and therefore influence the opaque algorithm within the model.

The model for the hello world example is created with the Python script train.py.

-- Uli Raich - 2023-09-02

Comments