6.1 Models Introduction
  • 03 Oct 2022
  • 1 Minute to read
  • Dark
    Light

6.1 Models Introduction

  • Dark
    Light

Article summary

6.1 Models Introduction

6.1.1 Understanding the Model Concept

Models are executed under the Predict Engine software of the KoiosLT platform.  There are two (2) layers to the Predict Engine that are licensed functions of the software, and each layer is licensed separately.

  • Model Manager: Licensed only once per KoiosLT based on CPU, or Accelerator, and is responsible for scheduling and monitoring each of the models uploaded into the KoiosLT system.
  • Models:  Licensed independently, and is uploaded into the KoiosLT Model Manager as tflite files.  Model Licenses, by default, are sold in bundles of 5 Models.

6.1.2 Model Files

The model files are uploaded into the system as tflite files.  The KoiosLT platform only limits, by license count, the number of enabled tflite files managed by the KoiosLT Model Manger.  

More about tflite-runtime.....
To learn more about tflite files, and how they are created and executed, please visit the TensorFlow Lite webpage at, https://www.tensorflow.org/lite/guide.  The backend to every KoiosLT software platform's Predict Engine runs tflite-runtime, which is TensorFlow Lite's official solution for running machine learning models on mobile and embedded devices.  You can view the Open Source Disclosure for tflite-runtime by referring to, Open Source Disclosures.

6.1.3 Model Bindings

Each model will have a declared number of inputs and outputs that are scanned by the KoiosLT system upon file upload.  The system correctly builds these requirements based on how the model was trained.  Each input and output must have a tag assigned, or bound, to it for the model to run.