ai_model_hub_25_Q3

by cix other
6.1K downloads 9 likes on ModelScope updated

Model card

CIX AI Model Hub

The CIX AI Model Hub Models are a collection of state-of-the-art machine learning models optimized for deployment on CIX SOCs.

Setup

Install Python Package

The package is available via pip and apt:

apt install libpython3-dev
pip install -r requirements.txt

Getting Started

Export and Run A Model on a Physical Device

All models in the model hub can be compiled or imported from our pre-built git repo and then run inference on a CIX SOC powered device.

End-To-End Model Samples

Python applications are defined for all models.

These apps are optimized to be an easy-to-follow example, rather than to minimize prediction time.

End-to-end samples:

  1. Preprocess human-readable input into model input
  2. Run model inference
  3. Postprocess model output to a human-readable format

All the models sample codes that can run the model end-to-end on a CIX SOC powered device:

python3 inference_npu.py

Also there are end-to-end samples run locally on host X86 or on CIX SOCs via OnnxRuntime.

python3 inference_onnx.py

LICENSE

CIX AI Model Hub is licensed under Apache-2.0.