multithread_model_reasoning

Introduction

Deploy onnx deep learning models for image recognition via multithreaded parallelism

Algorithm Flow

Illustrate

1. test.py is the code for loading multi-threaded processing
2. main.py is the code for loading single-threaded models
3. You can increase the number of threads according to the number of cores in your main controller