{"repo":"aallan/benchmarking-ml-on-the-edge","free":true,"listed":false,"github":"https://github.com/aallan/benchmarking-ml-on-the-edge","clone":"git clone https://github.com/aallan/benchmarking-ml-on-the-edge.git","description":"Benchmarking machine learning inferencing on embedded hardware.","language":"Python","stars":27,"topics":["benchmark","benchmarking-framework","coral-tpu","jetson-nano","machine-learning","movidius","raspberry-pi","tiny-ml","small-ai"],"license":"MIT","category":"machine-learning","readme_excerpt":"Benchmarking Machine Learning on the Edge and the MobileNet v1 SSD 0.75 depth model (right hand bars, green), trained using the Common Objects in Context (COCO) dataset with an input size of 300×300.\") Inferencing time in milli-seconds for the for MobileNet v2 model (left hand bars, blue) and the MobileNet v1 SSD 0.75 depth model (right hand bars, green), trained using the Common Objects in Context (COCO) dataset with an input size of 300×300. Board Framework Connection MobileNet v2 (ms) MobileNet v1 (ms) --- --- --- --- --- Jetson Nano TensorFlow 309.3 276.0 Jetson Nano TensorRT 72.3 61.6 Coral Dev Board Edge TPU 20.9 15.7 Coral USB Accelerator Edge TPU USB2 58.1 49.3 Coral USB Accelerator Edge TPU USB3 18.2 14.9 Movidius NCS OpenVINO USB2 204.5 115.7 Movidius NCS OpenVINO USB3 176.4 88.4 Intel NCS2 OpenVINO USB2 118.6 87.2 Intel NCS2 OpenVINO USB3 80.4 52.8 Raspberry Pi 3, Model B+ TensorFlow 654.0 480.3 Raspberry Pi 4 TensorFlow 483.5 263.9 Raspberry Pi 5 TensorFlow 148.9 66.2 Raspberry Pi 3, Model B+ TensorFlow Lite 379.6 271.5 Raspberry Pi 4 TensorFlow Lite 112.6 82.7 Raspberry Pi 5 TensorFlow Lite 23.5 16.9 The latest results are presented in the article benchmarking the Raspberry Pi 5. NOTE: See the documentation directory for instructions on how to install TensorFlow and TensorFlow Lite, and how to run the benchmarking scripts on your hardware. Getting Started with Google's Edge TPU Hands on with the Coral Dev Board How to use a Raspberry Pi to flash the new firmware ","default_branch":null,"files":null,"tree":[],"storefront":"/r/aallan","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/aallan/benchmarking-ml-on-the-edge/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}