{"repo":"larq/compute-engine","free":true,"listed":false,"github":"https://github.com/larq/compute-engine","clone":"git clone https://github.com/larq/compute-engine.git","description":"Highly optimized inference engine for Binarized Neural Networks","language":"C++","stars":257,"topics":["larq","binarized-neural-networks","tflite","tensorflow","mlir","bnn","raspberry-pi","keras","armv8","aarch64"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Larq Compute Engine Larq Compute Engine (LCE) is a highly optimized inference engine for deploying extremely quantized neural networks, such as Binarized Neural Networks (BNNs). It currently supports various mobile platforms and has been benchmarked on a Pixel 1 phone and a Raspberry Pi. LCE provides a collection of hand-optimized TensorFlow Lite custom operators for supported instruction sets, developed in inline assembly or in C++ using compiler intrinsics. LCE leverages optimization techniques such as tiling to maximize the number of cache hits, vectorization to maximize the computational throughput, and multi-threading parallelization to take advantage of multi-core modern desktop and mobile CPUs. Larq Compute Engine is part of a family of libraries for BNN development; you can also check out Larq for building and training BNNs and Larq Zoo for pre-trained models. Key Features - Effortless end-to-end integration from training to deployment: - Tight integration of LCE with Larq and TensorFlow provides a smooth end-to-end training and deployment experience. - A collection of Larq pre-trained BNN models for common machine learning tasks is available in Larq Zoo and can be used out-of-the-box with LCE. - LCE provides a custom MLIR-based model converter which is fully compatible with TensorFlow Lite and performs additional network level optimizations for Larq models. - Lightning fast deployment on a variety of mobile platforms: - LCE enables high performance, on-device machine","default_branch":null,"files":null,"tree":[],"storefront":"/r/larq","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/larq/compute-engine/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}