{"repo":"OBAA/fastembed-server","free":true,"listed":false,"github":"https://github.com/OBAA/fastembed-server","clone":"git clone https://github.com/OBAA/fastembed-server.git","description":"Self-hosted fastembed embedding server with CPU and GPU based images.","language":"Python","stars":34,"topics":[],"license":null,"category":"self-hosted-apps","readme_excerpt":"FastEmbed API Server: [Self-hosted] [CPU] [GPU] This document describes a set of Docker images designed to provide readily deployable FastEmbed embeddings API services for your projects. The aim is to simplify the integration of text embedding generation with both CPU and GPU acceleration, now featuring integrated monitoring and structured logging. --- Project Overview This project offers Docker containers for running FastEmbed as a service, enabling easy access to text embeddings for various NLP tasks. By providing both CPU and GPU options, you can choose the best performance based on your available hardware. Both variants now include built-in Prometheus metrics for HTTP request performance monitoring and structured JSON logging for detailed event analysis. --- Docker Images Two Docker images are available: 1. itsobaa/fastembed:latest (CPU) Size: Approximately 245.3 MB [ 397MB uncompressed ] Purpose: Optimized for CPU-based text embedding generation using the fastembed library, now with enhanced observability features. 2. itsobaa/fastembed-gpu:latest (GPU) Size: Approximately 2.7 GB [ 4.25GB uncompressed ] Purpose: Includes NVIDIA drivers and fastembed-gpu for GPU acceleration. It attempts to use the GPU and falls back to CPU if GPU initialization fails. Recommended for faster embedding generation on NVIDIA GPUs, also with enhanced observability. --- Usage Both services expose an identical HTTP API on port 8000 within their respective containers, along with a dedicated metri","default_branch":null,"files":null,"tree":[],"storefront":"/r/OBAA","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/OBAA/fastembed-server/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}