{"repo":"MADEVAL/FerryAI","free":true,"listed":false,"github":"https://github.com/MADEVAL/FerryAI","clone":"git clone https://github.com/MADEVAL/FerryAI.git","description":"Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process via FFI. Chat, streaming, embeddings, RAG and vector search. No Python, no HTTP microservices, no Docker sidecars.","language":"PHP","stars":41,"topics":["ai","embeddings","ffi","generative-ai","gguf","inference","llama-cpp","llm","llm-inference","local-llm"],"license":"MIT","category":"ai-agents","readme_excerpt":"FerryAI — native AI inference for PHP Run ONNX, GGUF, and RubixML models directly in PHP — no Python, no HTTP microservices, no Docker sidecars. One API, full FFI bridge to native engines. Inference-only. PHP 8.3+. Status: early release ( v0.1.1 ). The public API is stabilizing and may change before 1.0 — pin a version and skim the CHANGELOG when upgrading. Code quality is production-grade (PHPStan level 8, Psalm level 3, 793 tests green on Windows + Linux). Contents - Quick example - Why FerryAI - Backends - Vector store - Observability & model pool - Install - Dependencies - Capabilities - Packages - Testing - Examples - Documentation - Contributing & license --- Quick example Embeddings & vector search — semantic RAG in 8 lines: Chat & streaming — local LLM in 3 lines: --- Why FerryAI FerryAI Python sidecar --- --- --- Deployment One PHP process. composer require Python runtime + HTTP server + process manager Latency Zero-copy FFI → sub-ms overhead HTTP round-trip per inference Memory Shared weights across workers (shmop) Duplicated per process Debugging PHP stack traces, xdebug Cross-process tracing Structured output JSON Schema → GBNF grammar, guaranteed valid JSON Prompt engineering + regex hacks Model cache Built-in HuggingFace download + LRU cache + SHA-256 verify Manual pip + custom scripts Type safety PHPStan level 8 + Psalm level 3 mypy (optional) Streaming Native PHP Generator + SSE/NDJSON PSR-7 response Flask/FastAPI streaming boilerplate FerryAI loads native sha","default_branch":null,"files":null,"tree":[],"storefront":"/r/MADEVAL","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/MADEVAL/FerryAI/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}