{"repo":"bentoml/BentoLangGraph","free":true,"listed":false,"github":"https://github.com/bentoml/BentoLangGraph","clone":"git clone https://github.com/bentoml/BentoLangGraph.git","description":"Serving LangGraph Agent as REST API with BentoML, optionally with self-host open-source LLMs","language":"Python","stars":13,"topics":[],"license":null,"category":"ai-agents","readme_excerpt":"LangGraph Serving with BentoML This repo demonstrates how to serve LangGraph agent application with BentoML. See here for a full list of BentoML example projects. Overview - AI Agent Serving : Serving LangGraph Agent as REST API for easy integration - Flexible Invocation : Supports both synchronous and asynchronous (queue-based) interactions. - Deployment Options : Run locally or deploy to BentoCloud for scalability. - LLM Deployment : Use external LLM APIs or deploy open-source LLM together with the Agent API service This project serves as a reference implementation designed to be hackable, providing a foundation for building and customizing your own AI agent solutions. Getting Started Download source code: Follow the step-by-step guide for serving & deploying LangGraph agents with BentoML: - Anthropic Claude 3.5 Sonnet - Ministral 8B Troubleshoot When running the example code which uses DuckDuckGo search tool, you may run into the following rate limit error: You may use a different tool from LangChain's pre-built tools list here or create a custom tool. For example, you can use exa to replace DuckDuckGo for search: Interested in using LangGraph with other open-source LLMs? Checkout BentoVLLM for more sample code. Community Join the BentoML developer community on Slack for more support and discussions!","default_branch":null,"files":null,"tree":[],"storefront":"/r/bentoml","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bentoml/BentoLangGraph/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}