{"repo":"bentoml/BentoCrewAI","free":true,"listed":false,"github":"https://github.com/bentoml/BentoCrewAI","clone":"git clone https://github.com/bentoml/BentoCrewAI.git","description":"Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs","language":"Python","stars":22,"topics":[],"license":null,"category":"ai-agents","readme_excerpt":"BentoCrewAI: Serving CrewAI Agent with BentoML Welcome to the BentoCrewAI project. This project demonstrates how to serve and deploy a CrewAI multi-agent application with the BentoML serving framework. See here for a full list of BentoML example projects. Getting Started This project is a reference implementation designed to be hackable. Download the source code and use it as a playground to build your own agent APIs: Download source code: Ensure you have Python =3.10 💡 For other open-source LLMs, try running openllm hello command to explore more. Next, add the following custom LLM definition to the BentoCrewDemoCrew class, replace with your deployed API endpoint URL: And modify the config/agent.yaml file where you want to use this LLM, e.g.: Trouble shooting BentoML 1.3.x requires opentelemetry-api==1.20.0 while CrewAI requires opentelemetry-api =1.27.0; You may ignore the dependency resolver issue and proceed with the 1.27 version that CrewAi requires. BentoML team will update the package to support the newer version of opentelemetry libraries. Community Join the BentoML developer community on Slack for more support and discussions!","default_branch":null,"files":null,"tree":[],"storefront":"/r/bentoml","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bentoml/BentoCrewAI/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}