{"repo":"future-agi/agent-opt","free":true,"listed":false,"github":"https://github.com/future-agi/agent-opt","clone":"git clone https://github.com/future-agi/agent-opt.git","description":"Open Source Library for Automated Optimization of AI Agent Workflows","language":"Python","stars":73,"topics":["agent","ai-agents","aioptimization","automation","cicd","evaluation","optimization-algorithms"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"agent-opt Close the loop: six prompt-optimization algorithms, any LLM, any metric. Part of the Future AGI open-source platform for making AI agents reliable. Try Cloud (Free) · Docs · Colab · Blog · Discord · Discussions --- Why agent-opt? Prompts are how ambiguity sneaks into an agent. You can tweak one by hand. You can't tweak a hundred, and you definitely can't re-tweak them every time the model behind them changes. agent-opt does the tweaking for you: pick an algorithm, pick a metric, feed it a dataset, and it returns a prompt that beats the one you wrote. Six algorithms, one API. Plug in any LLM via LiteLLM. Score against any of the 50+ metrics from ai-evaluation , or write your own. Production traces feed back in as training data. Six real algorithms Not one toy loop with six labels. Random Search, Bayesian (Optuna), ProTeGi (textual gradients), Meta-Prompt, PromptWizard (mutate-critique-refine), and GEPA (evolutionary Pareto). Pick by problem shape. Any model, any metric LiteLLM under the hood, so OpenAI, Anthropic, Gemini, Bedrock, Azure, Groq, and self-hosted all just work. Score with BLEU, ROUGE, embedding similarity, LLM-as-judge, or any of 50+ ai-evaluation metrics. Or write your own. Built for the Future AGI loop Optimize against traces captured by traceAI . Score with ai-evaluation . Deploy the winning prompt through the Agent Command Center gateway. One loop, on your infrastructure. --- Install Requirements: Python ≥ 3.10 · ai-evaluation ≥ 0.2.2 · litellm ≥ 1.8","default_branch":null,"files":null,"tree":[],"storefront":"/r/future-agi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/future-agi/agent-opt/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}