{"repo":"cyberark/FuzzyAI","free":true,"listed":false,"github":"https://github.com/cyberark/FuzzyAI","clone":"git clone https://github.com/cyberark/FuzzyAI.git","description":"A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.","language":"Jupyter Notebook","stars":1564,"topics":["jailbreak","jailbreaking","llm","llms","ai","security","fuzzing","llm-evaluation","llm-security","ai-red-team"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"FuzzyAI Fuzzer The FuzzyAI Fuzzer is a powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify jailbreaks and mitigate potential security vulnerabilities in their LLM APIs. Getting Started Quick start #1 - Using an existing python project 1. Install fuzzyai 2. Run the fuzzer Quick start #2 - or as a standalone project 1. Clone the repository: 2. Install dependencies using Poetry: 3. Run the fuzzer: 4. Optional: Install ollama, and download a model for local usage: Alternativly, you can use the Web UI Web UI (Experimental) 1. Run the Web UI (make sure you completed either of the installation steps from above): Notebooks We've included interactive Jupyter notebooks you can use under src/fuzzyai/resources/notebooks/. For more information, see notebooks wiki. Datasets We've included some datasets you can use under resources/. For more information, see datasets wiki. Documentation Explore detailed usage instructions in the Wiki. Examples If you're using poetry, make sure you've activated the venv (or by prepending 'poetry run' to the command line A default attack (just evaluate the prompt 'Harmful Prompt') using llama over Ollama Attack the prompt utilizing ManyShot and Taxonomy attacks, using gpt3.5 over OpenAI using one worker Attack prompts in prompts.txt utilizing the ArtPrompt attack, using Claude 3.5 over Anthropic --- Attack your own REST API Arguments breakdown: - -a def : Invokes the default attack mode, which evaluates","default_branch":null,"files":null,"tree":[],"storefront":"/r/cyberark","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/cyberark/FuzzyAI/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}