{"repo":"refuel-ai/autolabel","free":true,"listed":false,"github":"https://github.com/refuel-ai/autolabel","clone":"git clone https://github.com/refuel-ai/autolabel.git","description":"Label, clean and enrich text datasets with LLMs.","language":"Python","stars":2327,"topics":["llm","large-language-models","huggingface-transformers","python","langchain","anthropic-claude","gpt-4","data-science","llms","machine-learning"],"license":"MIT","category":"ai-agents","readme_excerpt":"Discord Twitter Website Benchmark ⚡ Quick Install pip install refuel-autolabel 📖 Documentation https://docs.refuel.ai/ 🏷 What is Autolabel Access to large, clean and diverse labeled datasets is a critical component for any machine learning effort to be successful. State-of-the-art LLMs like GPT-4 are able to automatically label data with high accuracy, and at a fraction of the cost and time compared to manual labeling. Autolabel is a Python library to label, clean and enrich text datasets with any Large Language Models (LLM) of your choice. 🌟 (New!) Benchmark models on Refuel's Benchmark Check out our technical report to learn more about the performance of RefuelLLM-v2 on our benchmark. You can replicate the benchmark yourself by following the steps below You can benchmark the relevant model by replacing $model with the name of the model needed to be benchmarked. If it is an API hosted model like gpt-3.5-turbo , gpt-4-1106-preview , claude-3-opus-20240229 , gemini-1.5-pro-preview-0409 or some other Autolabel supported model, just write the name of the model. If the model to be benchmarked is a vLLM supported model then pass the local path or the huggingface path corresponding to the model. This will run the benchmark along with the same prompts for all models. The results.csv will contain a row with every model that was benchmarked as a row. Look at benchmark/results.csv for an example. 🚀 Getting started Autolabel provides a simple 3-step process for labeling data: 1. Spe","default_branch":null,"files":null,"tree":[],"storefront":"/r/refuel-ai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/refuel-ai/autolabel/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}