{"repo":"meta-llama/synthetic-data-kit","free":true,"listed":false,"github":"https://github.com/meta-llama/synthetic-data-kit","clone":"git clone https://github.com/meta-llama/synthetic-data-kit.git","description":"Tool for generating high quality Synthetic datasets","language":"Python","stars":1629,"topics":["data","generation","llm","python","synthetic"],"license":"MIT","category":"ai-agents","readme_excerpt":"Synthetic Data Kit Tool for generating high-quality synthetic datasets to fine-tune LLMs. Generate Reasoning Traces, QA Pairs, save them to a fine-tuning format with a simple CLI. Checkout our guide on using the tool to unlock task-specific reasoning in Llama-3 family What does Synthetic Data Kit offer? Fine-Tuning Large Language Models is easy. There are many mature tools that you can use to fine-tune Llama model family using various post-training techniques. Why target data preparation? Multiple tools support standardized formats. However, most of the times your dataset is not structured in \"user\", \"assistant\" threads or in a certain format that plays well with a fine-tuning packages. This toolkit simplifies the journey of: - Using a LLM (vLLM or any local/external API endpoint) to generate examples - Modular 4 command flow - Converting your existing files to fine-tuning friendly formats - Creating synthetic datasets - Supporting various formats of post-training fine-tuning How does Synthetic Data Kit offer it? The tool is designed to follow a simple CLI structure with 4 commands: - ingest various file formats - create your fine-tuning format: QA pairs, QA pairs with CoT, summary format - curate : Using Llama as a judge to curate high quality examples. - save-as : After that you can simply save these to a format that your fine-tuning workflow requires. You can override any parameter or detail by either using the CLI or overriding the default YAML config. Installation From P","default_branch":null,"files":null,"tree":[],"storefront":"/r/meta-llama","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/meta-llama/synthetic-data-kit/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}