{"repo":"eosphoros-ai/DB-GPT-Hub","free":true,"listed":false,"github":"https://github.com/eosphoros-ai/DB-GPT-Hub","clone":"git clone https://github.com/eosphoros-ai/DB-GPT-Hub.git","description":"A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL","language":"Python","stars":2005,"topics":["sql","text2sql","gpt","llm","text-to-sql","datasets","nl2sql","database","fine-tuning","hacktoberfest"],"license":"MIT","category":"databases-storage","readme_excerpt":"DB-GPT-Hub: Text-to-SQL parsing with LLMs 简体中文 Discord Wechat Huggingface Community Paper Text2SQL Text2NLU 🔥🔥🔥 News - Support Text2NLU fine-tuning to improve semantic understanding accuracy. - Support Text2GQL fine-tuning to generate graph query. Baseline Text2SQL eval execution accuracy (ex) metric, and we will move this to src/dbgpt hub sql - update time: 2023/12/08 - metric: execution accuracy (ex) - more details refer to docs/eval-llm-result.md Model Method Easy Medium Hard Extra All base 0 0 0 0 0 Llama2-7B-Chat lora 0.887 0.641 0.489 0.331 0.626 qlora 0.847 0.623 0.466 0.361 0.608 base 0 0 0 0 0 Llama2-13B-Chat lora 0.907 0.729 0.552 0.343 0.68 qlora 0.911 0.7 0.552 0.319 0.664 base 0.214 0.177 0.092 0.036 0.149 CodeLlama-7B-Instruct lora 0.923 0.756 0.586 0.349 0.702 qlora 0.911 0.751 0.598 0.331 0.696 base 0.698 0.601 0.408 0.271 0.539 CodeLlama-13B-Instruct lora 0.94 0.789 0.684 0.404 0.746 qlora 0.94 0.774 0.626 0.392 0.727 base 0.577 0.352 0.201 0.066 0.335 Baichuan2-7B-Chat lora 0.871 0.63 0.448 0.295 0.603 qlora 0.891 0.637 0.489 0.331 0.624 base 0.581 0.413 0.264 0.187 0.392 Baichuan2-13B-Chat lora 0.903 0.702 0.569 0.392 0.678 qlora 0.895 0.675 0.58 0.343 0.659 base 0.395 0.256 0.138 0.042 0.235 Qwen-7B-Chat lora 0.855 0.688 0.575 0.331 0.652 qlora 0.911 0.675 0.575 0.343 0.662 base 0.871 0.632 0.368 0.181 0.573 Qwen-14B-Chat lora 0.895 0.702 0.552 0.331 0.663 qlora 0.919 0.744 0.598 0.367 0.701 base 0 0 0 0 0 ChatGLM3-6b lora 0.855 0.605 0.477 0.271 0.59 q","default_branch":null,"files":null,"tree":[],"storefront":"/r/eosphoros-ai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/eosphoros-ai/DB-GPT-Hub/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}