{"repo":"telekom/wurzel","free":true,"listed":false,"github":"https://github.com/telekom/wurzel","clone":"git clone https://github.com/telekom/wurzel.git","description":"Wurzel is an open-source Python framework for advanced ETL pipelines in Retrieval-Augmented Generation (RAG) systems.","language":"Python","stars":28,"topics":["etl","llm","pipeline","rag"],"license":"CC0-1.0","category":"ai-agents","readme_excerpt":"wurzel wurzel is the german word for root. So with this framework we provide a combination of the best out of the whole domain of retrieval and beyond. wurzel is an open-source Python library built to address advanced Extract, Transform, Load (ETL) needs for Retrieval-Augmented Generation (RAG) systems. It is designed to streamline ETL processes while offering essential features like multi-tenancy , cloud-native deployment support , and job scheduling . The repository includes initial implementations for widely-used frameworks in the RAG ecosystem, such as Qdrant, Milvus, and Hugging Face, providing users with a strong starting point for building scalable and efficient RAG pipelines. Features - Advanced ETL Pipelines : Tailored for the specific needs of RAG systems. - Multi-Tenancy : Easily manage multiple tenants or projects within a single system. - Cloud-Native Deployment : Designed for seamless integration with Kubernetes, Docker, and other cloud platforms. - Scheduling Capabilities : Schedule and manage ETL tasks using built-in or external tools. - Framework Integrations : Pre-built support for popular tools like Qdrant, Milvus, and Hugging Face. - Type Security : By leveraging capabilities of pydantic and pandera we ensure type security Installation To get started with wurzel, install the library using pip: Run a Step (Two Ways) 1. CLI-based Execution Run a step using the CLI: To inspect the step requirements: 2. Programmatic Execution (Python) Run a step using the snip","default_branch":null,"files":null,"tree":[],"storefront":"/r/telekom","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/telekom/wurzel/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}