{"repo":"petaly-labs/petaly","free":true,"listed":false,"github":"https://github.com/petaly-labs/petaly","clone":"git clone https://github.com/petaly-labs/petaly.git","description":"Python Open-source ETL tool for seamless data movement across PostgreSQL, MySQL, Redshift, BigQuery, S3, GCS, and CSV files, with yaml/json-based configuration.","language":"Python","stars":17,"topics":["bigquery","csv","gcs-bucket","mysql","postgresql","redshift","s3-bucket","etl","ingestion","python"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"Overview Petaly is an open-source ETL/ELT (Extract, Load, \"Transform\") tool, created by and for data professionals! Our mission is to simplify data movement across different platforms with a tool that truly understands the needs of the data community. Key Features - Multiple Data Sources : Support for various endpoints: - PostgreSQL - MySQL - BigQuery - Redshift - Google Cloud Storage (GCS Bucket) - S3 Bucket - Local CSV files - Features : - Source to target schema evaluation and mapping - CSV file load with column-type recognition - Target table structure generation - Configurable type mapping between different databases - Full table unload/load in CSV format - User-Friendly : No programming knowledge required - YAML/JSON Configuration : Easy pipeline setup - Cloud Ready : Full support for AWS and GCP [EXPERIMENTAL] : Petaly went agentic! The AI Agent can create and run pipeline using natural language prompts. If you're interested in exploring, check out the experimental branch: petaly-ai-agent Feedback is welcome! Quick Start 1. Installation 2. Configuration 3. Create Pipeline 4. Run Pipeline Requirements System Requirements - Python 3.10 - 3.12 - Operating System: - Linux - MacOS Note: Petaly may work on other operating systems and Python versions, but these haven't been tested yet. Installation Basic Installation Cloud Provider Support GCP Support Prerequisites : 1. Install Google Cloud SDK 2. Configure access to your Google Project 3. Set up service account authenticatio","default_branch":null,"files":null,"tree":[],"storefront":"/r/petaly-labs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/petaly-labs/petaly/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}