{"repo":"Ratheshan03/etl-snowflake-azure","free":true,"listed":false,"github":"https://github.com/Ratheshan03/etl-snowflake-azure","clone":"git clone https://github.com/Ratheshan03/etl-snowflake-azure.git","description":null,"language":"Python","stars":16,"topics":["azure","azure-functions","etl-pipeline","grafana","snowflake","weather-api"],"license":null,"category":"analytics","readme_excerpt":"🌦️ ETL Pipeline with Azure, Snowflake & Grafana Welcome to the Weather Data ETL Pipeline project! This end-to-end solution automates weather data extraction, transformation, loading (ETL), and visualization using modern cloud and analytics tools. Built with modular, cloud-native components and a Grafana dashboard for real-time monitoring. Live Dashboard : Grafana Weather Dashboard (https://ratheshan03.grafana.net/goto/SzGuhrANg?orgId=1) --- 📌 Table of Contents - Project Overview - Tech Stack - Architecture - ETL Breakdown - 1. Extraction - 2. Transformation - 3. Loading - Visualization with Grafana - Setup Guide - Automation and Scheduling - How to Contribute - License - References & Docs --- 🧠 Project Overview This project collects live weather data from multiple cities, processes it, and makes it accessible via a Snowflake data warehouse. A Grafana dashboard on top of the pipeline provides intuitive visual insights. Key Features: - Azure Functions for cloud-native ETL automation - Weather API integration - Data transformation and cleaning - Scheduled uploads to Snowflake via Azure Blob Storage - Real-time visual dashboards with Grafana + Snowflake --- 🛠️ Tech Stack Layer Tool/Service ------------------ --------------------- Language Python Orchestration Azure Functions Storage Azure Blob Storage Warehouse Snowflake Visualization Grafana Cloud Scheduling CRON (Azure Timer) --- 🏗️ Architecture --- ⚙️ ETL Breakdown 1. 🔍 Extraction - Source : Public Weather API (e.g., Ope","default_branch":null,"files":null,"tree":[],"storefront":"/r/Ratheshan03","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Ratheshan03/etl-snowflake-azure/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}