{"repo":"jsrl/aemet-elt","free":true,"listed":false,"github":"https://github.com/jsrl/aemet-elt","clone":"git clone https://github.com/jsrl/aemet-elt.git","description":"ELT for AEMET weather data.","language":"Python","stars":16,"topics":["dbt","dlthub","docker","gcp","kestra","terraform","zoomcamp"],"license":null,"category":"deployment-docker-iac","readme_excerpt":"AEMET ELT Table of Contents 1. Problem statement 2. Project solution 3. Tech Stack 4. Prerequisites 5. Datasets 6. Usage 7. Visualization Problem Statement Spain has over 900 meteorological stations across the country that collect valuable weather data. However, accessing and processing this data in a structured manner can be a challenging task, especially when trying to analyze it over different time periods or extract meaningful statistics from it. Project Solution This project leverages the open data APIs provided by AEMET (Agencia Estatal de Meteorología) to collect historical weather data from meteorological stations. The system gathers data for a specific year and processes it to generate detailed statistics on weather measurements (e.g., temperature, humidity, etc.) and the geographical locations of the stations. This approach allows users to easily analyze weather trends, compare station data, and gain insights into the meteorological conditions across the country. Tech Stack - BigQuery : Data Warehouse. - Google Cloud Storage : Object storage service. - Docker : Containerization. - Terraform : Infrastructure as Code. - Kestra : Orchestration. - dlt : Data Loading tool. - dbt : Data Transformation tool. - Looker Studio : Data visualization. Prerequisites Ensure you have the following installed and configured: - A Google Cloud Project with a Service Account and its associated key. - Docker Desktop for containerization. - Terraform for infrastructure provisioning. Datas","default_branch":null,"files":null,"tree":[],"storefront":"/r/jsrl","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/jsrl/aemet-elt/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}