{"repo":"peter115342/soccer-tracker-DE-project","free":true,"listed":false,"github":"https://github.com/peter115342/soccer-tracker-DE-project","clone":"git clone https://github.com/peter115342/soccer-tracker-DE-project.git","description":"End-To-End Data Engineering Project. Made to learn some common data engineering practices.","language":"Python","stars":20,"topics":["cloud-run-functions","data-engineering","data-pipeline","etl","firebase","football","gcp","python","soccer","svelte"],"license":"MIT","category":"data-pipelines","readme_excerpt":"⚠️ LEARNING PROJECT: This is a personal learning project in the field of data engineering. I understand the architecture might not be the most optimal as this project. I made this to practise and learn. Feedback and suggestions are highly welcomed! Football Statistics Tracker 📊⚽ An end-to-end data engineering pipeline that collects, processes, and analyzes football match results, standings data, weather data, Reddit data and summarizes matchdays using Gemini from the top 5 European leagues. Used data sources include football-data.org API, Open-Meteo API, and PRAW (Reddit API), Maps... Introduction This project demonstrates a complete data pipeline for football (soccer) results, from data extraction to visualization. It implements some data engineering practices including data lakes, transformation layers, and Infrastructure as Code (IaC) with Terraform. Features - Automated Data Collection : Scheduled data fetching from multiple APIs using Google Cloud Functions - Multi-layer Data Architecture : Raw data stored in GCS, processed data in BigQuery, and user-facing data in Firestore - Weather Integration : Match statistics with weather data at match time - Social Media (Reddit) Data : Reddit comments for fan sentiment - Infrastructure as Code : Cloud Functions and Pub/Sub subscriptions and topics defined and deployed with Terraform Architecture The pipeline follows the following architecture: 1. Data Ingestion : Cloud Functions trigger on schedule to fetch data 2. Storage Layer","default_branch":null,"files":null,"tree":[],"storefront":"/r/peter115342","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/peter115342/soccer-tracker-DE-project/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}