{"repo":"MarkPhamm/skytrax_reviews","free":true,"listed":false,"github":"https://github.com/MarkPhamm/skytrax_reviews","clone":"git clone https://github.com/MarkPhamm/skytrax_reviews.git","description":"End-to-end ELT pipeline for 160K+ Skytrax airline reviews: Airflow orchestration, BeautifulSoup scraping, S3 staging, Snowflake warehouse, dbt star schema transformation, Terraform IaC, GitHub Actions CI/CD","language":"HTML","stars":13,"topics":["airflow-dags","astronomer","aws-s3","chartjs","chromadb","cicd","crawler-python","dbt","deepseek-r1","dockers"],"license":"MIT","category":"deployment-docker-iac","readme_excerpt":"Skytrax Reviews Analytics Platform End-to-end airline review analytics: scrape AirlineQuality.com → stage on S3 → load Snowflake → dbt star schema (medallion) → Mode dashboards. Source status: AirlineQuality.com (Skytrax) is permanently closed . This platform was built from historical scrapes collected while the site was live; the EL path is a replayable S3/Snowflake archive, not an ongoing feed from that domain. This repo is the umbrella — project narrative, architecture, and links into the part repos. Implementation lives in the extract-load, transformation, and dashboard repositories below. Platform walkthrough — Show → Why → What-if deck ( index.html ) covering modeling, transformation, governance, insight, and DataOps. Demo runbook — live commands per pillar (including break-it-live branches demo/contract-break and demo/bad-data on the transformation repo). Self-selection bias: Skytrax reviews are self-reported. Passengers with extreme experiences are more likely to post, so KPIs are directional , not population-level. --- Repositories Part Repository Owner Purpose --- --- --- --- 1 · Extract & Load skytrax reviews extract load MarkPhamm Scrape 4 review types → S3 ( raw/ / processed/ ) → Snowflake COPY INTO + quality gates + Terraform 2 · Transform & DataOps skytrax reviews transformation MarkPhamm dbt Kimball star schema, incremental fact, slim CI/CD, OIDC, Terraform RBAC, hosted dbt docs 3 · Insight · Delta airline customer exp analysis alyssaqle Mode dashboard — Delta","default_branch":null,"files":null,"tree":[],"storefront":"/r/MarkPhamm","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/MarkPhamm/skytrax_reviews/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}