{"repo":"vedanthv/data-engineering-portfolio","free":true,"listed":false,"github":"https://github.com/vedanthv/data-engineering-portfolio","clone":"git clone https://github.com/vedanthv/data-engineering-portfolio.git","description":"Cool DE Projects","language":"Jupyter Notebook","stars":77,"topics":["aws-projects","data","data-engineering","data-modelling","databricks","portfolio-project","python","sql"],"license":null,"category":"data-pipelines","readme_excerpt":"Hello World! I'm Vedanth. This is a complete portfolio of the projects I have designed with a major focus on implementing various data engineering tech and cloud services. Feel Free to Connect with me 🤠 LinkedIn GitHub Quick Links Here is an index of projects with the tech, domain and link. Real Time Streaming and Analytics Project Tech :---------: :---------: Realtime Vehicle Fleet Monitoring Analysis Redpanda,Apache Flink,Clickhouse,Metabase,Docker,Kubernetes InvestIQ Metrics AWS EC2,Docker,Airflow,ReapidAPI,AWS Lambda,AWS S3,AWS CloudWatch,AWS Redshift,Prometheus,Grafana,PowerBI Small Data Engineering And Analytics Projects Project Tech :---------: :---------: Pt 1 : Streaming ETL with Airflow Orchestrator and Postgres DB Near Realtime Streaming,SQL Database, Kafka, Cricket! Pt 2 : Serving Postgres Data using FastAPI Backend API Development, Streaming Data Pt 3 : Frontend Web App Powered by Streaming Data with Streamlit Frontend Application Development,MVC Architecture Pt 4 : Realtime Ingestion and Transformation with Apache Druid as OLAP Database Data Ingestion and Big Data Processing User Mingle : Kafka Driven User Profile Streaming Airflow, Zookeeper, Cassandra, Schema Registry, Spark Grand Prix Data Odyssey Azure Databricks,Spark SQL,Postman,Blob Storage,Unity Catalog,ADF,Azure Devops,Synapse Studio, Delta Lake,PowerBI Medal Metrics: Tokyo Olympics Data Alchemy ADF,Azure Data Lake Gen2,Blob Storage,Databricks,Synapse Analytics,PowerBI [Airflow with Postgres as OLTP Da","default_branch":null,"files":null,"tree":[],"storefront":"/r/vedanthv","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/vedanthv/data-engineering-portfolio/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}