{"repo":"brunocampos01/data-engineering","free":true,"listed":false,"github":"https://github.com/brunocampos01/data-engineering","clone":"git clone https://github.com/brunocampos01/data-engineering.git","description":null,"language":"Python","stars":11,"topics":["python","java","algorithms-techniques","big-o-notation","data-sctructures","paradigms","design-patterns","storage","database-fundamentals","cookbook"],"license":"MIT","category":"databases-storage","readme_excerpt":"Data Engineering Storage Database Fundamentals - SQL - Normalization - Concepts: relational, noSQL, data warehouse, data lake, data lakehouse, database Dump - ACID transactions - CAP theorem - Dead locks - Database design - Modeling - How choose database? Relational Database Python examples connections, disconnection, execution query: - MySQL - Postgres - SQLServer - Oracle - DB2 Non-relational Database Python examples connections, disconnection, execution query: - DynamoDB - ElasticSearch - Apache Hive - Redis Data Projects Small Projects - Blocked sort based index [//]: # (- Apache Airflow: generating multiples DAG) [//]: # (- Apache Airflow: generating multiples tasks in DAG) Exploratory Data Analysis (EDA) - The Spending of Brazilians Senators - Finding Interesting Business Metrics Data Lakes - Apache Hadoop (YARN, Hive, HDFS), Tez, Spark, Sqoop and Azkaban - Apache Hadoop (YARN, Hive, HDFS), Impala, Spark, Oracle database, Redis, and Airflow Data Warehouses - Data Catalog in Databricks (Unity Catalog) Data QA - Data Quality Assurance in Medallion Architecture --- References - 1: Coding Roadmap ---","default_branch":null,"files":null,"tree":[],"storefront":"/r/brunocampos01","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/brunocampos01/data-engineering/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}