{"repo":"groda/big_data","free":true,"listed":false,"github":"https://github.com/groda/big_data","clone":"git clone https://github.com/groda/big_data.git","description":"Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.","language":"Jupyter Notebook","stars":87,"topics":["big-data","bigdata","spark","spark-sql","docker","mapreduce","mapreduce-bash","pyspark","hadoop","testdfsio"],"license":"MIT","category":"deployment-docker-iac","readme_excerpt":"Big Data for beginners Explore a variety of tutorials and interactive demonstrations focused on Big Data technologies like Hadoop, Spark, and more, primarily presented in the format of Jupyter notebooks. Most notebooks are self-contained, with instructions for installing all required services. They can be run on Google Colab or in a virtual Ubuntu machine/container. Setting Up Hadoop: Single-Node Configuration - Hadoop Setting up a Single Node Cluster.ipynb Set up a single-node Hadoop cluster on Google Colab and run some basic HDFS and MapReduce examples - Hadoop single node cluster setup Python.ipynb Set up a single-node Hadoop cluster on Google Colab using Python - Hadoop minicluster.ipynb Deploy a test Hadoop Cluster with a single command and no need for configuration. Running Apache Spark in Standalone Mode - Setting up Spark Standalone on Google Colab.ipynb Set up a single-node Spark server on Google Colab and estimate „π“ with a Montecarlo method - Setting up Spark Standalone on Google Colab BigtopEdition.ipynb Set up a single-node Spark server on Google Colab using the Bigtop distribution and utilities, estimate „π“ with a Montecarlo method and run another Java ML example. - Run Spark on Google Colab.ipynb Set up a single-node standalone Spark server on Google Colab including Web UI and History Server - compact version - Spark Standalone Architecture on Google Colab.ipynb Explore the Spark architecture through the immersive experience of deploying a standalone setup. -","default_branch":null,"files":null,"tree":[],"storefront":"/r/groda","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/groda/big_data/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}