{"repo":"mispecto/realtime-dashboard-example","free":true,"listed":false,"github":"https://github.com/mispecto/realtime-dashboard-example","clone":"git clone https://github.com/mispecto/realtime-dashboard-example.git","description":"This is a real-time dashboard example using Spark Streaming and Node.js","language":"Java","stars":25,"topics":["spark","spark-streaming","kafka","meetup","rethinkdb","dashboard-application","flink"],"license":null,"category":"dashboards-admin","readme_excerpt":"coding-with-af-spark-streaming =============================== Spark Streaming makes it easy to build scalable fault-tolerant streaming applications. At AppsFlyer, we use Spark for many of our offline processing services. Spark Streaming joined our technology stack a few months ago for real-time work flows, reading directly from Kafka to provide value to our clients in near-real-time. In this session we will code a real-time dashboard application based on Spark Streaming technology. You will learn how to collect events from Kafka, aggregate them by time window and present aggregated insights in a dashboard. Screenshot Architecture The following scheme presents what we are going to create in this session: Read events +------------+ +------------------------+ Kafka ----------- Spark Streaming Job +------------+ +------------------------+ Update V +---------------+ +--------+------+ Push! Real-time RethinkDB --------- Dashboard .. +---------------+ (../ \\) +---------------+ 1. We'll read real-time events from Kafka queue. 2. We'll aggregate events in Spark streaming job by some sliding window. 3. We'll write aggregated events to RethinkDB. 4. RethinkDB will push updates to the real-time dashboard. 5. Real-time dashboard will present current status. Prerequisites 1. Laptop with at least 4GB of RAM. 2. Make sure Virtualization is enabled in BIOS. 3. VirtualBox v5.x or greater installed. 4. Vagrant v1.8.1 or greater installed. Preparation & Setup Please do these steps prior to comi","default_branch":null,"files":null,"tree":[],"storefront":"/r/mispecto","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mispecto/realtime-dashboard-example/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}