{"repo":"GoogleCloudPlatform/redis-dataflow-realtime-analytics","free":true,"listed":false,"github":"https://github.com/GoogleCloudPlatform/redis-dataflow-realtime-analytics","clone":"git clone https://github.com/GoogleCloudPlatform/redis-dataflow-realtime-analytics.git","description":"Build a real-time website analytics dashboard on GCP using Dataflow, Cloud Memorystore (Redis) and Spring Boot","language":"Java","stars":28,"topics":["realtime-processing","in-memory-database","dataflow","spring-boot","redis"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"Realtime Analytics using Dataflow and Cloud Memorystore (Redis) In today’s fast-paced world, there is emphasis on getting instant insights. Typical use-cases involve SaaS operators providing real-time metrics for their KPIs or marketeers' need for quick insights on performance of their offers or experiments on the website. This solution will demonstrate how to build a real-time website analytics dashboard on GCP. Components User events / Message bus provides system decoupling, Pub/Sub is a fully managed message/event bus and provides an easy way to handle the fast click-stream generated by typical websites. The click-stream contains signals which can be processed to derive insights in real time. Metrics processing pipeline is required to process the click-stream from Pub/Sub into the metrics database. Dataflow will be used, which is a serverless, fully managed processing service supporting real-time streaming jobs. Metrics Database , needs to be an in-memory database to support real-time use-cases. Some common web analytic metrics are unique visitors, number of active experiments, conversion rate of each experiment, etc. The common theme is to calculate uniques, i.e. Cardinality counting, although from a marketeer's standpoint a good estimation is sufficient, the HyperLogLog algorithm is an efficient solution to the count-unique problem by trading off some accuracy. Cloud Memorystore (Redis) provides a slew of in-built functions for sets and cardinality measurement, alleviati","default_branch":null,"files":null,"tree":[],"storefront":"/r/GoogleCloudPlatform","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/GoogleCloudPlatform/redis-dataflow-realtime-analytics/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}