{"repo":"anqorithm/RealTime-StockStream","free":true,"listed":false,"github":"https://github.com/anqorithm/RealTime-StockStream","clone":"git clone https://github.com/anqorithm/RealTime-StockStream.git","description":"RealTime StockStream is a streamlined, simulation system for processing live stock market data. It uses Apache Kafka for data input, Apache Spark for data handling, and Apache Cassandra for data storage, making it a powerful yet easy-to-use tool for financial data analysis","language":"Python","stars":32,"topics":["cassendra","data-stream-processing","docker","docker-compose","kafka","python","realtime","spark","spark-streaming","stocks"],"license":null,"category":"deployment-docker-iac","readme_excerpt":"RealTime StockStream RealTime StockStream is a streamlined system for processing live stock market data. It uses Apache Kafka for data input, Apache Spark for data handling, and Apache Cassandra for data storage, making it a powerful yet easy-to-use tool for financial data analysis 💹🕊️ Getting Started This guide will walk you through setting up and running the RealTime StockStream on your local machine for development and testing. Prerequisites Ensure you have the following software installed: - Docker - Python (version 3.11 or higher) Todo Features 1. Live Market Data Integration ⌛ 2. Advanced Analytics Features ⌛ 3. Interactive Data Visualization ⌛ 4. Improved Scalability ⌛ 5. User Customization Options ⌛ 6. Stronger Security ⌛ Used Techs - Appache Kafka - Appache Cassandra - Appache ZooKeeper - Appache Spark - Python Installation Follow these steps to set up your development environment: Setting Up Kafka 1. Create a Kafka Topic : Suppored Data Opreations 1. Grouping Aggregation: Summarize data by groups. 2. Pivot Aggregation: Reshape data, converting rows to columns. 3. Rollups and Cubes: Perform hierarchical and combinational aggregations. 4. Ranking Functions: Assign ranks within data partitions. 5. Analytic Functions: Compute aggregates while maintaining row-level details. Database Schema Configuring Cassandra 1. Create a Keyspace and Table : Execute the following CQL commands to set up your Cassandra database: System Architecture Docker Compose 1. Launch Services : U","default_branch":null,"files":null,"tree":[],"storefront":"/r/anqorithm","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/anqorithm/RealTime-StockStream/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}