{"repo":"agile-lab-dev/wasp","free":true,"listed":false,"github":"https://github.com/agile-lab-dev/wasp","clone":"git clone https://github.com/agile-lab-dev/wasp.git","description":"WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.","language":"Scala","stars":31,"topics":["spark","spark-streaming","kafka","hbase","hdfs","hadoop","solr","elasticsearch","jdbc","parquet"],"license":null,"category":"data-pipelines","readme_excerpt":"WASP - Wide Analytics Streaming Platform Official documentation website : Wasp documentation Install Wasp final releases are published to maven central through sonatype, snapshot releases are published to sonatype maven-snapshots. or (for snapshots) To download Wasp snapshot releases you need a personal access token or a project access token with read api scope and role Developer to GitLab Wasp project. To get a token, open a github issue. Table of contents - WASP - Wide Analytics Streaming Platform - Table of contents - General - Overview - WASP in the wild - Background - Architecture - Glossary - Services - Kafka - Spark - Akka - MongoDB or Postgresql - Pluggable Datastore - Using WASP - Setting up the development environment - Leverage Wasp in your project General Overview WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you. If you need a point and click product, this is not the tool for you. WASP is a big data framework that allows you to not waste time with devops architectures and integrating different components. WASP lets you focus on your data, business logic and algorithms, without worrying about tipical big data problems like: - at least once or exactly once delivery - periodically training a machine learning model - publishing your resu","default_branch":null,"files":null,"tree":[],"storefront":"/r/agile-lab-dev","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/agile-lab-dev/wasp/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}