{"repo":"O2-Czech-Republic/proxima-platform","free":true,"listed":false,"github":"https://github.com/O2-Czech-Republic/proxima-platform","clone":"git clone https://github.com/O2-Czech-Republic/proxima-platform.git","description":"The Proxima platform.","language":"Java","stars":24,"topics":["batch-processing","analytical-platform","unified-data-processing","apache-spark","apache-flink","apache-beam","iot-platform","data-mesh","stream-processing"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"The Proxima platform The platform is a generic data ingestion, manipulation and retrieval framework. High level can be described by following scheme: Design document High level design document can be found here. Incomplete (under construction) documentation Not yet complete documentation can be found here. The documentation should grow over over time to cover all the aspects of the platform. PRs welcome! Scheme definition First, let's introduce some glossary: entity : a named dictionary consisting of string key and one or more attributes attribute : an atomic field of entity with string name and scheme definining its data-type attribute family : a logical grouping of attributes of the same entity into a named group storage : a physical store for data Example scheme definition The scheme definition uses HOCON. As a short example we will show definition of data processing of a hypothetic e-commerce site. The site has some goods, some users and generates some events which describe how users interact with the goods. We will use protocol buffers for serialization. First, let's define our data model. We will model the system which processes events coming from some source in given format and based on these events creates a model of user preferences. Next, after defining our data model, we need to specify attribute families for our entities. This definition is highly dependent on the access pattern to the data. Mostly, we have to worry about how are we going to read our data. Relevan","default_branch":null,"files":null,"tree":[],"storefront":"/r/O2-Czech-Republic","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/O2-Czech-Republic/proxima-platform/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}