{"repo":"pixelsdb/pixels","free":true,"listed":false,"github":"https://github.com/pixelsdb/pixels","clone":"git clone https://github.com/pixelsdb/pixels.git","description":"An efficient storage and compute engine for both on-prem and cloud-native data analytics.","language":"Java","stars":909,"topics":["cloud-database","data-lake","data-warehouse","database","olap","column-store"],"license":"AGPL-3.0","category":"databases-storage","readme_excerpt":"Pixels ======= The core of Pixels is a columnar storage engine designed for data lakes and warehouses. It is optimized for analytical tables stored in on-premises and cloud-native storage systems, including S3, GCS, HDFS, Redis, HTTP (Netty), and local file systems. Pixels outperforms Parquet, which is the most widely used columnar format in today's lakehouses, by up to two orders of magnitude. We have integrated Pixels with popular query engines including DuckDB (1.3.0), Trino (405 and 466), StarRocks (3.3.5), PrestoDB (0.279), and Hive (2.3+). The DuckDB integration and the C++ implementation of Pixels are in the cpp folder. The other integrations are opensourced in separate repositories: Pixels Connector for Trino Pixels Connector for PrestoDB StarRocks with Pixels Integration Pixels SerDe for Hive Pixels also has its own query engine Pixels-Turbo. It prioritizes processing queries in an autoscaling MPP cluster (currently based on Trino) and exploits serverless functions (e.g, AWS Lambda, vHive / Knative, and Spike) to accelerate the processing of workload spikes. With Pixels-Turbo , we can achieve better performance and cost-efficiency for continuous workloads while not compromising elasticity for workload spikes. Based on Pixels-Turbo, we implement Pixels-Rover, a web-based query interface that provides users with a complete experience of serverless query processing, natural-language-to-SQL translation, and flexible service levels in query urgency. It allows users to sel","default_branch":null,"files":null,"tree":[],"storefront":"/r/pixelsdb","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/pixelsdb/pixels/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}