{"repo":"buremba/universql","free":true,"listed":false,"github":"https://github.com/buremba/universql","clone":"git clone https://github.com/buremba/universql.git","description":"Pushdown compute from Snowflake to DuckDB running on your infrastructure","language":"Jupyter Notebook","stars":206,"topics":["dbt","duckdb","snowflake","sqlglot","databricks","sql","proxy-server","sql-proxy"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"10x more efficient Snowflake compute UniverSQL is a Snowflake proxy that allows you to run SQL queries locally on Snowflake Iceberg tables and Polaris catalog, using DuckDB. You can join Snowflake data with your local datasets, without any need for a running warehouse . UniverSQL relies on Snowflake for access control and data catalog so it's complementary to your Snowflake workloads. [!WARNING] Any SQL client that supports Snowflake, also supports UniverSQL as we implement Snowflake's API to support compatibility. If you run into any issue using an app or client, feel free to create a discussion. Universql is not affiliated with Snowflake. Watch on YouTube When you query an Iceberg table on Snowflake for the first time, UniverSQL looks up Iceberg metadata from Snowflake, (metadata operation, no compute cost) re-writes the query for DuckDB dialect, sets up filesystem that connects to your data lake with your cloud credentials and caches the Parquet files and executes the query on DuckDB. Use Cases Smart caching for your Snowflake queries, reducing the compute costs. UniverSQL optimize the query and re-uses the cache across multiple runs, better than Snowflake's result cache. Query local files without any need to upload them to Snowflake for prototyping and only upload them when you want to publish data on cloud. Utilize your hardware for running queries faster on small datasets and run queries on your data even when you don't have internet connectivity. Use DuckDB warehouse f","default_branch":null,"files":null,"tree":[],"storefront":"/r/buremba","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/buremba/universql/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}