{"repo":"ibis-project/ibis","free":true,"listed":false,"github":"https://github.com/ibis-project/ibis","clone":"git clone https://github.com/ibis-project/ibis.git","description":"the portable Python dataframe library","language":"Python","stars":6631,"topics":["python","impala","pandas","database","clickhouse","postgresql","sqlite","mysql","datafusion","sql"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"Ibis What is Ibis? Ibis is the portable Python dataframe library: - Fast local dataframes (via DuckDB by default) - Lazy dataframe expressions - Interactive mode for iterative data exploration - Compose Python dataframe and SQL code - Use the same dataframe API for more than 20 backends - Iterate locally and deploy remotely by changing a single line of code See the documentation on \"Why Ibis?\" to learn more. Getting started You can pip install Ibis with a backend and example data: 💡 Tip See the installation guide for more installation options. Then use Ibis: 💡 Tip See the getting started tutorial for a full introduction to Ibis. Python + SQL: better together For most backends, Ibis works by compiling its dataframe expressions into SQL: You can mix SQL and Python code: This allows you to combine the flexibility of Python with the scale and performance of modern SQL. Backends Ibis supports more than 20 backends: - Apache DataFusion - Apache Druid - Apache Flink - Apache Impala - Apache PySpark - Athena - BigQuery - ClickHouse - Databricks - DuckDB - Exasol - Materialize - MySQL/MariaDB - Oracle - Polars - PostgreSQL - RisingWave - SingleStoreDB - SQL Server - SQLite - Snowflake - Trino How it works Most Python dataframes are tightly coupled to their execution engine. And many databases only support SQL, with no Python API. Ibis solves this problem by providing a common API for data manipulation in Python, and compiling that API into the backend’s native language. This means y","default_branch":null,"files":null,"tree":[],"storefront":"/r/ibis-project","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ibis-project/ibis/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}