{"repo":"bmsuisse/lakeapi","free":true,"listed":false,"github":"https://github.com/bmsuisse/lakeapi","clone":"git clone https://github.com/bmsuisse/lakeapi.git","description":"API for distributing Data Lake Data","language":"Python","stars":11,"topics":["api","data-lake","duckdb","fastapi","polars","rest-api","sql","deltalake","lakehouse","columnar"],"license":"MIT","category":"api-integrations-sdks","readme_excerpt":"The BMS LakeAPI A FastAPI plugin that allows you to expose your data lake as an API, allowing several output formats such as Parquet, Csv, Json, Excel, ... The LakeAPI also includes a minimal security layer for convenience (Basic Auth), but you can also bring your own. Unlike roapi, we intentionally do not expose most SQL by default, but limit the possible queries with a config. This makes it easy for you to control what happens to your data. If you want the SQL endpoint, you can enable it. And because we built LakeAPI on the shoulders of giants like FastAPI. A lot of things like documentation and authentication are built in and we don't have to reinvent the wheel. To run the application with the default config, just do it: To adjust the config, you can do like this: Installation Pypi Package bmsdna-lakeapi can be installed like any python package : pip install bmsdna-lakeapi Basic Idea Based on a YAML configuration and the data source, LakeAPI will automatically generate GET and/or POST endpoints. Calling the endpoint turns the query into an SQL statement that can be executed with the engine of your choice (duckdb or polars). The result is then seralised into the requested format (Json, CSV, Arrow etc). This makes it super easy to distribute your data lake data to other systems. We use it internally to feed data to MS SQL Server, SQLite, Streamlit and Web Apps. You can host it wherever you want, we use Azure Websites which works fine even for very large data amounts. OpenAPI","default_branch":null,"files":null,"tree":[],"storefront":"/r/bmsuisse","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bmsuisse/lakeapi/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}