{"repo":"CogitatorTech/gaggle","free":true,"listed":false,"github":"https://github.com/CogitatorTech/gaggle","clone":"git clone https://github.com/CogitatorTech/gaggle.git","description":"A DuckDB extension for working with Kaggle datasets","language":"Rust","stars":17,"topics":["datasets","duckdb-extension","kaggle-dataset","rust","duckdb","kaggle"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Gaggle Access and query Kaggle datasets from DuckDB --- Gaggle is a DuckDB extension that allows you to work with Kaggle datasets directly in SQL queries, as if they were DuckDB tables. It is written in Rust and uses the Kaggle API to search, download, and manage the datasets. Kaggle hosts a large collection of very useful datasets for data science and machine learning. Accessing these datasets typically involves manually downloading a dataset (as a ZIP file), extracting it, loading the files in the dataset into your data science environment, and managing storage and dataset updates, etc. This workflow can quickly become complex, especially when working with multiple datasets or when datasets are updated frequently. Gaggle tries to help simplify this process by hiding the complexity and letting you work with datasets directly inside DuckDB that allows you to run fast analytical queries on the data. In essence, Gaggle makes DuckDB into a SQL-enabled frontend for Kaggle datasets. Features - Provides a simple API to interact with Kaggle datasets from DuckDB - Allows you to search, download, and read datasets from Kaggle - Supports datasets that contain CSV, Parquet, JSON, and XLSX files - Supports dataset updates and versioning - Configurable and has built-in caching support to avoid re-downloading - Thread-safe, fast, and has a low memory footprint See the ROADMAP.md for the list of implemented and planned features. [!IMPORTANT] Gaggle is in early development, so bugs and break","default_branch":null,"files":null,"tree":[],"storefront":"/r/CogitatorTech","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/CogitatorTech/gaggle/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}