{"repo":"JuliaAPlavin/QuackIO.jl","free":true,"listed":false,"github":"https://github.com/JuliaAPlavin/QuackIO.jl","clone":"git clone https://github.com/JuliaAPlavin/QuackIO.jl.git","description":"High-performance tabular data I/O powered by DuckDB with native Julia table interface support.","language":"Julia","stars":23,"topics":["duckdb","file-formats","tabular-data","csv","data-io","parquet","performance"],"license":"MIT","category":"data-pipelines","readme_excerpt":"QuackIO.jl 🐣🦆 If it quacks like a tabular IO package, then it is a tabular IO package (powered by DuckDB ) . QuackIO provides a native Julia interface to DuckDB read/write functions. They support all Julia table types that follow the Tables.jl interface. Reading and writing is most efficient with columnar table types, such as StructArray or columntable . Write table write table(filename, table; options...) \\ Executes COPY table TO file (options) in DuckDB. Here, table is an arbitrary Julia table object: Read full table into memory read (tabletype, filename; options...) where is csv , parquet , or json \\ Calls the corresponding DuckDB function and converts the result to the specified Julia table type. Thanks to DuckDB and its Julia integration, QuackIO functions are performant. They can even be faster than native Julia readers for these formats. Lazy read: only materialize a subset QuackIO is based on DuckDB – a fully-featured SQL database. Such a backend makes it straightforward to do basic data manipulation on the fly, without materializing the whole table in memory.\\ Thanks to the SQLCollections.jl integration, even the syntax for performing manipulations in SQL is basically the same as for in-memory Julia datasets. Column Selection Load only specific columns from a CSV file into memory: Extract First N Rows Only load first 3 rows from a CSV file into memory: Generic Queries Even more complex queries can be performed with basically the same syntax as for in-memory Julia d","default_branch":null,"files":null,"tree":[],"storefront":"/r/JuliaAPlavin","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/JuliaAPlavin/QuackIO.jl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}