{"repo":"0xcaff/duckdb_protobuf","free":true,"listed":false,"github":"https://github.com/0xcaff/duckdb_protobuf","clone":"git clone https://github.com/0xcaff/duckdb_protobuf.git","description":"a duckdb extension for querying encoded protobuf messages","language":"Rust","stars":30,"topics":["duckdb","protobuf"],"license":null,"category":"data-pipelines","readme_excerpt":"duckdb protobuf a duckdb extension for parsing sequences of protobuf messages encoded in either the standard varint delimited format or a u32 big endian delimited format. quick start ensure you're using duckdb 1.1.0 for support with the latest features. if you need new features on an old versions, please open an issue. start duckdb with -unsigned flag to allow loading unsigned libraries. or if you're using the jdbc connector, you can do this with the allow unsigned extensions jdbc connection property. now install the extension: next load it (you'll need to do this once for every session you want to use the extension) and start shredding up your protobufs! if you want builds for a platform or version which currently doesn't have builds, please open an issue. install from file download the latest version from releases. if you're on macOS, blow away the quarantine params with the following to allow the file to be loaded next load the extension why sometimes you want to land your row primary data in a format with a well-defined structure and pretty good decode performance and poke around without a load step. maybe you're scraping an endpoint which returns protobuf responses, you're figuring out the schema as you go and iteration speed matters much more than query performance. duckdb protobuf allows for making a new choice along the flexibility-performance tradeoff continuum for fast exploration of protobuf streams with little upfront load complexity or time. configuration descrip","default_branch":null,"files":null,"tree":[],"storefront":"/r/0xcaff","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/0xcaff/duckdb_protobuf/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}