{"repo":"pgspider/parquet_s3_fdw","free":true,"listed":false,"github":"https://github.com/pgspider/parquet_s3_fdw","clone":"git clone https://github.com/pgspider/parquet_s3_fdw.git","description":"ParquetS3 Foreign Data Wrapper for PostgresSQL","language":"PLpgSQL","stars":241,"topics":["fdw","foreign-data-wrapper","foreign-tables","parquet","postgresql","postgresql-extension","s3","parquets3-fdw"],"license":null,"category":"databases-storage","readme_excerpt":"Parquet S3 Foreign Data Wrapper for PostgreSQL This PostgreSQL extension is a Foreign Data Wrapper (FDW) for accessing Parquet file on local file system and [Amazon S3][2]. This version of parquet s3 fdw can work for PostgreSQL 13, 14, 15, 16 and 17. Apache Parquet foreign data wrapper supporting S3 access for PostgreSQL. Installation 1. Build requirements CMake 3.29.3 C++11 compiler libcurl-devel openssl-devel libuuid-devel pulseaudio-libs-devel 2. Install dependent libraries libarrow and libparquet : Confirmed version is 16.1.0 (required). Please refer to building guide. AWS SDK for C++ (libaws-cpp-sdk-core libaws-cpp-sdk-s3) : Confirmed version is 1.11.335 (required). Please refer to bulding guide Attention! - We recommend to build libarrow , libparquet and AWS SDK for C++ from the source code. We failed to link if using pre-compiled binaries because gcc version is different between arrow and AWS SDK. - Build libarrow with the options -DARROW WITH SNAPPY=ON, -DARROW WITH ZSTD=ON to support compression with SNAPPY and ZSTD. 3. Build and install parquet s3 fdw or in case when PostgreSQL is installed in a custom location: It is possible to pass additional compilation flags through either custom CCFLAGS or standard PG CFLAGS , PG CXXFLAGS , PG CPPFLAGS variables. Usage Load extension Create server If using [MinIO][3] instead of AWS S3, please use use minio option for create server. Create user mapping You have to specify user name and password if accessing Amazon S3. Create fo","default_branch":null,"files":null,"tree":[],"storefront":"/r/pgspider","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/pgspider/parquet_s3_fdw/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}