{"repo":"iangow/wrds2pg","free":true,"listed":false,"github":"https://github.com/iangow/wrds2pg","clone":"git clone https://github.com/iangow/wrds2pg.git","description":"Functions to convert (WRDS) SAS data to PostgreSQL, parquet, and CSV","language":"Jupyter Notebook","stars":22,"topics":["postgresql","wrds"],"license":"MIT","category":"databases-storage","readme_excerpt":"Library to convert WRDS SAS data This package was created to convert WRDS SAS data to modern data formats. This package has three major functions, one for each of three popular data formats. - wrds update() : Imports WRDS SAS data into a PostgreSQL database. - wrds update pq() : Converts WRDS SAS data to parquet files. - wrds update csv() : Converts WRDS SAS data to gzipped CSV files. This package was primarily designed to handle WRDS data, but some support is provided for importing a local SAS file ( .sas7dbat ) into a PostgreSQL database. Functions prefixed with wrds are designed to pull data from WRDS via SSH. For local SAS datasets, use functions that accept fpath (e.g., sas to pandas() and related helpers). Requirements 1. Python The software uses Python 3 and depends on SQLAlchemy and Paramiko. Some helper functions return Pandas DataFrames; Pandas is optional unless those functions are used. 2. A WRDS ID To access WRDS non-interactively (e.g., from Python scripts), you must use SSH public-key authentication . WRDS provides a dedicated SSH endpoint for key-based authentication: wrds-cloud-sshkey.wharton.upenn.edu Step 1: Generate a modern SSH key (recommended) WRDS supports modern SSH key types. We recommend ed25519 : ssh-keygen -t ed25519 -C \"your wrds id@wrds\" Accept the default location ( /.ssh/id ed25519 ). You may use a passphrase if your SSH agent is running. For unattended jobs (cron / CI), an empty passphrase may be required. Step 2: Install the public key on WR","default_branch":null,"files":null,"tree":[],"storefront":"/r/iangow","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/iangow/wrds2pg/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}