{"repo":"evdubs/spdr-etf-holdings","free":true,"listed":false,"github":"https://github.com/evdubs/spdr-etf-holdings","clone":"git clone https://github.com/evdubs/spdr-etf-holdings.git","description":"ETL for the SPDR ETF holdings XLS documents","language":"Racket","stars":27,"topics":["spdr","spdr-etf","etl","racket"],"license":"MPL-2.0","category":"data-pipelines","readme_excerpt":"spdr-etf-holdings These Racket programs will download the SPDR ETF holdings XLS documents and insert the holding data into a PostgreSQL database. The intended usage on Windows with Microsoft Excel is: On other platforms, you will need to do something like the following (and will need some bit of software to do the XLS- CSV transformation): If you have libreoffice installed, you can instead just do the following as XLS- CSV conversion using libreoffice is supported within the process: You will need to provide a database password for the transform-load- .rkt programs. The available parameters are: The provided schema.sql file shows the expected schema within the target PostgreSQL instance. This process assumes you can write to a /var/local/spdr folder. This process also assumes you have loaded your database with NASDAQ symbol file information. This data is provided by the nasdaq-symbols project. Dependencies It is recommended that you start with the standard Racket distribution. With that, you will need to install the following packages: Format and URL updates On 2020-01-01, the URL for SPDR ETF documents changed; extract.2020-01-01.rkt uses this new location. On 2019-11-02, columns were added to the SPDR ETF documents; transform-load.2019-11-02.rkt can process these new columns.","default_branch":null,"files":null,"tree":[],"storefront":"/r/evdubs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/evdubs/spdr-etf-holdings/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}