{"repo":"LibrariesHacked/openlibrary-search","free":true,"listed":false,"github":"https://github.com/LibrariesHacked/openlibrary-search","clone":"git clone https://github.com/LibrariesHacked/openlibrary-search.git","description":"Searching Open Library by keywords to return ISBNs","language":"PLpgSQL","stars":241,"topics":["isbn","bulk-download","library-catalogue","open-library","books","sql","database","python","isbns","json"],"license":null,"category":"databases-storage","readme_excerpt":"Open Library database Open Library is an large online library of bibliographic data. They publish full data dumps of data on authors, works, and editions. This project provides instructions and scripts for downloading and importing this data into a PostgreSQL database, and some sample queries to test the database. The database is primarily aimed at querying using ISBN and includes tables specifically for these identifiers. It could be extended to change this to other identifiers, such as Open Library ID, or text searching by title or author. Getting started The following steps should get you up and running with a working database. 1. Install the required prerequisites so that you have a local database server. 2. Download the data from Open Library. 3. Run the processing the data scripts to prepare for import. 4. Import the data into the database. Prerequisites - Python 3 - Tested with 3.10 - PostgreSQL - Version 15 is tested but all recent versions should work. The scripts should be run on a local server - if you need to transfer this to the cloud, it would be better done once the database has been created. - Disk space - The data files are large, and the uncompressed editions file is 45GB. You will need at least 250GB of free space to import all the data. Downloading the data Open Library offer bulk downloads on their website, available from the data dumps page. These are updated every month. The downloads include (compressed sizes shown): - Editions ( 10.5GB) - Works ( 3.5G","default_branch":null,"files":null,"tree":[],"storefront":"/r/LibrariesHacked","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/LibrariesHacked/openlibrary-search/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}