{"repo":"oscarcontrerasnavas/nist-webbook-API","free":true,"listed":false,"github":"https://github.com/oscarcontrerasnavas/nist-webbook-API","clone":"git clone https://github.com/oscarcontrerasnavas/nist-webbook-API.git","description":"API for webbook.nist.gov","language":"Python","stars":14,"topics":["python","scrapy","scrapyrt","twister"],"license":null,"category":"api-integrations-sdks","readme_excerpt":"Nist Webbook spider and API with scrapyrt This project allows users to request data from the webbook.nist.gov website managed by the National Institute of Standards and Technology. The webbook is a compilation of chemical substances and properties available to the public, although there is no official interface for easy programmatic access. This repository provides one spider to scrap some tabulated data from NIST. It is possible to search by name or by cas as follows: Update Since Heroku decided to cut off its free tier, this app is now hosted in Fly.io and the only change for the final user, if there is a final user, is the API base url. Storing scraped items If you are familiar with Scrapy, you know it is possible store the scraped items by using a pipeline. In this case, the MongoPipeline class starts a PyMongo connection by looking for two environment variables as follow: Make sure you set them properly and according to your deploy method. API deployed on Fly.io Thanks to ScrapyRT, this spider also has a simple read-only API that the user can use to return a JSON file with the scraped item. For more information, you can visit the ScrapyRT documentation. However, for this purpose, two custom Resources (endpoints) were written to allow users an easier consumption. Endpoints and examples Request all the substances The substances will return with pagination, but with fewer properties. The default number of items per page is 20. If you do not specify the page number, it will ","default_branch":null,"files":null,"tree":[],"storefront":"/r/oscarcontrerasnavas","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/oscarcontrerasnavas/nist-webbook-API/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}