{"repo":"whoknowsi/pedidosya-scraper-api","free":true,"listed":false,"github":"https://github.com/whoknowsi/pedidosya-scraper-api","clone":"git clone https://github.com/whoknowsi/pedidosya-scraper-api.git","description":"I am implementing a project that uses web scraping via Playwright to gather information from PedidosYa. I am then utilizing Cloudflare Workers and Hono to create an API for the collected information. The data is stored in JSON files and images are optimized using the Sharp library. These files are periodically uploaded to a MongoDB for backup.","language":"JavaScript","stars":11,"topics":["cloudflare-workers","hono","playwright"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"PedidosYa Scraper API This project utilizes web scraping techniques to collect information from the online food delivery service, PedidosYa. The scraping process is automated using the Playwright library for specific locations. The collected information is then used to create an API using Cloudflare Workers and Hono. Data Storage The data is stored in JSON files and images are optimized using the Sharp library. These files are periodically uploaded to a MongoDB database for backup. API Usage The API can be used to access the information collected from PedidosYa in a structured and easily consumable format. Endpoints - /products - /markets - /categories Screenshots Raw data of products: Raw data of categories: Setting up the project To use this project, you need to have installed NodeJS and MongoDB. Once you have cloned the repository, run npm install to install the dependencies. Running the project To start the scraping process, run npm run scrap . To run the API locally, run npm run dev:api To publish the API, run npm run publish:api You have to configure a env file using the example.env. Built With - Playwright - Cloudflare Workers - Hono - Sharp - MongoDB - Node.js License This project is licensed under the ISC License - see the LICENSE.md file for details. Disclaimer This project is for educational use only and should not be used for any commercial purposes without obtaining proper authorization from PedidosYa.","default_branch":null,"files":null,"tree":[],"storefront":"/r/whoknowsi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/whoknowsi/pedidosya-scraper-api/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}