{"repo":"bilalahhmedd/ebay-products-scraper","free":true,"listed":false,"github":"https://github.com/bilalahhmedd/ebay-products-scraper","clone":"git clone https://github.com/bilalahhmedd/ebay-products-scraper.git","description":"A production grade data scraper developed to acquire listing data (product details, images and item-specifications) from ebay.com","language":"Python","stars":31,"topics":["scrapy","scrapy-crawler","scrapy-ebay","ebay-scraper","data-scraping","python-scraper","python-scrapy"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"A production grade data scraper developed to acquire listing data (product details, images and item-specifications) from ebay.com Overview E-commerce listing data acquistion demands end to end solution to scrape, validate and store data. This project is an implementation to acquire data from ebay using scrapy , python and pydantic using clean architecture. This project consists of two saparate scrapy bots. scraping-ebay-1.0.3 scraping-ebay-2.0.0 [latest] scraping-ebay-2.0.0 is stable, modernized and functional. Quick Start git clone https://github.com/bilalahhmedd/ebay-products-scraper pip install -r requirements.txt cd scraping-ebay-2.0.0 run command: Command Arguments Argument Type Required Default Example Description ---------- ------ :--------: --------- --------- ------------- search String ✅ — \"men shoes\" Search keyword(s) to crawl. pages Integer ❌ 1 4 Number of search result pages to scrape. output String ✅ — products.csv Output CSV file name. Dependencies Python = 3.8 scrapy = 2.16 pandas pydantic System Components scraping-ebay-2.0.0 comprises following components spiders ebay models product summary product image extractors search page extractor product page extractor pipelines customImagePipeline utils image utils selectors url utils Architecture Spider │ ├── Scheduling Requests ├── Pagination └── Passing Models Extractors │ ├── Parse HTML ├── Extract Data └── Build Domain Models Models │ └── Represent Business Objects Pipelines │ ├── Download Images ├── Export CSV ","default_branch":null,"files":null,"tree":[],"storefront":"/r/bilalahhmedd","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bilalahhmedd/ebay-products-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}