{"repo":"sukhcha-in/dart_web_scraper","free":true,"listed":false,"github":"https://github.com/sukhcha-in/dart_web_scraper","clone":"git clone https://github.com/sukhcha-in/dart_web_scraper.git","description":"Powerful, easy-to-use scraper for web pages and APIs. Chain parsers and transforms to extract exactly the data you need.","language":"Dart","stars":10,"topics":["htmlparser","jsonparser","parser","parsing","scraper","scraping","webscraper","webscraping"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Config-based, reusable web scraper for web and API scraping. Scrape, parse web pages or APIs without writing parsers or scraping logic, using simple key/value based configs. Features - Config-based, reusable web scraper for web and API scraping. - Scrape, parse web pages or APIs without writing parsers or scraping logic, using simple key/value based configs. - 15+ Built-in parsers. - Data cleaning and transformations. - Automatic browser-like request headers (User-Agent + matching client hints). Getting Started Install it with a flutter command: Install it with a dart command: Usage This is the most basic example of scraping quotes from quotes.toscrape.com WebScraper class High-level web scraper that combines HTML fetching and data parsing. ScraperConfig class Configuration for targeting and scraping specific types of URLs. UrlCleaner class Clean the URL before it's passed to a scraper. --- Parser class Easy to use and reusable parser class :) --- Parser Types Type Description Selector ParserOptions ---------------------------- ------------------------------------------------------------------------ ---------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------- ParserType.element Extracts element nodes from HTML using CSS selectors. CSS selector required. - ParserType.attribute Extracts attribute value from HTML element using CSS selectors. Use CSS selector to select ","default_branch":null,"files":null,"tree":[],"storefront":"/r/sukhcha-in","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/sukhcha-in/dart_web_scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}