{"repo":"ruippeixotog/scala-scraper","free":true,"listed":false,"github":"https://github.com/ruippeixotog/scala-scraper","clone":"git clone https://github.com/ruippeixotog/scala-scraper.git","description":"A Scala library for scraping content from HTML pages","language":"Scala","stars":733,"topics":["scala","scraper","dsl","html-parsing","hacktoberfest"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Scala Scraper A library providing a DSL for loading and extracting content from HTML pages. Take a look at Examples.scala and at the unit specs for usage examples or keep reading for more thorough documentation. Feel free to use GitHub Issues for submitting any bug or feature request and Gitter to ask questions. This README contains the following sections: - Quick Start - Core Model - Browsers - Content Extraction - Content Validation - Other DSL Features - Using Browser-Specific Features - Working Behind an HTTP/HTTPS Proxy - Integration with Typesafe Config - New Features and Migration Guide - Copyright Quick Start To use Scala Scraper in an existing SBT project with Scala 2.13 or newer, add the following dependency to your build.sbt : If you are using an older version of this library, see this document for the version you're using: 1.x, 0.1.2, 0.1.1, 0.1. An implementation of the Browser trait, such as JsoupBrowser , can be used to fetch HTML from the web or to parse a local HTML file or string: The returned object is a Document , which already provides several methods for manipulating and querying HTML elements. For simple use cases, it can be enough. For others, this library improves the content extracting process by providing a powerful DSL. You can open the example.html file loaded above to follow the examples throughout the README. First of all, the DSL methods and conversions must be imported: Content can then be extracted using the extraction operator and CSS querie","default_branch":null,"files":null,"tree":[],"storefront":"/r/ruippeixotog","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ruippeixotog/scala-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}