{"repo":"ronin-rb/ronin-web","free":true,"listed":false,"github":"https://github.com/ronin-rb/ronin-web","clone":"git clone https://github.com/ronin-rb/ronin-web.git","description":"ronin-web is a collection of useful web helper methods and commands.","language":"Ruby","stars":42,"topics":["ronin-rb","ruby","web","spider","server","helpers","proxy-server","crawler","cli","xml"],"license":"GPL-3.0","category":"scrapers-browser-automation","readme_excerpt":"ronin-web Source Issues Documentation Discord Mastodon Description ronin-web is a Ruby library that provides common web security commands and additional libraries. ronin-web is part of the [ronin-rb] project, a [Ruby] toolkit for security research and development. Features HTML/XML parsing/building (using [Nokogiri][nokogiri]). Also provides additional extensions to [Nokogiri][nokogiri] using [nokogiri-ext]. Supports diffing HTML/XML documents using [nokogiri-diff]. Supports random User-Agent generation using [ronin-web-user agents]. Provides an easy to use [Sinatra][sinatra] based web server using [ronin-web-server]. Provides an easy to use web spider using [ronin-web-spider]. Provides a CLI for common web related tasks. Has 98% documentation coverage. Has 89% test coverage. Synopsis Open the ronin-web Ruby REPL: Diff two HTML files: Diff two URLs: Perform an XPath query on an HTML file: Perform an XPath query on a URL: Dump all links from a web page: Spiders a host and print all visited URLs: Spiders the domain and sub-domains and print every visited URL: Spiders a specific web-site and print every visited URL: Spider a host and print the response statuses: Spider a host and print the response status and headers: Start a debug web server on http://localhost:8000/: Start a debug web server on a different address and port: Host the files in a directory on http://localhost:8000/: Mount a specific file at a specific HTTP path: Mount a specific directory at a specific HTTP path:","default_branch":null,"files":null,"tree":[],"storefront":"/r/ronin-rb","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ronin-rb/ronin-web/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}