{"repo":"hrbrmstr/htmlunit","free":true,"listed":false,"github":"https://github.com/hrbrmstr/htmlunit","clone":"git clone https://github.com/hrbrmstr/htmlunit.git","description":"🕸🧰☕️Tools to Scrape Dynamic Web Content via the 'HtmlUnit' Java Library","language":"R","stars":36,"topics":["r","rstats","htmlunit","web-scraping","javascript","r-cyber"],"license":"Apache-2.0","category":"scrapers-browser-automation","readme_excerpt":"htmlunit Tools to Scrape Dynamic Web Content via the ‘HtmlUnit’ Java Library Description ‘HtmlUnit’ ( ) is a “‘GUI’-Less browser for ‘Java’ programs”. It models ‘HTML’ documents and provides an ‘API’ that allows one to invoke pages, fill out forms, click links and more just like one does in a “normal” browser. The library has fairly good and constantly improving ‘JavaScript’ support and is able to work even with quite complex ‘AJAX’ libraries, simulating ‘Chrome’, ‘Firefox’ or ‘Internet Explorer’ depending on the configuration used. It is typically used for testing purposes or to retrieve information from web sites. Tools are provided to work with this library at a higher level than provided by the exposed ‘Java’ libraries in the ‘htmlunitjars’ package. What’s Inside The Tin The following functions are implemented: DSL - web client / webclient : Create a new HtmlUnit WebClient instance - wc go : Visit a URL - wc html nodes : Select nodes from web client active page html content - wc html text : Extract attributes, text and tag name from webclient page html content - wc html attr : Extract attributes, text and tag name from webclient page html content - wc html name : Extract attributes, text and tag name from webclient page html content - wc headers : Return response headers of the last web request for current page - wc browser info : Retreive information about the browser used to create the ‘webclient’ - wc content length : Return content length of the last web request for c","default_branch":null,"files":null,"tree":[],"storefront":"/r/hrbrmstr","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/hrbrmstr/htmlunit/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}