{"repo":"tryolabs/requestium","free":true,"listed":false,"github":"https://github.com/tryolabs/requestium","clone":"git clone https://github.com/tryolabs/requestium.git","description":"Integration layer between Requests and Selenium for automation of web actions.","language":"Python","stars":1831,"topics":["web-automation","requests","selenium","python","interface"],"license":"BSD-3-Clause","category":"scrapers-browser-automation","readme_excerpt":"======== Requestium is a Python library that merges the power of Requests, Selenium, and Parsel into a single integrated tool for automatizing web actions. The library was created for writing web automation scripts that are written using mostly Requests but that are able to seamlessly switch to Selenium for the JavaScript heavy parts of the website, while maintaining the session. Requestium adds independent improvements to both Requests and Selenium, and every new feature is lazily evaluated, so its useful even if writing scripts that use only Requests or Selenium. Read more about the motivation behind creating this library in this blopost. Features - Enables switching between a Requests' Session and a Selenium webdriver while maintaining the current web session. - Integrates Parsel's parser into the library, making xpath, css, and regex much cleaner to write. - Improves Selenium's handling of dynamically loading elements. - Makes cookie handling more flexible in Selenium. - Makes clicking elements in Selenium more reliable. - Supports Chromedriver natively plus adding a custom webdriver. Installation You should then download your preferred Selenium webdriver if you plan to use the Selenium part of Requestium, such as Chromedriver. Usage First create a session as you would do on Requests, and optionally add arguments for the web-driver if you plan to use one. Since headless mode is common, there's a shortcut for it by specifying headless=True . You can also create a Selenium ","default_branch":null,"files":null,"tree":[],"storefront":"/r/tryolabs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/tryolabs/requestium/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}