{"repo":"digipodium/dputils","free":true,"listed":false,"github":"https://github.com/digipodium/dputils","clone":"git clone https://github.com/digipodium/dputils.git","description":"open source library from digipodium","language":"Python","stars":12,"topics":["beautifulsoup","datacollection","file","file-handling-in-python","python","python3","requests-module","scraper","webscraping","read-files"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"A python library which can be used to extraxct data from files, pdfs, doc(x) files, as well as save data into these files. This library can be used to scrape and extract webpage data from websites as well. Installation Requirements and Instructions Python versions 3.8 or above should be installed. After that open your terminal: For Windows users: For Mac/Linux users: Files Module Functions from dputils.files: for now, the files module has two functions: 1. get data: - To import, use statement: - Obtains data from files of any extension given as args(supports text files, binary files, pdf, doc for now, more coming!) - sample call: - Returns a string or binary data depending on the output arg - images will not be extracted 2. save data: - save data can be used to write and save data into a file of valid extension. - sample call: - Returns True if file is successfully accessed and modified. Otherwise, False. Scrape Module Data extraction from a page Here's a basic tutorial to help you get started with the scraper module. 1. Import the required classes and functions: 2. Initialize the Scraper class with the URL of the webpage you want to scrape: 3. Define the tags you want to scrape using the Tag class: 4. Extract data from the page: Extracting list of items from a page For more advanced usage, such as extracting repeated data from lists of items on a page, you can use the following approach: 1. Initialize the Scraper class: 2. Define the tags for the target section and the items","default_branch":null,"files":null,"tree":[],"storefront":"/r/digipodium","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/digipodium/dputils/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}