{"repo":"oxylabs/backlink-monitoring","free":true,"listed":false,"github":"https://github.com/oxylabs/backlink-monitoring","clone":"git clone https://github.com/oxylabs/backlink-monitoring.git","description":"Backlink checker is a simple tool, which checks backlink quality, identifies problematic backlinks, and outputs them to a specific Slack channel","language":"Python","stars":30,"topics":["python","web-scraping","backlinks","backlinks-checker","screen-scraping"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"Backlink checker Table of Contents - Packages Required - Checking backlinks - STEP 1: Check if backlink is reachable - STEP 2: Check if backlink HTML has noindex element - STEP 3: Check if backlink HTML contains a link to a referent page - STEP 4: Check if referent page is marked as \"nofollow\" - Assigning results to Pandas DataFrame - Pushing results to Slack Backlink checker is a simple tool, which checks backlink quality, identifies problematic backlinks, and outputs them to a specific Slack channel. The tool tries to reach a backlink, which is supposed to contain a referent link, and checks if it indeed does. If a backlink contains a referent link, the tool retrieves the HTML of that backlink and checks for certain HTML elements, which indicate good quality of backlink. Packages Required The first step is to prepare the environment. The backlink checker is written in Python. The most common Python packages for creating any web crawling tool are Requests and Beautiful Soup 4 - a library needed for pulling data out of HTML. Also, make sure you have Pandas package installed, as it will be used for some simple data wrangling. These packages can be installed using the pip install command. This will install all the three needed packages. Important: Note that version 4 of BeautifulSoup is being installed here. Earlier versions are now obsolete. Checking backlinks The script scrapes backlink websites and checks for several backlink quality signs: - if backlink is reachable - if ba","default_branch":null,"files":null,"tree":[],"storefront":"/r/oxylabs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/oxylabs/backlink-monitoring/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}