{"repo":"victoriadrake/hydra-link-checker","free":true,"listed":false,"github":"https://github.com/victoriadrake/hydra-link-checker","clone":"git clone https://github.com/victoriadrake/hydra-link-checker.git","description":"Hydra: a multithreaded site-crawling link checker in Python standard library","language":"Python","stars":125,"topics":["link-checker","link-checking","python","ci-cd","website"],"license":"MIT","category":"deployment-docker-iac","readme_excerpt":"Hydra: multithreaded site-crawling link checker in Python A Python program that crawls slithers 🐍 a website for links and prints a YAML report of broken links. Requires Python 3.6 or higher. There are no external dependencies, Neo. Usage Positional arguments: - URL : The URL of the website to crawl. Ensure URL is absolute including schema, e.g. https://example.com . Optional arguments: - -h , --help : Show help message and exit - --config CONFIG , -c CONFIG : Path to a configuration file A broken links report will be output to stdout, so you may like to redirect this to a file. The report will be YAML formatted. To save the output to a file, run: You can add the current date to the filename using a command substitution, such as: To see how long Hydra takes to check your site, add time : GitHub Action You can easily incorporate Hydra as part of an automated process using the link-snitch action. Configuration Hydra can accept an optional JSON configuration file for specific parameters, for example: To use a configuration file, supply the filename: Possible settings: - OK - HTTP response codes to consider as a successful link check. Defaults to [200, 999] . - attrs - Attributes of the HTML tags to check for links. Defaults to [\"href\", \"src\"] . - exclude scheme prefixes - Link prefixes to exclude from checking. Any link that starts with one of these strings is skipped, so this works for schemes ( \"tel:\" , \"javascript:\" ) as well as whole domains or path prefixes. Defaults to [\"t","default_branch":null,"files":null,"tree":[],"storefront":"/r/victoriadrake","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/victoriadrake/hydra-link-checker/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}