{"repo":"EdJoPaTo/website-stalker","free":true,"listed":false,"github":"https://github.com/EdJoPaTo/website-stalker","clone":"git clone https://github.com/EdJoPaTo/website-stalker.git","description":"Track changes on websites via git","language":"Rust","stars":73,"topics":["scraper","git","change-alert","change-detection","monitoring","self-hosted","url-monitor","web-scraping","website-change-detector","website-change-monitor"],"license":"LGPL-2.1","category":"scrapers-browser-automation","readme_excerpt":"Website Stalker Track changes on websites via git This tool checks all the websites listed in its config. When a change is detected, the new site is added to a git commit. It can then be inspected via normal git tooling. Basically it's curl , sed ++ and then git commit in a neat package. See it in action (literally in GitHub Action s). Install - GitHub Releases - Arch Linux User Repository (AUR) - Docker Hub Image - Via rust and cargo: Clone → cargo install --path . Usage GitHub Actions Check out website-stalker-example which runs within GitHub actions. Locally - First create a new folder / git repository for tracking website changes - Add your favorite website to the configuration file website-stalker.yaml . Also make sure to set the value of from to an email address of yours. - Run your newly added website. If you added https://apple.com/newsroom use something like this to test if everything works like you want: - Set up a cronjob / systemd.timer executing the following command occasionally Config Example The config describes a list of sites. Each site has a URL. Additionally, each site can have editors which are used before saving the file. Each editor manipulates the content of the URL. There is a bigger config in my example repository. The example repository is also used by me to detect changes of interesting sites. Global Options Options which are globally configured at the root level of the configuration file website-stalker.yaml . from Used as the From header in the w","default_branch":null,"files":null,"tree":[],"storefront":"/r/EdJoPaTo","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/EdJoPaTo/website-stalker/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}