{"repo":"openwpm/OpenWPM","free":true,"listed":false,"github":"https://github.com/openwpm/OpenWPM","clone":"git clone https://github.com/openwpm/OpenWPM.git","description":"A web privacy measurement framework","language":"Python","stars":1415,"topics":["python3","privacy","crawler","firefox"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"OpenWPM OpenWPM is a web privacy measurement framework which makes it easy to collect data for privacy studies on a scale of thousands to millions of websites. OpenWPM is built on top of Firefox, with automation provided by Selenium. It includes several hooks for data collection. Check out the instrumentation section below for more details. Table of Contents - Installation - Pre-requisites - Install - Mac OSX - Quick Start - Troubleshooting - Documentation - Advice for Measurement Researchers - Developer instructions - Instrumentation and Configuration - Storage - Local Storage - Remote storage - Docker Deployment for OpenWPM - Building the Docker Container - Running Measurements from inside the Container - MacOS GUI applications in Docker - Citation - License Installation OpenWPM is tested on Ubuntu 24.04 via GitHub Actions and is commonly used via the docker container that this repo builds, which is based on Ubuntu 22.04. Although we don't officially support other platforms, conda is a cross platform utility and the install script can be expected to work on OSX and other linux distributions. OpenWPM does not support windows: Pre-requisites The main pre-requisite for OpenWPM is conda, a fast cross-platform package management tool. Conda is open-source and can be installed from . Install An installation script, install.sh is included to: install the conda environment, install unbranded firefox, and build the instrumentation extension. All installation is confined to your cond","default_branch":null,"files":null,"tree":[],"storefront":"/r/openwpm","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/openwpm/OpenWPM/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}