{"repo":"bellingcat/vk-url-scraper","free":true,"listed":false,"github":"https://github.com/bellingcat/vk-url-scraper","clone":"git clone https://github.com/bellingcat/vk-url-scraper.git","description":"Scrape VK URLs to fetch info and media - python API or command line tool.","language":"Python","stars":54,"topics":["media-downloader","scraper","vk","command-line","open-source-research","python"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"vk-url-scraper Python library to scrape data, and especially media links like videos and photos, from vk.com URLs. This repo has been archived because it relies on a fixed git commit of the vk api library which we can no longer publish to pypi, see issue. You can still install the latest install. This archived state may change if a solution is found to publish the library to pypi again. You can use it via the command line or as a python library, check the documentation . Installation You can install the most recent release from pypi via pip install vk-url-scraper . Currently you need to manually unsintall and re-install one dependency (as it is installed from github and not pypi): To use the library you will need a valid username/password combination for vk.com. Command line usage Python library usage see [docs] for all available functions. TODO scrape album links scrape profile links docs online from sphinx Development (more info in CONTRIBUTING.md). 1. setup dev environment with pipenv install --dev 1. setup environment with pipenv install -r requirements.txt 1. Activate the environment with pipenv shell (or prepend pipenv run to all commands) 2. To run all checks to make run-checks (fixes style) or individually 1. To fix style: black . and isort . - flake8 . to validate lint 2. To do type checking: mypy . 3. To test: pytest . ( pytest -v --color=yes --doctest-modules tests/ vk url scraper/ to use verbose, colors, and test docstring examples) 3. make docs to generate shpynx","default_branch":null,"files":null,"tree":[],"storefront":"/r/bellingcat","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bellingcat/vk-url-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}