{"repo":"RyouMon/FavoritesCrawler","free":true,"listed":false,"github":"https://github.com/RyouMon/FavoritesCrawler","clone":"git clone https://github.com/RyouMon/FavoritesCrawler.git","description":"Crawl your personal favorite images, photo albums, comics from website. Support pixiv, yande.re, x for now.","language":"Python","stars":25,"topics":["pixiv","pixiv-downloader","scrapy","yandere","spider","pixiv-bot","pixiv-client","comic-downloader","twitter-bot","x-bot"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"FavoritesCrawler Crawl your personal favorite images, photo albums, comics from website. You may prefer gallery-dl, which more powerful and supports more sites. Warning! - Not ready for production. - Appropriately reduce the crawling speed in the future and provide options to set performance, but your account is still at risk of being disabled by the website. Plan to support - instagram.com Already support - pixiv.net (crawl your liked illust, must login), Thanks for project PixivPy. - yande.re (crawl your voted posts, require your username) - twitter.com (crawl your liked posts, must login) Requirements - Python3.10+ Install Config Proxy (Optional) Login Login Pixiv Login by command 1. Run command 2. Pixiv login page will open in browser, input username and password, then press login button. Login by edit config 1. Get your access token and refresh token by gppt 2. Get your user id (Access your pixiv personal page, copy from address bar) 3. Open config file located in {your user home}/.favorites crawler/config.yml , put access token, refresh token and user id in this file Login Yandere run command: Login Twitter 1. Get Authorization, X-Csrf-Token RequestURL and Cookie File 1. Open x.com and login, get to your \"Likes\" page 2. Open dev console (F12) and switch to network tab. 3. Enable persistent logging (\"Preserve log\"). 4. Type into the filter field: Likes? 5. Refresh Page. 6. Copy Authorization, X-Csrf-Token and RequestURL from request(Likes?variables...) 7. Use \"Get cookie","default_branch":null,"files":null,"tree":[],"storefront":"/r/RyouMon","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/RyouMon/FavoritesCrawler/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}