{"repo":"bibanon/neofuuka-scraper","free":true,"listed":false,"github":"https://github.com/bibanon/neofuuka-scraper","clone":"git clone https://github.com/bibanon/neofuuka-scraper.git","description":"Asagi-like Yotsuba scraper","language":"Python","stars":28,"topics":["4chan","python","scraper"],"license":"GPL-3.0","category":"scrapers-browser-automation","readme_excerpt":"neofuuka-scraper neofuuka-scraper is a next-generation 4chan scraper, written in Python. Its primary goals are: Efficiency Accuracy of scraped data Reliability and error resilience It currently supports the Asagi+FoolFuuka MySQL schema and functions as a drop-in replacement for Asagi. In the future, more schemas may be supported. Vs. Asagi All of Asagi's primary features are supported, with several fixes and improvements, including: Significantly reduced database writes : Every time a thread is modified, Asagi will run an insert+update query for every single post in it, including ones that have not changed. This scraper keeps track of post changes by storing a small hash in memory, and will only update posts that have actually changed. Significantly reduced I/O when saving files : Every time a thread is modified, Asagi will check for the existence of every single image in the thread, and will update the modification time of all full image files. This scraper only checks for each image once the first time a post is seen, and only updates modification times if configured to do so. Higher data accuracy : Asagi has some minor issues that result in saved data being slightly different than what it originally was, such as every tag being replaced with [/spoiler] , recently created threads not being properly marked as deleted, etc. All such known issues are not present in this scraper. Better overall performance and efficiency : Asagi uses significantly more CPU/RAM/etc resources tha","default_branch":null,"files":null,"tree":[],"storefront":"/r/bibanon","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bibanon/neofuuka-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}