{"repo":"WayneChang65/ptt-crawler","free":true,"listed":false,"github":"https://github.com/WayneChang65/ptt-crawler","clone":"git clone https://github.com/WayneChang65/ptt-crawler.git","description":"ptt-crawler is a web crawler module designed to scarpe data from Ptt.","language":"TypeScript","stars":24,"topics":["ptt","crawler","scraping","webcrawler","spider","scraper","javascript","web-crawler","nodejs","typescript"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"ptt-crawler ptt-crawler 是一個專門用來爬批踢踢(Ptt)各版資料的爬蟲模組。 ptt-crawler is a web crawler module designed to scrape data from Ptt. :heavy exclamation mark:注意 (Attention):heavy exclamation mark: [!IMPORTANT] :thumbsup: 3.1.0 版本 ，利用非同步並發處理，爬取內文效率大增，依照測試結果， 時間可減少81%以上 。 (Benchmark) Version 3.1.0 : Utilizes asynchronous concurrent processing to significantly boost content crawling efficiency, reducing processing time by over 81% according to our benchmark results . (Benchmark) :thumbsup: 3.0.1 版本 ，利用並發處理，爬取內文效率大增，依照測試結果， 時間可減少77%以上 。 (Benchmark) Version 3.0.1 : Utilizes concurrent processing to significantly boost content crawling efficiency, reducing processing time by over 77% according to our benchmark results . (Benchmark) :bookmark: 3.x.x 版本 ，主要利用「物件導向類別」進行使用，仍保留原本 2.x.x版本的模組函式呼叫介面(如：initialize(), getResults(),...)。 但是， 預計在4.0.0以後的版本，把原2.x.x版本函式(Deprecated)刪除，請留意！！！ Version 3.x.x : It primarily utilizes an object-oriented class for usage, but still retains the original 2.x.x module function call interfaces(e.g., initialize(), getResults(), etc.). However, these 2.x.x functions are deprecated and are planned for removal in versions 4.0.0 and later. Please take note! 前言 (Overview) 批踢踢(Ptt)是台灣最大的BBS(Bulletin Board System)， 也是許多台灣大數據分析常參考的資料庫。 不過，大多數Ptt爬蟲都是用python程式所寫。 本人為了在Node.js上爬批踢踢(Ptt)的資料， 乾脆就自己用javascript打造一個簡單的爬蟲模組，並且分享給大家使用。 Ptt is the largest and most famous Bulletin Board System (BBS) in Taiwan, and also an important reference database for big data analysis. However, most PTT c","default_branch":null,"files":null,"tree":[],"storefront":"/r/WayneChang65","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/WayneChang65/ptt-crawler/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}