{"repo":"poozhu/crawler-for-github-trending","free":true,"listed":false,"github":"https://github.com/poozhu/crawler-for-github-trending","clone":"git clone https://github.com/poozhu/crawler-for-github-trending.git","description":"🕷️ A node crawler for github trending.","language":"JavaScript","stars":186,"topics":["crawler","node-crawler","github-trending"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"crawler-for-github-trending 50 lines, minimalist node crawler for GitHub Trending. 一个50行的 node 爬虫，一个简单的 axios, express, cheerio 体验项目。 Usage 一篇简单的介绍 https://juejin.cn/post/6844903827024396296 首先保证电脑已存在 node10.0+ 环境，然后 1.拉取本项目 2.或者下载本项目压缩包，解压 Examples 当启动项目后，可以看到控制台输出 此时打开浏览器，访问 http://localhost:3000/ 稍微等待即可看到爬取完毕的返回数据： More 本项目每次访问都会实时爬取数据，所以数据返回速度会比较慢，期望作为接口数据建议定时爬取到数据库。 但了解项目代码可以带来以上各个 node 模块和爬虫最基础的用法和概念，希望可以帮到大家。 Star History","default_branch":null,"files":null,"tree":[],"storefront":"/r/poozhu","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/poozhu/crawler-for-github-trending/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}