{"repo":"ethereum/node-crawler","free":true,"listed":false,"github":"https://github.com/ethereum/node-crawler","clone":"git clone https://github.com/ethereum/node-crawler.git","description":"Attempts to crawl the Ethereum network of valid Ethereum execution nodes and visualizes them in a nice web dashboard.","language":"Go","stars":130,"topics":["ethereum","crawler"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Ethereum Node Crawler Crawls the network and visualizes collected data. This repository includes backend, API and frontend for Ethereum network crawler. Backend is based on devp2p tool. It tries to connect to discovered nodes, fetches info about them and creates a database. API software reads raw node database, filters it, caches and serves as API. Frontend is a web application which reads data from the API and visualizes them as a dashboard. Features: - Advanced filtering, allows you to add filters for a customized dashboard - Drilldown support, allows you to drill down the data to find interesting trends - Network upgrade readiness overview - Responsive mobile design Contribute Project is still in an early stage, contribution and testing is welcomed. You can run manually each part of the software for development purposes or deploy whole production ready stack with Docker. Frontend Development For local development with debugging, remoting, etc: 1. Copy .env into .env.local and replace the variables. 1. And then npm install then npm start 1. Run tests to make sure the data processing is working good. npm test Production To deploy this web app: 1. Build the production bits by npm install then npm run build the contents will be located in build folder. 1. Use your favorite web server, in this example we will be using nginx. 1. The nginx config for that website could be which proxies the api to endpoint /v1 . Review the frontent/nginx.conf file for an example. Backend API The A","default_branch":null,"files":null,"tree":[],"storefront":"/r/ethereum","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ethereum/node-crawler/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}