{"repo":"wuzhy1ng/BlockchainSpider","free":true,"listed":false,"github":"https://github.com/wuzhy1ng/BlockchainSpider","clone":"git clone https://github.com/wuzhy1ng/BlockchainSpider.git","description":"A toolkit for blockchain data collection","language":"Python","stars":183,"topics":["blockchain","spider","python","scrapy","graph-sampling","labeling-tool","dataset"],"license":"MIT","category":"blockchain-web3","readme_excerpt":"BlockchainSpider Blockchain spiders aim to collect on-chain data, including: - Transfer subgraph : the money flow with a center of specific address/transaction. - Transaction : the transaction data on chains, e.g., receipts, logs, trace, etc. - Label data : the labels of address/transaction. - ... For more info in detail, see our documentation. 🚀Getting Started 🔧Install Let's start with the following command: And then install the dependencies: 🔍Crawl a transaction subgraph We demonstrate how to crawl a transaction subgraph of KuCoin hacker on Ethereum and trace the illegal fund of the hacker! Run on this command as follow: You can find the money transfer data on ./data/AccountTransferItem.csv . ✨Collect transaction data In this section, we will demonstrate how to collect transaction data. The following command will continuously collect transactions in Ethereum from block number 19000000 to 19000100 : Another example to listen the latest transactions in Ethereum: You can find the label data on ./data , in which: - BlockItem.csv saves the metadata for blocks, such as minter, timestamp and so on. - TransactionItem.csv saves the external transactions of blocks. BlockchainSpider also supports collecting transaction receipts, logs, token transfers, etc. Moreover, collecting block data from EVM-compatible chains (e.g., BNBChain, Polygon, etc.) is also available; see our documentation. The following command will continuously collect transaction data in Solana from block height 270","default_branch":null,"files":null,"tree":[],"storefront":"/r/wuzhy1ng","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/wuzhy1ng/BlockchainSpider/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}