{"repo":"near/near-lake-indexer","free":true,"listed":false,"github":"https://github.com/near/near-lake-indexer","clone":"git clone https://github.com/near/near-lake-indexer.git","description":"Watch NEAR network and store all the events as JSON files on AWS S3","language":"Rust","stars":52,"topics":["blockchain","hacktoberfest"],"license":"GPL-3.0","category":"blockchain-web3","readme_excerpt":"[!WARNING] Aurora is the current maintainer of this project and the fork is maintained in their organization. near-lake-indexer NEAR Lake is an indexer built on top of NEAR Indexer microframework to watch the network and store all the events as JSON files on AWS S3. Concept We used to have NEAR Indexer for Explorer that was watching for the network and stored all the events to PostgreSQL database. PostgreSQL became the main bottleneck for us. After some brainstorming sessions and researches we decided to go with AWS Aurora database. Knowing the fact that NEAR Explorer is not the only project that uses the Indexer for Explorer's database, we wanted to come up with the concept that will allow us to cover even more projects that can benefit from the data from NEAR Protocol. That's why we decided to store the data from the blockchain as JSON files on AWS S3 bucket that can be used as a data source for different projects. As \"Indexer for Explorer Remake\" project we are going to have near-lake as a data writer. There's going to be another project that will read from AWS S3 bucket and will store all the data in SingleStore database. This will replace NEAR Indexer for Explorer PostgreSQL database at some moment and will become the main source for NEAR Explorer. How to start The final setup consists of the following components: AWS S3 Bucket as a storage NEAR Lake binary that operates as a regular NEAR Protocol peer-to-peer node, so you will operate it as any other Regular/RPC Node in","default_branch":null,"files":null,"tree":[],"storefront":"/r/near","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/near/near-lake-indexer/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}