{"repo":"thkoch2001/lara","free":true,"listed":false,"github":"https://github.com/thkoch2001/lara","clone":"git clone https://github.com/thkoch2001/lara.git","description":"decentralized web search engine, web archive and feed reader","language":"Rust","stars":14,"topics":["crawler","decentralized","index","search-engine"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"Lara ( L ocal Ar chive, A ) wants to be(come) a - decentralized - web search engine - web archive - and feed reader. Project status: incomplete, experimental A user should be able to run an instance of Lara on their own (or rented) hardware and connect it with other trusted remote instances. A search query combines results from own and remote instances. Assumptions Instances only crawl and index sites handpicked and trusted by their administrators. This eases the implementation: - Crawled sites can be assumed to not be spam or intentionally misbehaving. - Ranking of sites is not a priority anymore since all of them are considered valuable. Thus a big webgraph and pagerank is not needed. - Most Instances run on one single machine but instances can also scale to small clusters. Motivation It is widely acknowledged, that the quality of Google search has declined: - The term \"enshittification\"[^3] has been created for this phenomenon. - lightning talk at Chaos Communication Congress 2023[^4] - Paper: Is Google Getting Worse? A Longitudinal Investigation of SEO Spam in Search Engines[^5] [^3]: 2023-07-28, Cory Doctorow: Microincentives and Enshittification [^4]: 2023-12-28, Martin Hamilton: Honey I federated the search engine - finding stuff online post-big tech [^5]: https://downloads.webis.de/publications/papers/bevendorff 2024a.pdf The paper [GOGGLES: Democracy dies in darkness, and so does the Web][Goggles] by the Brave Search Team discusses the issue of biases in search engin","default_branch":null,"files":null,"tree":[],"storefront":"/r/thkoch2001","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/thkoch2001/lara/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}