{"repo":"safesploitOrg/doogle","free":true,"listed":false,"github":"https://github.com/safesploitOrg/doogle","clone":"git clone https://github.com/safesploitOrg/doogle.git","description":"Doogle is a search engine and web crawler which can search indexed websites and images","language":"PHP","stars":41,"topics":["crawler","php","search","search-engine","database-search","php-search-engine","full-text-search","indexing","mysql","google-clone"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Doogle Doogle is a search engine and web crawler which can search indexed websites and images, and then use keywords to be searched later. Written primarily in OOP style PHP with the intent of better understanding OOP and how web crawlers work. Features - Search sites Displays title, URL and description - Search images Hover over images to preview description (alt tag) Masonry layout for searched images Image preview using Fancybox Image search page responds dynamically - Clean homepage - Filters broken image results - Organises search results by clicks/visits - Pagination system at the bottom of the search page - Shows 'results found' for search term - Supports non-latin characters (UTF-8) Table of Contents - Setup and Usage - Docker - Server Setup - PHP Dependencies - Connecting PHP to MySQL Server - Crawling Websites to Populate Images and Sites tables - Programming Logic - Pagination - Image Search - Site Search - Trimming Results - Telemetry - User-Agent - Preview Images - Doogle Homepage - Doogle Search - Sites - Doogle Search - Images - Pagination System - doogleBot Crawl Form - Preview Video Setup and Usage Two methods of setup are discussed. - Docker (Easiest) - Server Setup Docker Docker configuration files are available at doogle-docker. Presuming you already have Docker v3.9 (or greater) installed and configured. git clone https://github.com/safesploit/doogle-docker.git cd doogle-docker sh build.sh Doogle is now accessible via localhost:8000. For debugging phpMyAd","default_branch":null,"files":null,"tree":[],"storefront":"/r/safesploitOrg","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/safesploitOrg/doogle/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}