{"repo":"MADEVAL/WP-robots-generator","free":true,"listed":false,"github":"https://github.com/MADEVAL/WP-robots-generator","clone":"git clone https://github.com/MADEVAL/WP-robots-generator.git","description":"Smart client-side robots.txt generator for WordPress - security levels, plugin presets, AI crawler blocking, i18n. No backend, no dependencies.","language":"JavaScript","stars":31,"topics":["robots-txt","wordpress","generator","seo","client-side","microservice"],"license":"GPL-3.0","category":"scrapers-browser-automation","readme_excerpt":"robots.txt Generator for WordPress Smart, free, client-side robots.txt generator built specifically for WordPress sites. No backend, no tracking, no signup - just open and go. Live Demo → --- Why Every WordPress site needs a robots.txt . Most online generators spit out a generic file that either blocks too much (breaking Google rendering) or too little (leaking admin pages to search index). This tool understands WordPress internals and generates rules that actually make sense. Features Core - Three security levels - Low / Recommended / High - with WordPress-aware defaults - Per-engine targeting (Google, Bing, Yandex, DuckDuckGo, Baidu) or wildcard - AI crawler blocking (GPTBot, ClaudeBot, CCBot, Bytespider, Google-Extended, PerplexityBot, and more) - Sitemap auto-detection and custom URL support - Yandex-specific directives: Host , Clean-param , Crawl-delay Plugin-Aware Rules - WooCommerce - hides /cart/ , /checkout/ , /my-account/ - Easy Digital Downloads - hides /purchase-confirmation/ , EDD actions - WPML - blocks language parameter duplicates - WPForms - blocks form handler URLs - BuddyPress - hides /members/ , /activity/ , /groups/ UX - Syntax-highlighted preview with directive coloring - Copy to clipboard / download as file - Live generation with debounced input - Flash animation on output update - Line counter - Form state persisted in localStorage - Light / Dark theme toggle i18n & SEO - Full Russian and English UI with auto-detection via navigator.language - ?lang=ru","default_branch":null,"files":null,"tree":[],"storefront":"/r/MADEVAL","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/MADEVAL/WP-robots-generator/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}