{"repo":"yogsec/endpoints-extractor","free":true,"listed":false,"github":"https://github.com/yogsec/endpoints-extractor","clone":"git clone https://github.com/yogsec/endpoints-extractor.git","description":"A powerful Bash script for extracting URLs and API endpoints from HTML, JavaScript, and JSON content of web pages. Designed for security researchers, bug bounty hunters, and developers to streamline endpoint discovery. Simple to use, supports single or multiple URLs, and offers file-saving capabilities.","language":"Shell","stars":18,"topics":["cybersecurity","endpoints","hacking-tool","yogsec","endpoints-extractor-tool","get-endpoints","crawler","hackers","hacking","url-finder"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Endpoints Extractor Tool The Endpoints Extractor by YogSec is a Bash script designed to extract URLs and API endpoints from the HTML, JavaScript, and JSON content of web pages. --- Features - Scan a single URL or a list of URLs. - Extract URLs from HTML, JavaScript, and JSON content. - Save the results to a file for further analysis. - Simple and user-friendly interface. --- Prerequisites - Bash : Ensure you are running the script in a Bash shell environment. - cURL : The script uses curl to fetch web page content. - grep : Used to extract URLs from the content. - sort : Ensures the URLs are unique. --- Usage Display Help Scan a Single URL Example: Scan a List of URLs Example: Save Results to a File Example: Combined Example Scan a list of URLs and save results to a file: --- Options - -u : Specify a single URL to scan. - -l : Specify a file containing a list of URLs. - -s : Save the output to the specified file. - -h : Display the help message. --- Example Output For the URL https://example.com , the script may output: --- Troubleshooting - Error: Either -u or -l must be specified : Ensure you provide a URL with -u or a file with -l . - Error: File does not exist : Verify the file path is correct. - Empty Output : Ensure the target URL or file contains valid HTML, JS, or JSON content with endpoints.","default_branch":null,"files":null,"tree":[],"storefront":"/r/yogsec","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/yogsec/endpoints-extractor/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}