{"repo":"ainoya/cloudflare-dom-distiller","free":true,"listed":false,"github":"https://github.com/ainoya/cloudflare-dom-distiller","clone":"git clone https://github.com/ainoya/cloudflare-dom-distiller.git","description":"A Cloudflare Workers-based API for extracting and converting web page content to Markdown using DOM-Distiller and Turndown.","language":"TypeScript","stars":31,"topics":["cloudflare","cloudflare-workers","puppeteer"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"[!NOTE] https://developers.cloudflare.com/browser-rendering/rest-api/ What this repository does is almost the same as what is officially supported by the /markdown endpoint, so please consider using that instead. Cloudflare DOM Distiller This repository provides an API implementation for easily retrieving content from target web pages on Cloudflare Workers. Features - Cloudflare Workers & Browser Rendering : Utilizes Cloudflare Workers and browser rendering to fetch page information. - Readability : Uses Readability to extract page content and remove unnecessary information. - DOM-Distiller : If you set option useReadability: false in a request, uses dom-distiller to extract page content and remove unnecessary information. - Turndown : Converts the extracted HTML to Markdown format for better readability. Example Usage To run the API in development mode: You can make a request to your local server and verify that the content of the target web page is converted to Markdown format: Endpoint: /distill Request Format - url : The URL of the target web page to fetch content from. - markdown : Boolean value to indicate whether the content should be converted to Markdown format. Response Format - body : Returns the content of the web page. References - mixmark\\-io/turndown: 🛏 An HTML to Markdown converter written in JavaScript - mozilla/readability: A standalone version of the readability lib - chromium/dom\\-distiller: Distills the DOM - Puppeteer · Browser Rendering docs","default_branch":null,"files":null,"tree":[],"storefront":"/r/ainoya","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ainoya/cloudflare-dom-distiller/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}