{"repo":"luka-dev/headless-task-server","free":true,"listed":false,"github":"https://github.com/luka-dev/headless-task-server","clone":"git clone https://github.com/luka-dev/headless-task-server.git","description":"A headless browser task/job queue & runner based on Hero (Chrome)","language":"TypeScript","stars":34,"topics":["headless","browser","chrome","chromium","automation","puppeteer","playwright","scraping","job-queue","job-scheduler"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Headless Task Server A headless browser task server based on Hero. - Hero is a web browser that's built for scraping. - This task server allow you to process multiple task simultaneously on single server instance - Has Helper for PHP to make request easy Install - Install dependencies - Make build - Now we can run it directly on machine NOTE: Viewing browser and replays will work only on machine - Docker way - Build Docker image - Run Docker image - Directly on machine way - Run task server - #### Enjoy Additional ENVs: - AUTH KEY - Auth key for requests, default null - SERVER PORT - Server port, default 8080 - UPSTREAM PROXY URL - Default proxy for script, default null , also can be set personally for each task in options upstreamProxyUrl - QUEUE TIMEOUT - Max queue waiting time. Ends when task moved from queue to pool , default 30000 (30 sec) - INIT TIMEOUT - Max waiting time, to launch new chrome context for task. Runs when task moved to pool , default 15000 (15 sec) - SESSION TIMEOUT - Max task script execution time inside pool / Counts only after context created, default 60000 (1 min) - MAX CONCURRENCY - Limit of concurrent tasks, default 5 NOTE: If you want to calculate custom value, you can use this formula MAX CONCURRENCY = (FREE RAM - 1.5GB) / 0.5GB , also to prevent stuttering avg formula for CPU is MAX CONCURRENCY = CPU CORES COUNT 2 - CONCURRENCY DISABLE MEM LIMITER - Memory limiter for concurrency, can be disabled with true . NOTE: If free memory less than 500MB,","default_branch":null,"files":null,"tree":[],"storefront":"/r/luka-dev","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/luka-dev/headless-task-server/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}