{"repo":"devtbit/tg-scrapper","free":true,"listed":false,"github":"https://github.com/devtbit/tg-scrapper","clone":"git clone https://github.com/devtbit/tg-scrapper.git","description":"Utility tool to automate the scraping of Telegram groups/channels.","language":"Python","stars":15,"topics":["telegram-api","telegram","scraper","data-mining","osint","telethon","docker"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"Telegram Scrapper Utility tool to scrape Telegram groups/channels. It downloads the messages of a group within a date range, it will also download all the media/files of the messages. Everything can be optionally uploaded to a S3 bucket. This tool was created with a focus on automation and containerization. The idea behind this tool was inspired by https://github.com/jordanwildon/Telepathy Requirements This tool depends on Telethon and is required to be registered in Telegram API. Credentials are provided through environment variables. To set the variables: To obtain API credentials go to: my.telegram.org AWS CLI can optionally be installed in order to upload data to a S3 Bucket. Install dependencies Usage Tool uses invoke to run tasks: Examples Validate your session before running any other command (if you haven't): Telethon will generate session files that can be reused. Scraping Scrape two groups from 2022-01-01 to 2022-03-01 and display every message (skipping media download): This command will fetch all memebers of the groups (if possible) and all messages and store them in 2 CSV files. You can also store the messages in a local sqlite database: You can specify a custom path with the environment variable TG DB NAME Uploading to S3 The next command requires AWS CLI with credentials configured (note that account only requires PutObject permissions to the bucket). Scrape one group from 2022-02-28 to 2022-03-01 and upload everything to a S3 Bucket named MY BUCKET: Docker The","default_branch":null,"files":null,"tree":[],"storefront":"/r/devtbit","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/devtbit/tg-scrapper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}