{"repo":"rphle/gag-network","free":true,"listed":false,"github":"https://github.com/rphle/gag-network","clone":"git clone https://github.com/rphle/gag-network.git","description":"Network Visualizer for the 'Geschichten aus der Geschichte' Podcast","language":"Python","stars":17,"topics":["data-science","database","javascript","network-analysis","python","sqlite3","wikipedia","wikipedia-dump","data-visualization","podcast"],"license":"AGPL-3.0","category":"databases-storage","readme_excerpt":"Geschichten aus der Geschichte Network Visualizer This project aims to visualize the intricate web of connections within the German podcast \"Geschichten aus der Geschichte\" (Stories from History). It creates a network visualization based on the podcast's episode list on Wikipedia/Episodenliste&useskin=vector), showcasing how the Wikipedia articles of the topics mentioned in the podcast are interconnected. [!Note] I am 16 years old and made this in my spare time, so please don't blame me for inefficient code :) Project Overview The GAG Network Visualizer scrapes data from Wikipedia, processes it, and generates a interactive network graph. It reveals interesting connections between historical topics discussed in the podcast episodes. Key features: - Scrapes podcast episode data and related Wikipedia articles - Processes and analyzes links between articles - Generates a visual network of interconnected topics - Provides an interactive web interface to explore the network Tech Stack - Python - Web scraping: requests , BeautifulSoup , and Selenium - Data processing: pandas and numpy - Text parsing: wikitextparser - Multiprocessing - SQLite database - SvelteKit as JavaScript frontend framework - Network visualization with vis.js Performance Optimization Significant effort has been put into optimizing the performance of this project as processing complete Wikipedia dumps: - Wikipedia index file is converted to an sqlite database at the beginning to make it searchable more easily. - ","default_branch":null,"files":null,"tree":[],"storefront":"/r/rphle","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/rphle/gag-network/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}