{"repo":"raphaelberly/journal","free":true,"listed":false,"github":"https://github.com/raphaelberly/journal","clone":"git clone https://github.com/raphaelberly/journal.git","description":"A movie journal coupled with open IMDb data, and a Flask web-app for easy movie insertion.","language":"Python","stars":11,"topics":["etl","imdb","scraping","flask","web-app"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"Movie Journal Since January 2014, I have been keeping an Excel log of movies as I watched them, in order to keep track of what I watch and to compute some basic statistics. I recently decided to upgrade it. This project aims at keeping a journal of the movies I have seen. It takes the form of a Postgres database containing both the logs of all the movies I have seen and open IMDb data. This enables me to get a lot of information about the movies I have seen, and also to be able to compute all kinds of useful statistics (proportion of movies watched per genre, favourite directors, actors, writers, etc.) In order to rate movies and add them to my database (with their IMDb ID!) conveniently, whenever I want from my phone or my computer, I also built a web app, in the form of a Flask Website, which looks something like this: It recently evolved into a more sophisticated web app offering new features, such as a \"Recent\" page to check the most recent movies seen, a \"Watchlist\" page to store your movie watch list, and a \"Statistics\" page. 1. ETL The ETL part of the project aims at inserting the open IMDb data into the database. To do so, one can use the script main etl.py . Usage example: python main etl.py -t titles The process is automated on my Raspberry Pi via a cron job, which purpose is to refresh the IMDb data on the database every week (to get updated rankings, new titles, etc.) The ETL class (defined in lib/etl.py ) is used and the process follows the three inherent steps o","default_branch":null,"files":null,"tree":[],"storefront":"/r/raphaelberly","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/raphaelberly/journal/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}