{"repo":"vinta/albedo","free":true,"listed":false,"github":"https://github.com/vinta/albedo","clone":"git clone https://github.com/vinta/albedo.git","description":"A recommender system for discovering GitHub repos, built with Apache Spark","language":"Scala","stars":187,"topics":["recommender-system","machine-learning","apache-spark","scala","python","feature-engineering","elasticsearch"],"license":"MIT","category":"machine-learning","readme_excerpt":"Albedo ====== A recommender system for discovering GitHub repos, built with Apache Spark. Albedo is a fictional character in Dan Simmons's Hyperion Cantos series. Councilor Albedo is the TechnoCore's AI advisor to the Hegemony of Man. Setup Collect Data You need to create your own GITHUB PERSONAL TOKEN on your GitHub settings page. Start a Spark Cluster You could also create a Spark cluster on Google Cloud Dataproc. Use Popularity as the Recommendation Baseline See PopularityRecommenderBuilder.scala for complete code. Build the User Profile for Feature Engineering See UserProfileBuilder.scala for complete code. Build the Item Profile for Feature Engineering See RepoProfileBuilder.scala for complete code. Train an ALS Model for Candidate Generation See ALSRecommenderBuilder.scala for complete code. Build a Content-based Recommender for Candidate Generation Elasticsearch's More Like This API will do the tricks. See ContentRecommenderBuilder.scala for complete code. Train a Word2Vec Model for Text Vectorization See Word2VecCorpusBuilder.scala for complete code. Train a Logistic Regression Model for Ranking See LogisticRegressionRanker.scala for complete code. TODO - Build a recommender system with Spark: Factorization Machine - Build a recommender system with Spark: GDBT for Feature Learning - Build a recommender system with Spark: Item2Vec - Build a recommender system with Spark: PageRank and GraphX - Build a recommender system with Spark: XGBoost Related Posts - Build a recomm","default_branch":null,"files":null,"tree":[],"storefront":"/r/vinta","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/vinta/albedo/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}