{"repo":"archivesunleashed/twut","free":true,"listed":false,"github":"https://github.com/archivesunleashed/twut","clone":"git clone https://github.com/archivesunleashed/twut.git","description":"An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.","language":"Scala","stars":10,"topics":["spark","tweets","twitter-data","twitter-json","apache-spark","spark-packages"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Tweet Archives Unleashed Toolkit (twut) An open-source toolkit for analyzing line-oriented JSON data from the Twitter v1.1 API or flattened line-oriented JSON data from the Twitter v2 API using Apache Spark. Dependencies - Java 8 or 11 - Python 3 - Apache Spark Getting Started To get started with twut , you can either use it directly from Maven or download the JAR and ZIP files for Spark or PySpark. Using the Spark Shell To use twut with Apache Spark, you can use the following command to include the package: Alternatively, you can download the JAR file from the latest release and include it manually: Using PySpark For Python users, download the ZIP file from the latest release and include it in your PySpark environment: You will also need to set the PYSPARK PYTHON and PYSPARK DRIVER PYTHON environment variables. Documentation and Tutorials After you have twut built or downloaded, you can follow the basic set of recipes and tutorials here. License Licensed under the Apache License, Version 2.0. Acknowledgments This work is primarily supported by the Andrew W. Mellon Foundation. Other financial and in-kind support comes from the Social Sciences and Humanities Research Council, Compute Canada, the Ontario Ministry of Research, Innovation, and Science, York University Libraries, Start Smart Labs, and the Faculty of Arts and David R. Cheriton School of Computer Science at the University of Waterloo. Any opinions, findings, and conclusions or recommendations expressed are those of ","default_branch":null,"files":null,"tree":[],"storefront":"/r/archivesunleashed","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/archivesunleashed/twut/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}