{"repo":"astrolabsoftware/fink-broker","free":true,"listed":false,"github":"https://github.com/astrolabsoftware/fink-broker","clone":"git clone https://github.com/astrolabsoftware/fink-broker.git","description":"Astronomy Broker based on Apache Spark","language":"Python","stars":85,"topics":["apache-spark","structured-streaming","apache-kafka","alerts","astronomy","apache-hbase"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"What is Fink? Fink is an alert broker, that is a layer between astronomical alert issuers and the scientific community analysing the alert data. It exposes services to help the scientists to efficiently analyse the alert data from telescopes and surveys. Among several, it collects and stores alert data, enriches them with information from other surveys and catalogues or user-defined added values such as machine-learning classification scores, and redistributes the most promising events for further analyses, including follow-up observations. Fink's main scientific objective is to optimize the scientific impact of the Rubin Observatory alert data stream. We do not limit ourselves to a specific area, but instead our ambition is to study the transient and variable sky as a whole, from Solar system objects to galactic and extragalactic science. In practice thanks to the Zwicky Transient Facility alert stream, we are active since 2019 on Solar system objects, young stellar objects, microlensing, supernovae, kilonovae, gamma-ray bursts, active galactic nuclei, and even anomaly detection. On the technological side, Fink aims at providing a robust infrastructure and state-of-the-art streaming services to Rubin scientists, to seamlessly enable user-defined science cases in a big data context. How Fink works? The current Fink platform works in four steps. First, alerts from multiple streams are continuously ingested and stored on disk (Apache Spark Structured Streaming). Second, alerts ","default_branch":null,"files":null,"tree":[],"storefront":"/r/astrolabsoftware","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/astrolabsoftware/fink-broker/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}