{"repo":"nomic-ai/deepscatter","free":true,"listed":false,"github":"https://github.com/nomic-ai/deepscatter","clone":"git clone https://github.com/nomic-ai/deepscatter.git","description":"Zoomable, animated scatterplots in the browser that scales over a billion points","language":"TypeScript","stars":1157,"topics":["data-visualization","visualization","webgl"],"license":null,"category":"analytics","readme_excerpt":"Deep Scatterplots for the Web This is a library for allowing interactive visualization of extremely large datasets, in browser. It's fast for three reasons: 1. All data is sent in the Apache Arrow feather format, in a custom quadtree format that makes it possible to only load data as needed on zoom. Feather takes no time to parse in the browser once transferred, compresses pretty well, and can be directly copied to the GPU without transformation in JS. This is the way of the future. We also now allow custom in-browser calculations on Arrow data. 2. Most rendering is done in custom layers using WebGL, with a buffer management strategy handled by REGL. This means that there are no unnecessary abstractions around points or separate draw calls for different objects; a minimum number of buffers are attached for all needed points. 3. Almost all grammar-of-graphics transforms such are handled on the GPU, which allows for interpolated transitions with calculations done in parallel. It also runs in completely static settings, so you can host a million-point scatterplot over something like Github Pages. Deepscatter is the underlying graphics engine for Atlas. It is provided under an NC-CC-BY-SA license for all noncommercial use. Examples - Atlas map of 5.5 million tweets. (Nomic) - Narrative visualization of 20 million biomedical abstracts embedded using T-SNE.. (Collaboration between Nomic and the University of Tübingen). - 1 million+ documents from arxiv.com rendered inside an Observ","default_branch":null,"files":null,"tree":[],"storefront":"/r/nomic-ai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/nomic-ai/deepscatter/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}