{"repo":"xorbitsai/xorbits","free":true,"listed":false,"github":"https://github.com/xorbitsai/xorbits","clone":"git clone https://github.com/xorbitsai/xorbits.git","description":"Scalable Python DS & ML, in an API compatible & lightning fast way.","language":"Python","stars":1200,"topics":["data-science","distributed-systems","numpy","pandas","python","scalable","lightgbm","machine-learning","ml","xgboost"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"What is Xorbits? Xorbits is an open-source computing framework that makes it easy to scale data science and machine learning workloads — from data preprocessing to tuning, training, and model serving. Xorbits can leverage multi-cores or GPUs to accelerate computation on a single machine or scale out up to thousands of machines to support processing terabytes of data and training or serving large models. Xorbits provides a suite of best-in-class libraries for data scientists and machine learning practitioners. Xorbits provides the capability to scale tasks without the necessity for extensive knowledge of infrastructure. Xorbits features a familiar Python API that supports a variety of libraries, including pandas, NumPy, PyTorch, XGBoost, etc. With a simple modification of just one line of code, your pandas workflow can be seamlessly scaled using Xorbits: Why Xorbits? As ML and AI workloads continue to grow in complexity, the computational demands soar high. Even though single-node development environments like your laptop provide convenience, but they fall short when it comes to accommodating these scaling demands. Seamlessly scale your workflow from laptop to cluster To use Xorbits, you do not need to specify how to distribute the data or even know how many cores your system has. You can keep using your existing notebooks and still enjoy a significant speed boost from Xorbits, even on your laptop. Process large datasets that pandas can't Xorbits can leverage all of your compu","default_branch":null,"files":null,"tree":[],"storefront":"/r/xorbitsai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/xorbitsai/xorbits/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}