{"repo":"apache/doris-streamloader","free":true,"listed":false,"github":"https://github.com/apache/doris-streamloader","clone":"git clone https://github.com/apache/doris-streamloader.git","description":"Stream Loader for Apache Doris","language":"Go","stars":35,"topics":["bigquery","database","dbt","delta-lake","elt","etl","hadoop","hive","hudi","iceberg"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Apache Doris Streamloader A robust, high-performance and user-friendly alternative to the traditional curl-based Stream Load. Key Features - Parallel Loading : Split data files automatically and perform parallel loading - Support for Multiple Files and Directories : Support multiple files and directories load with one shot - Path Traversal Support : Support path traversal when the source files are in directories - Resilience and Continuity : Resume loading from previous failures and cancellations - Automatic Retry Mechanism : Retry automatically when failure - Comprehensive and Concise Input Parameters Usage - FILE LIST : directory or file list, support \\ wildcard - FE OR BE SERVER URL & PORT : Doris FE or BE hostname or IP and HTTP port - STREAMLOAD HEADER : supports all headers as curl Stream Load does，multiple headers are separated by '?' - TARGET DATABASE & TARGET TABLE : indicate the target database and table where the data will be loaded e.g.: For additional details and options, refer to our comprehensive docs below. Docs User Guide 中文使用文档 Build To build Streamloader, ensure you have golang installed (version = 1.19.9). For example, on CentOS: Then, navigate to the doris-streamloader directory and execute: Linux/macOS: Windows: License Apache License, Version 2.0","default_branch":null,"files":null,"tree":[],"storefront":"/r/apache","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/apache/doris-streamloader/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}