{"repo":"databendlabs/databend","free":true,"listed":false,"github":"https://github.com/databendlabs/databend","clone":"git clone https://github.com/databendlabs/databend.git","description":"Data Agent Ready Warehouse : One for  Analytics, Search, AI, Python Sandbox.  — rebuilt from scratch. Unified architecture on your S3.","language":"Rust","stars":9414,"topics":["ai","bigdata","cloud-native","database","elasticsearch","geospatial","lakehouse","olap","rust","serverless","snowflake","sql","vector-database","vector-search"],"license":null,"category":"data_warehouse","readme_excerpt":"<h1 align=\"center\">Databend</h1>\n<h3 align=\"center\">Enterprise Data Warehouse for AI Agents</h3>\n<p align=\"center\">Large-scale analytics, vector search, full-text search — with flexible agent orchestration and secure Python UDF sandboxes. Built for enterprise AI workloads.</p>\n\n<div align=\"center\">\n\n<a href=\"https://databend.com/\">☁️ Try Cloud</a> •\n<a href=\"#-quick-start\">🚀 Quick Start</a> •\n<a href=\"https://docs.databend.com/\">📖 Documentation</a> •\n<a href=\"https://link.databend.com/join-slack\">💬 Slack</a>\n\n<br><br>\n\n<a href=\"https://github.com/databendlabs/databend/actions/workflows/release.yml\">\n<img src=\"https://img.shields.io/github/actions/workflow/status/datafuselabs/databend/release.yml?branch=main\" alt=\"CI Status\" />\n</a>\n<img src=\"https://img.shields.io/badge/Platform-Linux%2C%20macOS%2C%20ARM-green.svg?style=flat\" alt=\"Platform\" />\n\n</div>\n\n<br>\n\n<img src=\"https://github.com/user-attachments/assets/4c288d5c-9365-44f7-8cde-b2c7ebe15622\" alt=\"databend\" width=\"100%\" />\n\n## 💡 Why Databend?\n\nDatabend is an open-source enterprise data warehouse built in Rust.\n\n**Core capabilities**: Analytics, vector search, full-text search, auto schema evolution — unified in one engine.\n\n**Agent-ready**: Sandbox UDFs for agent logic, SQL for orchestration, transactions for reliability, branching for safe experimentation on production data.\n\n| | |\n| :--- | :--- |\n| **📊 Core Engine**<br>Analytics, vector search, full-text search, auto schema evolution, transactions. | **🤖 Agent-Ready**<br>Sandbox UDF + SQL orchestration. Build and run agents on your enterprise data. |\n| **🏢 Enterprise Scale**<br>Elastic compute, cloud native. S3/Azure/GCS. | **🌿 Branching**<br>Git-like data versioning. Agents safely operate on production snapshots. |\n\n![Databend Architecture](https://github.com/user-attachments/assets/288dea8d-0243-4c45-8d18-d4d402b08075)\n\n## ⚡ Quick Start\n\n### 1. Cloud (Recommended)\n[Start for free on Databend Cloud](https://docs.databend.com/guides/cloud/) — Production-ready in 60 seconds.\n\n### 2. Local (Python)\nIdeal for development and testing. Requires Python 3.12 or 3.13 and `databend-driver` 0.34.0 or later:\n\n```bash\npip install \"databend-driver[local]>=0.34.0\"\n```\n\n```python\nfrom databend_driver import connect\n\nconn = connect(\"databend+local:///./local-state\")\nprint(conn.query_row(\"SELECT 'Hello, Databend!'\").values())\n```\n\n### 3. Docker\nRun the full warehouse locally:\n\n```bash\ndocker run -p 8000:8000 datafuselabs/databend\n```\n\n## 🤖 Agent-Ready Architecture\n\nDatabend's **Sandbox UDF** enables flexible agent orchestration with a three-layer architecture:\n\n- **Control Plane**: Resource scheduling, permission validation, sandbox lifecycle management\n- **Execution Plane** (Databend): SQL orchestration, issues requests via Arrow Flight\n- **Compute Plane** (Sandbox Workers): Isolated sandboxes running your agent logic\n\n```sql\n-- Define your agent logic\nCREATE FUNCTION my_agent(input STRING) RETURNS STRING\nLANGUAGE python HANDLER = 'run'\nAS $$\ndef run(input):\n    # Your agent logic: LLM calls, tool use, reasoning...\n    return response\n$$;\n\n-- Orchestrate agents with SQL\nSELECT my_agent(question) FROM tasks;\n```\n\n## 🚀 Use Cases\n\n- **AI Agents**: Sandbox UDF + SQL orchestration + branching for safe operations\n- **Analytics & BI**: Large-scale SQL analytics — [Learn more](https://docs.databend.com/guides/query/sql-analytics)\n- **Search & RAG**: Vector + full-text search — [Learn more](https://docs.databend.com/guides/query/vector-db)\n\n## 🤝 Community & Support\n\n- [📖 Documentation](https://docs.databend.com/)\n- [💬 Join Slack](https://link.databend.com/join-slack)\n- [🐛 Issue Tracker](https://github.com/databendlabs/databend/issues)\n- [🗺️ Roadmap](https://github.com/databendlabs/databend/issues/14167)\n\n**Contributors are immortalized in the `system.contributors` table 🏆**\n\n## 📄 License\n\n[Apache 2.0](licenses/Apache-2.0.txt) + [Elastic 2.0](licenses/Elastic.txt) | [Licensing FAQ](https://docs.databend.com/guides/products/dee/license)\n\n---\n\n<div align=\"center\">\n<strong>Enterprise warehouse, agent ready</strong><br>\n<a href=\"https://databend.com\">🌐 Website</a> •\n<a href=\"https://x.com/DatabendLabs\">🐦 Twitter</a>\n</div>\n","default_branch":"main","files":6737,"tree":[".cargo/audit.toml",".cargo/config.toml",".config/nextest.toml",".config/version-schema.json",".config/workspace-schema.json",".devcontainer/Dockerfile",".devcontainer/devcontainer.json",".editorconfig",".gitattributes",".github/CODEOWNERS",".github/ISSUE_TEMPLATE/10_feature_request.md",".github/ISSUE_TEMPLATE/20_bug_report.yml",".github/ISSUE_TEMPLATE/30_blank_issue.md",".github/ISSUE_TEMPLATE/config.yml",".github/PULL_REQUEST_TEMPLATE.md",".github/actions-rs/grcov.yml",".github/actions/artifact_download/action.yml",".github/actions/artifact_failure/action.yml",".github/actions/artifact_meta_container_failure/action.yml",".github/actions/artifact_upload/action.yml",".github/actions/benchmark_cloud/action.yml",".github/actions/benchmark_local/action.yml",".github/actions/build_bindings_python/action.yml",".github/actions/build_linux/action.yml",".github/actions/build_linux_sanitizer/action.yml",".github/actions/build_macos/action.yml",".github/actions/check/action.yml",".github/actions/check_macos/action.yml",".github/actions/cleanup/action.yml",".github/actions/io_delay_chaos/action.yml",".github/actions/pack_binaries/action.yml",".github/actions/pack_deb/action.yml",".github/actions/publish_binary/action.yml",".github/actions/publish_deb/action.yml",".github/actions/publish_debug_symbols/action.yml",".github/actions/setup_bendsql/action.yml",".github/actions/setup_build_tool/action.yml",".github/actions/setup_docker/action.yml",".github/actions/setup_license/action.yml",".github/actions/setup_minio/action.yml",".github/actions/setup_test/action.yml",".github/actions/test_cloud_sqllogic_standalone_linux/action.yml",".github/actions/test_compat_client_cluster/action.yml",".github/actions/test_compat_fuse/action.yml",".github/actions/test_compat_meta_meta/action.yml",".github/actions/test_compat_meta_query/action.yml",".github/actions/test_ee_management_mode_linux/action.yml",".github/actions/test_ee_sqllogic_standalone_linux/action.yml",".github/actions/test_ee_standalone_fake_time_linux/action.yml",".github/actions/test_ee_standalone_linux/action.yml",".github/actions/test_fuzz_standalone_linux/action.yml",".github/actions/test_logs/action.yml",".github/actions/test_meta_cluster/action.yml",".github/actions/test_metactl/action.yml",".github/actions/test_private_tasks/action.yml",".github/actions/test_sandbox_udf/action.yml",".github/actions/test_sqllogic_cluster_linux/action.yml",".github/actions/test_sqllogic_iceberg_tpch/action.yml",".github/actions/test_sqllogic_management_mode_linux/action.yml",".github/actions/test_sqllogic_paimon/action.yml",".github/actions/test_sqllogic_stage/action.yml",".github/actions/test_sqllogic_standalone_linux/action.yml",".github/actions/test_sqllogic_standalone_linux_minio/action.yml",".github/actions/test_sqllogic_standalone_linux_minio_with_bendsave/action.yml",".github/actions/test_sqllogic_standalone_macos/action.yml",".github/actions/test_stateful_cluster_linux/action.yml",".github/actions/test_stateful_hive_standalone/action.yml",".github/actions/test_stateful_iceberg_catalogs_standalone/action.yml",".github/actions/test_stateful_large_data/action.yml",".github/actions/test_stateful_paimon_cluster_linux/action.yml",".github/actions/test_stateful_standalone_linux/action.yml",".github/actions/test_stateless_cluster_linux/action.yml",".github/actions/test_stateless_cluster_macos/action.yml",".github/actions/test_stateless_standalone_linux/action.yml",".github/actions/test_stateless_standalone_macos/action.yml",".github/actions/test_unit/action.yml",".github/codecov.yml",".github/misc/buildkitd.toml",".github/release.yml",".github/scripts/bump_version.js",".github/scripts/check_pr_ai_assistance.py",".github/scripts/check_pr_description.js",".github/scripts/check_pr_title.js",".github/scripts/generate_release_note.js",".github/scripts/notify_failure.js",".github/scripts/notify_release.js",".github/scripts/retry_failed_jobs.js",".github/scripts/test_check_pr_ai_assistance.py",".github/workflows.md",".github/workflows/bindings.python.yml",".github/workflows/build_tool.yml",".github/workflows/cloud.yml",".github/workflows/deb.yml",".github/workflows/dev.yml",".github/workflows/links.yml",".github/workflows/main.yml",".github/workflows/merge_group.yml",".github/workflows/meta.yml",".github/workflows/pr.yml",".github/workflows/release.yml",".github/workflows/retry.yml",".github/workflows/reuse.benchmark.yml",".github/workflows/reuse.explain.yml",".github/workflows/reuse.linux.yml",".github/workflows/reuse.macos.yml",".github/workflows/reuse.sqllogic.yml",".github/workflows/typos.yml",".gitignore",".typos.toml",".yamllint.yml","20260509-conversion-safety-helper.md","20260615-kll-analyze-histogram.md","AGENTS.md","AI_POLICY.md","CLAUDE.md","Cargo.lock","Cargo.toml","LICENSE","Makefile","README.md","agents/agents-md-alignment.md","agents/coding-style.md","agents/commit-and-pr.md","agents/debug-and-validation.md","agents/development-commands.md","agents/repository-structure.md","benchmark/Cargo.lock","benchmark/Cargo.toml","benchmark/README.md","benchmark/benchmark_cloud_load.py","benchmark/benchmark_local.sh","benchmark/benchmark_local_merge_into.sh","benchmark/disk_cache_merge_into/README.md","benchmark/disk_cache_merge_into/clear.sql","benchmark/disk_cache_merge_into/control_insert_only.sql","benchmark/disk_cache_merge_into/create.sql","benchmark/disk_cache_merge_into/explain.sql","benchmark/disk_cache_merge_into/merge.sql","benchmark/disk_cache_merge_into/plan.sql","benchmark/disk_cache_merge_into/reset.sql","benchmark/disk_cache_merge_into/warm.sql","benchmark/hits/analyze.sql","benchmark/hits/clear.sql","benchmark/hits/create.sql","benchmark/hits/create_local.sql","benchmark/hits/load.sql","benchmark/hits/queries/00.sql","benchmark/hits/queries/01.sql","benchmark/hits/queries/02.sql","benchmark/hits/queries/03.sql","benchmark/hits/queries/04.sql","benchmark/hits/queries/05.sql","benchmark/hits/queries/06.sql","benchmark/hits/queries/07.sql","benchmark/hits/queries/08.sql","benchmark/hits/queries/09.sql","benchmark/hits/queries/10.sql","benchmark/hits/queries/11.sql","benchmark/hits/queries/12.sql","benchmark/hits/queries/13.sql","benchmark/hits/queries/14.sql","benchmark/hits/queries/15.sql","benchmark/hits/queries/16.sql","benchmark/hits/queries/17.sql","benchmark/hits/queries/18.sql","benchmark/hits/queries/19.sql","benchmark/hits/queries/20.sql","benchmark/hits/queries/21.sql","benchmark/hits/queries/22.sql","benchmark/hits/queries/23.sql","benchmark/hits/queries/24.sql","benchmark/hits/queries/25.sql","benchmark/hits/queries/26.sql","benchmark/hits/queries/27.sql","benchmark/hits/queries/28.sql","benchmark/hits/queries/29.sql","benchmark/hits/queries/30.sql","benchmark/hits/queries/31.sql","benchmark/hits/queries/32.sql","benchmark/hits/queries/33.sql","benchmark/hits/queries/34.sql","benchmark/hits/queries/35.sql","benchmark/hits/queries/36.sql","benchmark/hits/queries/37.sql","benchmark/hits/queries/38.sql","benchmark/hits/queries/39.sql","benchmark/hits/queries/40.sql","benchmark/hits/queries/41.sql","benchmark/hits/queries/42.sql","benchmark/index.jinja","benchmark/internal/load.sh","benchmark/internal/queries/00.sql","benchmark/internal/queries/01.sql","benchmark/internal/queries/02.sql","benchmark/internal/queries/03.sql","benchmark/internal/queries/04.sql","benchmark/internal/queries/05.sql","benchmark/internal/queries/06.sql","benchmark/internal/queries/07.sql","benchmark/internal/queries/08.sql","benchmark/internal/queries/09.sql","benchmark/internal/queries/10.sql","benchmark/load/clear.sh","benchmark/load/load.sh","benchmark/load/queries/00.sql","benchmark/load/queries/01.sql","benchmark/load/queries/02.sql","benchmark/merge_into/clear.sql","benchmark/merge_into/create_local.sql","benchmark/merge_into/load.sql","benchmark/merge_into/queries.sql","benchmark/old/tpcds/README.md","benchmark/old/tpcds/load_data.sh","benchmark/old/tpcds/shell_env.sh","benchmark/old/tpcds/tpcds.sql","benchmark/old/tpch/README.md","benchmark/old/tpch/load_data.sh","benchmark/old/tpch/shell_env.sh","benchmark/old/tpch/tpch.sh","benchmark/pyproject.toml","benchmark/src/bin/benchmark_cloud.rs","benchmark/tpch/analyze.sql","benchmark/tpch/clear.sql","benchmark/tpch/create.sql","benchmark/tpch/create_local.sql","benchmark/tpch/load.sql","benchmark/tpch/queries/00.sql","benchmark/tpch/queries/01.sql","benchmark/tpch/queries/02.sql","benchmark/tpch/queries/03.sql","benchmark/tpch/queries/04.sql","benchmark/tpch/queries/05.sql","benchmark/tpch/queries/06.sql","benchmark/tpch/queries/07.sql","benchmark/tpch/queries/08.sql","benchmark/tpch/queries/09.sql","benchmark/tpch/queries/10.sql","benchmark/tpch/queries/11.sql","benchmark/tpch/queries/12.sql","benchmark/tpch/queries/13.sql","benchmark/tpch/queries/14.sql","benchmark/tpch/queries/15.sql","benchmark/tpch/queries/16.sql","benchmark/tpch/queries/17.sql","benchmark/tpch/queries/18.sql","benchmark/tpch/queries/19.sql","benchmark/tpch/queries/20.sql","benchmark/tpch/queries/21.sql","benchmark/tpch/queries/22.sql","benchmark/update_results.py","benchmark/uv.lock","benchmark/wait_tcp.py","clippy.toml","docker/Dockerfile","docker/README.md","docker/bootstrap.sh","docker/build-tool/debian/Dockerfile","docker/build-tool/dev/Dockerfile","docker/build-tool/musl/Dockerfile","docker/build-tool/musl/linker.sh","docker/it-hive/README.md","docker/it-hive/hadoop-hive.env","docker/it-hive/hive-docker-compose.yml","docker/it-iceberg-catalogs/Dockerfile","docker/it-iceberg-catalogs/core-site.xml","docker/it-iceberg-catalogs/docker-compose.yaml","docker/meta-chaos/meta.Dockerfile","docker/meta-chaos/verifier.Dockerfile","docker/query-config.toml","docker/service/meta.Dockerfile","docker/service/query.Dockerfile","docs/designs/proxy-engine-design.md","licenserc-ee.toml","licenserc.toml","licenses/Apache-2.0.txt","licenses/Elastic.txt","pyproject.toml","ruff.toml","rust-toolchain.toml","rustfmt.toml","scripts/bench_common/__init__.py","scripts/bench_common/bendsql.py","scripts/bench_common/runner.py","scripts/benchmark/analyze_frequency_stats_bench.py","scripts/benchmark/analyze_histogram_bench.py","scripts/benchmark/meta/README.md","scripts/benchmark/meta/cluster.py","scripts/benchmark/meta/lua/write_heavy_upsert_get.lua","scripts/benchmark/meta/meta-cluster-bench.py","scripts/benchmark/meta/reports/databend-meta-dependency-optimization-2026-05-14.md","scripts/benchmark/meta/run_lua_benchmark.py","scripts/benchmark/proxy_table_routing_bench.py","scripts/benchmark/query/load/hits.sh","scripts/benchmark/query/load/tpch10.sh","scripts/benchmark/query/load/tpch100.sh","scripts/build/build-debug.sh","scripts/build/build-native.sh","scripts/build/build-pkg.sh","scripts/build/build-release.sh","scripts/build/build-website.sh","scripts/ci/ci-check-query-log-duplicates.py","scripts/ci/ci-run-ee-sqllogic-tests.sh","scripts/ci/ci-run-ee-tests-management-mode.sh","scripts/ci/ci-run-ee-tests-standalone-fake-time-minio.sh","scripts/ci/ci-run-ee-tests-standalone-minio.sh","scripts/ci/ci-run-fuzz-tests.sh","scripts/ci/ci-run-heaptrack.sh","scripts/ci/ci-run-profile.sh","scripts/ci/ci-run-proxy-routing-benchmark.sh","scripts/ci/ci-run-sqllogic-tests-cloud.sh","scripts/ci/ci-run-sqllogic-tests-cluster-nginx.sh","scripts/ci/ci-run-sqllogic-tests-cluster.sh","scripts/ci/ci-run-sqllogic-tests-management-mode.sh","scripts/ci/ci-run-sqllogic-tests-minio-with-bendsave.sh","scripts/ci/ci-run-sqllogic-tests-minio.sh","scripts/ci/ci-run-sqllogic-tests-without-sandbox.sh","scripts/ci/ci-run-sqllogic-tests.sh","scripts/ci/ci-run-stateful-hive-tests-standalone.sh","scripts/ci/ci-run-stateful-iceberg-catalogs-tests-standalone.sh","scripts/ci/ci-run-stateful-paimon-tests-cluster.sh","scripts/ci/ci-run-stateful-tests-cluster-minio.sh","scripts/ci/ci-run-stateful-tests-large-data-s3.sh","scripts/ci/ci-run-stateful-tests-standalone-minio.sh","scripts/ci/ci-run-stateless-tests-cluster-tls.sh","scripts/ci/ci-run-stateless-tests-cluster.sh","scripts/ci/ci-run-stateless-tests-standalone.sh","scripts/ci/ci-run-unit-tests.sh","scripts/ci/ci-setup-chaos-meta.sh","scripts/ci/ci-setup-minio.sh","scripts/ci/cloud/create_warehouse.sh","scripts/ci/deploy/config/databend-meta-node-1.toml","scripts/ci/deploy/config/databend-meta-node-2.toml","scripts/ci/deploy/config/databend-meta-node-3.toml","scripts/ci/deploy/config/databend-meta-node-for-bendsave.toml","scripts/ci/deploy/config/databend-query-management-mode.toml","scripts/ci/deploy/config/databend-query-node-1.toml","scripts/ci/deploy/config/databend-query-node-2.toml","scripts/ci/deploy/config/databend-query-node-3.toml","scripts/ci/deploy/config/databend-query-node-hive.toml","scripts/ci/deploy/config/databend-query-node-otlp-logs.toml","scripts/ci/deploy/config/databend-query-node-system-managed.toml","scripts/ci/deploy/config/nginx.conf","scripts/ci/deploy/databend-query-cluster-3-nodes-nginx.sh","scripts/ci/deploy/databend-query-cluster-3-nodes.sh","scripts/ci/deploy/databend-query-cluster-tracing.sh","scripts/ci/deploy/databend-query-management-mode.sh","scripts/ci/deploy/databend-query-standalone-for-bendsave.sh","scripts/ci/deploy/databend-query-standalone-hive.sh","scripts/ci/deploy/databend-query-standalone-logging.sh","scripts/ci/deploy/databend-query-standalone.sh","scripts/ci/deploy/databend-query-system-managed.sh","scripts/ci/meta-chaos/ci-io-delay-meta-test.sh","scripts/ci/meta-chaos/k3d.yaml","scripts/ci/meta-chaos/meta-ha.yaml","scripts/ci/meta-chaos/verifier.yaml","scripts/ci/wait_tcp.py","scripts/databend_test_helper/README.md","scripts/databend_test_helper/pyproject.toml","scripts/databend_test_helper/src/.gitignore","scripts/databend_test_helper/src/databend_test_helper/__init__.py","scripts/databend_test_helper/src/databend_test_helper/args.py","scripts/databend_test_helper/src/databend_test_helper/cluster.py","scripts/databend_test_helper/src/databend_test_helper/configs/databend-meta-node2.toml","scripts/databend_test_helper/src/databend_test_helper/configs/databend-meta-node3.toml","scripts/databend_test_helper/src/databend_test_helper/configs/databend-meta.toml","scripts/databend_test_helper/src/databend_test_helper/configs/databend-query-node2.toml","scripts/databend_test_helper/src/databend_test_helper/configs/databend-query-node3.toml","scripts/databend_test_helper/src/databend_test_helper/configs/databend-query.toml","scripts/databend_test_helper/src/databend_test_helper/meta.py","scripts/databend_test_helper/src/databend_test_helper/meta_cluster.py","scripts/databend_test_helper/src/databend_test_helper/progress.py","scripts/databend_test_helper/src/databend_test_helper/query.py","scripts/databend_test_helper/src/databend_test_helper/query_cluster.py","scripts/databend_test_helper/src/databend_test_helper/utils.py","scripts/devops-meta/collect_meta_logs.py","scripts/devops-meta/databend-meta-diagnostics.sh","scripts/distribution/configs/databend-meta.toml","scripts/distribution/configs/databend-query.toml","scripts/distribution/deb/conf/distributions","scripts/distribution/nfpm-meta.yaml","scripts/distribution/nfpm-query-dbg.yaml","scripts/distribution/nfpm-query.yaml","scripts/distribution/package-scripts/postinstall.sh","scripts/distribution/package-scripts/preinstall.sh","scripts/distribution/release-readme.txt","scripts/distribution/systemd/databend-meta.default","scripts/distribution/systemd/databend-meta.service","scripts/distribution/systemd/databend-query.default","scripts/distribution/systemd/databend-query.service","scripts/kubernetes/meta-standalone.yaml","scripts/kubernetes/minio-sample.yaml","scripts/kubernetes/query-cluster.yaml","scripts/recluster/README.md","scripts/recluster/recluster_bench.py","scripts/recluster/run_recluster_bench_with_bin.py","scripts/security_policy/README.md","scripts/security_policy/run_security_policy_bench_with_bin.py","scripts/security_policy/security_policy_bench.py","scripts/selfhost/check_bad_tables.sh","scripts/selfhost/fetch_log.sh"],"storefront":"/r/databendlabs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/databendlabs/databend/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}