{"repo":"bmeares/Meerschaum","free":true,"listed":false,"github":"https://github.com/bmeares/Meerschaum","clone":"git clone https://github.com/bmeares/Meerschaum.git","description":"Create and manage data pipes with Meerschaum.","language":"Python","stars":154,"topics":["database-connector","pipe-data","data-engineering","data-analysis","pandas"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"PyPI GitHub Info Stats --- --- --- --- What is Meerschaum? Meerschaum is an ETL framework for time-series data. You define pipes — named data streams — and Meerschaum keeps them in sync: it fetches only the new or changed rows, deduplicates and upserts them, manages the schema, and handles scheduling, serving, and storage. Write a few lines of fetch logic; Meerschaum handles the rest of the pipeline. No more copy/pasting ETL scripts, hand-rolling incremental windows, or babysitting cron jobs. Drop it into an existing stack or stand up a full database-and-dashboard stack in minutes. Features - ⚡️ Incremental by default — the sync engine fetches only new or changed rows and concurrently updates many streams at once. Duplicate rows are ignored; rows with existing keys are updated. - 📊 Built for data scientists and analysts — integrate with Pandas, Grafana, and friends; persist DataFrames and always get the latest data. Skip pandas overhead and read rows as plain dicts with Pipe.get docs() . - 🗄️ Production-ready, batteries included — one-click deploy a TimescaleDB + Grafana stack, serve data org-wide via FastAPI ( uvicorn / gunicorn ), and secure API instances with scoped auth tokens. Supports PostGIS geometry (incl. ESRI CRS) for geospatial pipelines. - 💼 Jobs and scheduling — run any command as a background job with -d . Built-in scheduler handles cron and interval schedules — no crontab or systemd setup. Execute locally, via systemd , or remotely on an API instance with --","default_branch":null,"files":null,"tree":[],"storefront":"/r/bmeares","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bmeares/Meerschaum/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}