{"repo":"pwwang/pipen","free":true,"listed":false,"github":"https://github.com/pwwang/pipen","clone":"git clone https://github.com/pwwang/pipen.git","description":"A pipeline framework for python","language":"Python","stars":111,"topics":["pipeline-framework","pipeline","jinja2","dot","workflow-engine","workflow","python"],"license":"Apache-2.0","category":"workflow-automation","readme_excerpt":"A pipeline framework for Python [![Pypi][6]][7] [![Github][8]][9] ![Building][10] [![Docs and API][11]][1] [![Codacy][12]][13] [![Codacy coverage][14]][13] [![Deps][5]][23] [Documentation][1] [ChangeLog][2] [Examples][3] [API][4] Why pipen? pipen is designed for data scientists, bioinformaticians, and researchers who need to create reproducible, scalable computational pipelines without the complexity of traditional workflow systems. Target Audience - Data Scientists : Process large datasets with automatic parallelization and caching - Bioinformaticians : Build reproducible analysis pipelines for genomics data - Researchers : Create transparent, reproducible workflows for computational research - DevOps Engineers : Orchestrate batch jobs across different schedulers (SLURM, SGE, Google Cloud) Key Benefits 1. Zero Configuration - Get started immediately with sensible defaults - Configure only what you need, when you need it - Profile-based configuration for different environments 2. Reproducibility Built-In - Automatic job caching based on input/output signatures - Full audit trail of pipeline runs and parameters - Dependency tracking ensures processes run in correct order 3. Flexible Scheduling - Run locally for development - Scale to HPC clusters (SLURM, SGE) - Deploy to cloud (Google Cloud Batch, SSH) - Run in containers for reproducibility 4. Developer-Friendly - Define pipelines as Python classes - Use familiar Python syntax and tools - Extensible plugin system for custom f","default_branch":null,"files":null,"tree":[],"storefront":"/r/pwwang","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/pwwang/pipen/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}