{"repo":"davideganna/DataMorphers","free":true,"listed":false,"github":"https://github.com/davideganna/DataMorphers","clone":"git clone https://github.com/davideganna/DataMorphers.git","description":"Flexible framework for transforming Pandas and Polars DataFrames using a modular data pipeline approach.","language":"Python","stars":16,"topics":["pandas","python","polars","data-engineering"],"license":"MIT","category":"data-pipelines","readme_excerpt":"⚙️ DataMorphers Overview DataMorphers provides a flexible framework for transforming Pandas and Polars DataFrames using a modular data pipeline approach. Transformations are defined in a YAML configuration, and are applied sequentially to your dataset. By leveraging DataMorphers, your pipelines become cleaner, more scalable and easier to debug. Features - Modular and extensible transformation framework to design data pipelines, easily configurable from YAML files. - Supports multiple transformations, alphabetically ordered here (more to come!): - CreateColumn - CastColumnTypes - ColumnsOperator - DropDuplicates - DropNA - FillNA - FilterRows - FlatMultiIndex - MergeDataFrames - NormalizeColumn - RemoveColumns - RenameColumns - Rolling - SelectColumns - ToLower - ToUpper - Supports custom transformations, defined by the user. - Supports storing and retrieving objects throughout the entire application lifecycle, by leveraging DataMorphersStorage Installation Install DataMorphers in your project directly from PyPI: Usage 1. Define your initial DataFrame item item type price discount pct :----- :---------- ----: -----------: apple food 3 0.1 TV electronics 100 0.05 banana food 2.5 nan pasta food 3 0.12 cake food 15 nan 2. Define Your Transformation Pipeline Imagine that we want to perform some actions on the original DataFrame. Specifically, we want to identify which items are food, and then calculate the price after a discount percentage is applied. After these operations, we wa","default_branch":null,"files":null,"tree":[],"storefront":"/r/davideganna","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/davideganna/DataMorphers/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}