{"repo":"nh43de/DataPowerTools","free":true,"listed":false,"github":"https://github.com/nh43de/DataPowerTools","clone":"git clone https://github.com/nh43de/DataPowerTools.git","description":"Bridging the gap between IEnumerable and IDataReader for dealing with unstructured and loosely-structured data, plus fast ETL + SQL Bulk Copy.","language":"C#","stars":10,"topics":["ado-net","csharp","etl","etl-framework","transformations","csv-export"],"license":"MIT","category":"data-pipelines","readme_excerpt":"DataPowerTools ADO.NET Power Tools for In-Memory Data Processing with minimal dependencies. Take a chainsaw to your data! Overview DataPowerTools are tools for dealing with changing between IEnumerable, IDataReader, and ADO.NET DataTable/DataSet. It also provides a powerful API for filtering and object materialization. Why DataPowerTools? DataPowerTools is not dependent on any other frameworks or libraries such as Entity Framework or any other ORM. It has virtually no dependencies except for some core .NET / ADO.NET libraries. Nor does it try to be an ORM. It is simply a set of tools built around the ADO.NET IDataReader interface that allow you to manipulate the reader, apply transformations, and send this data somewhere else. For example, if you want to read a CSV, transform some column names, trim or truncate some columns, and map it to a SQL server destination and bulk insert, this allows you do do so in a very high performant way and with a low memory footprint. Check out the unit tests for examples. Getting Started 1. Install DataPowerTools nuget. 2. Use methods and extensions. Understanding IDataReader IDataReader is a fundamental interface for reading data, whether it be CSV, Excel, SQL database, or other format in a streaming fashion. It has a few main operations, 1) Read() - initializes the reader and reads the first record into memory, or reads the next record. It returns true if there is a next record available, false otherwise 2) GetValue(at i or name) - gets the ","default_branch":null,"files":null,"tree":[],"storefront":"/r/nh43de","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/nh43de/DataPowerTools/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}