{"repo":"mrpowers-io/quinn","free":true,"listed":false,"github":"https://github.com/mrpowers-io/quinn","clone":"git clone https://github.com/mrpowers-io/quinn.git","description":"pyspark methods to enhance developer productivity 📣 👯 🎉","language":"Python","stars":687,"topics":["pyspark","apache-spark"],"license":"Apache-2.0","category":"productivity","readme_excerpt":"Quinn ](https://github.com/MrPowers/quinn/actions/workflows/ci.yml/badge.svg) ](https://github.com/MrPowers/quinn/actions/workflows/lint.yaml/badge.svg) Pyspark helper methods to maximize developer productivity. Quinn provides DataFrame validation functions, useful column functions / DataFrame transformations, and performant helper functions. Documentation You can find official documentation here. Setup Quinn is uploaded to PyPi and can be installed with this command: Quinn Helper Functions DataFrame Validations validate presence of columns() Raises an exception unless source df contains the name , age , and fun column. validate schema() Raises an exception unless source df contains all the StructFields defined in the required schema . validate absence of columns() Raises an exception if source df contains age or cool columns. Functions single space() Replaces all multispaces with single spaces (e.g. changes \"this has some\" to \"this has some\" . remove all whitespace() Removes all whitespace in a string (e.g. changes \"this has some\" to \"thishassome\" . anti trim() Removes all inner whitespace, but doesn't delete leading or trailing whitespace (e.g. changes \" this has some \" to \" thishassome \" . remove non word characters() Removes all non-word characters from a string (e.g. changes \"si%$#@!#$!@#mpsons\" to \"simpsons\" . multi equals() multi equals returns true if s1 and s2 are both equal to \"cat\" . approx equal() This function takes 3 arguments which are 2 Pyspark DataFrames and ","default_branch":null,"files":null,"tree":[],"storefront":"/r/mrpowers-io","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mrpowers-io/quinn/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}