datasoap is a supplementary library for pandas that processes dataframes derived from CSV files. The module checks cell data for correct numerical formatting and converts mismatched data to the correct data type (ex. str > float64).
- Strips unnecessary characters from numerical data fields in pandas dataframes to ensure consistent data formatting
- Provides before and after representations of dataframes to allow for comparison
Source code is hosted on: github.com/snake-fingers/data-soap
pandas - Python package that provides fast, flexible, and expressive data structures designed to make working with “relational” or “labeled” data both easy and intuitive.
poetry add datasoap
User Docs can be found at datasoap docs
datasoap originated from a Code Fellows 401 Python midterm project. The project team includes Alex Angelico, Grace Choi, Robert Carter, Mason Fryberger, and Jae Choi. After working with a few painful datasets using, we wanted to create a library that allows users to more efficiently manipulate clean datasets extracted from CSVs that may have inconsistent formatting.
- Additional functionality that re-names columns with the common unit of measure.
- Automation of identifying columns that require reformatting, removing the need for user input on instantiation
- Extend useablity to work with other virtual environments such as pip, and conda