Built with
Prepup is a free open-source package that lets you inspect, explore, visualize, and perform pre-processing tasks on datasets in your windows/macOS terminal.
- Prepup can be installed using the Pip package manager.
- Developing an efficient and user-friendly command line tool for data pre-processing to handle various tasks such as missing data, data formatting, and cleaning, with a simple interface and scalability for large datasets.
- CSV
- EXCEL
- PARQUET
- Prepup is built on Polars which is an alternative to pandas and helps you load and manipulate the DataFrames faster.
- Prepup handles tasks ranging from the shape of data to the Standardizing of the feature before training the model. It does it right on the terminal.
- Prepup supports CSV, EXCEL, and PARQUET formats making it compatible to go with different file formats.
- Prepup doesn't alter your raw data, It saves pre-processed data only when the user specifies the path.
- Prepup is terminal-based and has specific entry points designed for using it instantly.
inspect.mp4
- inspect flag takes the dataframe and returns the Features available, Features datatype, and missing values present in the Dataset.
- File Name: If the current working directory is same as the file location or FILE PATH
explore.mp4
- explore flag takes the dataframe and returns the Features available, Features datatype, Correlation between features, Detects Outliers, Checks Normal Distribution, Checks Skewness, Checks Kurtosis, and also allows the option to check if the dataset is Imbalanced.
- File Name: If the current working directory is same as the file location or FILE PATH
visualize.mp4
- visualize flag plots of the feature distribution directly on the terminal.
- File Name: If the current working directory is same as the file location or FILE PATH
impute.mp4
-
There are 8 different strategies available to impute missing data using Prepup
-
File Name: If the current working directory is same as the file location or FILE PATH
- Option 1 - Drops the Missing Data
- Option 2 - Impute Missing values with a Specific value
- Option 3 - Impute Missing values with Mean.
- Option 4 - Impute Missing values with Median.
- Option 5 - Impute Missing value based on the distribution of existing columns.
- Option 6 - Impute Missing values based on Forward Fill Strategy where missing values are imputed based on the previous data points.
- Option 7 - Impute Missing values based on Backward Strategy where missing values are imputed based on the next data points.
- Option 8 - Impute missing values based on K-Nearest Neighbors.
standardize.mp4
-
Standardize allows you to standardize the dataset using two different methods:
-
Robust Scaler
-
Standard Scaler
-
-
Robust Scaler is recommended if there are outliers present and you feel they can have an influence on the Machine Learning model.
-
Standard Scaler is the go-to function if you want to standardize the dataset before training the model on it.
-
File Name: If the current working directory is same as the file location or FILE PATH
- Free software: MIT license
-
Documentation: https://sudhanshumukherjeexx.github.io/prepup