DeepRepair - Error detection and correction using Deep Learning

MAIS paper

Description

This project deals with the design and applications of algorithms to perform embedding of records from a database. We aim to draw parallels with the methods currently used for word and sentence embedding and explore applications of such an embedding scheme, namely detection of erroneous records and error correction. Here we present an approach to embed records and then study its applications by building an end to end pipeline to perform error detection and error correction of records.

Applications:

Error detection
Imputation of missing data
Error correction

Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
Adult - Error Cleaning-Copy1.ipynb		Adult - Error Cleaning-Copy1.ipynb
Adult - Error Detection using GRU-Copy1.ipynb		Adult - Error Detection using GRU-Copy1.ipynb
Adult - FastText Embedding.ipynb		Adult - FastText Embedding.ipynb
Adult - Synthetic Data Generator.ipynb		Adult - Synthetic Data Generator.ipynb
Adult - Word2Vec Embedding.ipynb		Adult - Word2Vec Embedding.ipynb
Adult- MultiAttribute Classifier.ipynb		Adult- MultiAttribute Classifier.ipynb
AdultErrors.csv		AdultErrors.csv
AdultErrorsWithoutNan.csv		AdultErrorsWithoutNan.csv
AdultTrainingDataMultiAttributes.csv		AdultTrainingDataMultiAttributes.csv
Census - Error Cleaning-Copy1.ipynb		Census - Error Cleaning-Copy1.ipynb
Census - Error Detection using GRU.ipynb		Census - Error Detection using GRU.ipynb
Census - FastText Embedding.ipynb		Census - FastText Embedding.ipynb
Census - MultiAttribute Classifier.ipynb		Census - MultiAttribute Classifier.ipynb
Census - Synthetic Data Generator.ipynb		Census - Synthetic Data Generator.ipynb
Census - Word2Vec Embedding-Copy1.ipynb		Census - Word2Vec Embedding-Copy1.ipynb
CensusErrors.csv		CensusErrors.csv
CensusErrorsWithoutNan.csv		CensusErrorsWithoutNan.csv
Hospital - Error Cleaning.ipynb		Hospital - Error Cleaning.ipynb
Hospital - Error Detection using GRU.ipynb		Hospital - Error Detection using GRU.ipynb
Hospital - FastText Embedding.ipynb		Hospital - FastText Embedding.ipynb
Hospital - MultiAttribute Classifier.ipynb		Hospital - MultiAttribute Classifier.ipynb
Hospital - Word2Vec Embedding.ipynb		Hospital - Word2Vec Embedding.ipynb
HospitalErrors.csv		HospitalErrors.csv
HospitalErrorsWithoutNan.csv		HospitalErrorsWithoutNan.csv
LICENSE		LICENSE
README.md		README.md
Synthetic Data Generator.ipynb		Synthetic Data Generator.ipynb
adult.csv		adult.csv
adult_final_train.csv		adult_final_train.csv
clean_adult_dataset.csv		clean_adult_dataset.csv
clean_adult_dataset_hc.csv		clean_adult_dataset_hc.csv
clean_hospital_dataset.csv		clean_hospital_dataset.csv
clean_hospital_dataset_hc.csv		clean_hospital_dataset_hc.csv
hospital_final_train.csv		hospital_final_train.csv

License

meghu2791/DeepRepair_MAIS

Folders and files

Latest commit

History

Repository files navigation

DeepRepair - Error detection and correction using Deep Learning

Description

Applications:

About

Resources

License

Stars

Watchers

Forks

Languages