Skip to content

Intelligent Excel data cleaning and transformation pipeline for health records — supports per-file rules, privacy sanitization, CSV conversion, and a user-friendly upload UI.

License

DevilsDev/csv_procedure

Repository files navigation

Clinisync

CI Build Status License Documentation codecov

Clinisync is a modular, extensible ETL platform designed to securely clean and transform healthcare data from spreadsheet files into standardized, de-identified CSVs.

Built with Node.js and Express, it provides both API and CLI interfaces and supports multi-sheet Excel processing with full privacy compliance, unit tests, CI/CD integration, and documentation powered by Docusaurus.


🚀 Getting Started

Install & Run

npm install
npm run dev

Upload Files via API

curl -F "excel=@path/to/input.xlsx" http://localhost:3000/upload

Returns a JSON response with a list of generated cleaned CSV files.


🧼 Cleaning Rules

  • NHI → anonymized ID-001, ID-002, etc.
  • DOBAge (accurate, format-tolerant)
  • Removes: Address, Contact, unnamed columns
  • Applies rules consistently across all sheets

📁 Project Structure

csv_procedure/
├── src/
│   ├── etl/                # ETL modules: extract, transform, load, idMapper
│   └── routes/             # Express upload route
├── __tests__/              # Jest test suite
├── docs/                   # Docusaurus site (see /docs/README.md)
├── VERSION                 # Current release version
├── CHANGELOG.md            # Project changelog
└── README.md

🧪 Testing

npm test

Includes full unit and integration coverage with Jest.


📝 Documentation

Full docs available at:
https://devilsdev.github.io/csv_procedure/

To run locally:

cd docs
npm install
npm run start

To deploy:

./deploy-gh-pages.sh

📦 Release History

See CHANGELOG.md


📄 License

Licensed under the MIT License.
(c) Ali Kahwaji, 2025

About

Intelligent Excel data cleaning and transformation pipeline for health records — supports per-file rules, privacy sanitization, CSV conversion, and a user-friendly upload UI.

Resources

License

Stars

Watchers

Forks

Packages

No packages published