Home

Welcome to the DBMaster wiki!

To add your custom dataset:

• Step 1: Onboard a data vendor and catalog

• Step 2: (Optional, up to your case) Compute derived dataset (i.e. compute any derived dataset using the raw vendor data)

To ask questions or comment, use Issues.

Currently, I don't accept PR unless it's discussed and agreed upon in Issues, but your feedback and comments are much appreciated!

Limitations and TODOs

This is a new project and a beta release. (API design might change between versions)

This project is for building a data management framework for Personal use. "Personal" probably means:

• local file-based, i.e. not intended to be running on some server on the cloud
• no advanced enterprise-level features like backup, disaster recovery, time travel, etc.

Topics that are possibly out of the scope of this project also include:

• Periodical (or event-driven) scheduler which triggers job running.
• Large amounts of data and concurrency needs.

However, anything related to database maintenance and management is considered in the scope of this project, including but not limited to:

• more vendor and catalog types to illustrate the usage or "good to have in general".
• visualization tool or command-line tool that displays useful stats about the database(s) under DBMaster's management. e.g. database location, table size, ...
• quality-check tool that enhances data quality ...