SODA Crystal provides unified metadata management platform for unstructured data for cloud and more.
Considering the state of unstructured data explosion, an efficient data management needs a strong backbone of metadata management. Hence we started thinking to build a dedicated solution for unified metadata management platform, especially for unstructured data.
There are s3 metadata management modules developed as a part of SODA Strato project.
Metadata management is more of a horizontal component across other projects or modules of SODA ODF(Open Data Framework) and any
other data management platforms. Hence, when crystal project is planned, we thought of bringing the metadata management modules
for s3 from SODA Strato project to this crystal project.
Based on our analysis (in progress), there are different open source projects are focussing on metadata management. So the key
strategy is to further investigate, derive or onboard suitable modules or projects to crystal solution along with unique features
development within the project
So, the strategy is to develop the unique components (or delta with exisitng projects) in this project and integrate other open solutions to build the complete crystal platform of unified metadata management for unstructured data.
- Collector
- Services
- Classification
- Initial architecture
- In progress : We are in the process of brining the s3 metadata management modules from SODA Strato here. - Expected by 17th September 2023 - Done
- In progress : Cleanup issue fix
- In progress : Open Source analysis of metadata management project and unique value assessment
Please feel free to share your requirements for crystal here
Join SODA Slack and share your interest in the ‘general’ channel