Directory structure standard for experimental pipelines.
-
Updated
Jun 19, 2024 - Python
Directory structure standard for experimental pipelines.
This module was developed to help reduce memory usage from python dictionaries, by splitting large and nested dictionaries into individual JSON files and having functionality to seamlessly access and manipulate the split data. I have used a CRUD approach, usually used in databases, for simple implementation of this module.
Example usage of python with parquet for IoT data storage and analytics
Add a description, image, and links to the datastorage topic page so that developers can more easily learn about it.
To associate your repository with the datastorage topic, visit your repo's landing page and select "manage topics."