Releases: VisionsOfficial/data-processing-chain-protocol
Releases · VisionsOfficial/data-processing-chain-protocol
Release list
[1.4.1] PreviousNodeParams and fix bug
Merge pull request #6 from VisionsOfficial/feature/v1.4.1 [1.4.1] Previous Node Params
[1.4.0] Pre in chain
Added await on pre callback in node execute function.
[1.3.0] Paused, Resume & Parallele
[v1.0.0] Data Processing Chain Protocol library
Description
The DPCP (Data Processing Chain Protocol) library is a Node.js framework designed to facilitate the orchestration of distributed data processing workflows. It allows users to create and manage a hierarchical system of chains, nodes, and pipelines, enabling scalable and modular integration with external services. The library provides capabilities for monitoring, control, and error management, making it suitable for complex and distributed applications.
Features
- Hierarchical Structure: Organizes processing workflows into chains, nodes, and pipelines for modularity and scalability.
- Node Lifecycle Management: Manages the creation, execution, and deletion of nodes, ensuring efficient operation.
- Flexible Chain Deployment: Supports dynamic deployment and distribution of chains across local and remote nodes.
- Signal Handling: Provides comprehensive signal management for precise control over node and chain actions.
- Status Monitoring: Utilizes a ReportingAgent for real-time status updates and monitoring of nodes.
- Data Processing: Executes multiple processing pipelines within nodes, allowing for both sequential and parallel execution.
- Integration with External Services: Facilitates communication with external APIs and services, including optional data transformation.
- Centralized Monitoring: The MonitoringAgent aggregates status updates and broadcasts them for external monitoring.
- Error Handling and Logging: Implements a logging system to track operations and manage errors effectively.
- Singleton Patterns: Ensures centralized management for components like NodeSupervisor and MonitoringAgent for consistency.
New Contributors
- @mathieu-vision made their first contribution in #1
Full Changelog: https://github.com/VisionsOfficial/data-processing-chain-protocol/commits/v1.0.0