Skip to content
This repository has been archived by the owner on Jan 27, 2020. It is now read-only.

Resource Manager

Christian Kreutzfeldt edited this page Apr 13, 2015 · 14 revisions

The SPQR framework relies on two different server node types:

  • [Processing Node](Processing Node)
  • Resource Manager

The first one handles all computation jobs executed from within previously instantiated micro pipelines. The latter keeps track of all SPQR cluster nodes (processing nodes) and pipelines distributed among those nodes.

This wiki page focuses on the resource manager and its internals.

Duties & Responsibilities

Inside the SPQR context the resource manager is responsible for managing all available resources to ensure an appropriate task/pipeline assignment.

Processing Node Registration & Management

A SPQR cluster forms itself through active registration where each new [processing node](Processing Node) notifies the resource manager that it wishes to be added to the cluster it supervises.

For each registered processing node the resource manager sets up a tracking instance to supervise the node, its resources and health state.

Node Registration API

To support active node registration the resource manager provides a corresponding REST API.

Node Supervision

Resource Monitoring

Pipeline Distribution

Clone this wiki locally