Skip to content

Request Manager

ticoann edited this page May 7, 2018 · 7 revisions

For users

  1. Definition of request arguments
  2. Definition of request status
  3. Design document (Old - original)

RequestManager2 Overview

  1. Provide the tools for request creation and management(REST API, Web GUI)
  2. Validate the requests parameters.
  3. Manage the request life cycle (in terms of providing tools to update status, priority and other parameters)
  4. Store the request data in DB (couch db backend)
  5. Provide search tools on request data (REST API, Web GUI)

DBBackends (CouchDB)

  1. reqmgr_workload_cache: stores request metadata and spec files.
  2. reqmgr_config_cache: stores config files for parameter set which is used by RuntimeScritpt and CMSSW
  3. reqmgr_auxiliary: stores config files to control components - users can use this to control agent functionality
  4. wmdatamining: stores the data for request summary periodically to provide historical overview (deprecated)
  5. acdcserver: stores file information from failed job. (Technically is it is not part of reqmgr2 since it is deployed separately but it could be integrated to ReqMgr2)

Services

  1. ReqMgr2 APIs: RequestManager provides APIs to create, updates and retrieve data from backend database. List of APIs are here ReqMgr2 APIs
  2. It provides GUI for yours to create, updated and search some of the requests' information. (i.e Supports bulk assignment and reject) CMS Production request manager
  3. Provides threads which periodically runs in background (Cherrypy Thread)
    • StateChangeTasks: collect the information from the GlobalWorkQueue and WMStats to determine each individual request status and advance them if the proper condition met
    • HeartbeatMonitor: Monitor backgrounds services and report them to WMStats
    • AuxCacheUpdateTasks: update reqmgr_auxiliary db parameters periodically - currently only updates CMSSW versions
    • CouchDBCleanup: Clean up ACDC entries for archived workflow
    • WMDataMining: periodically gets the snapshot of job information in requests and updated to wmdataminig db. Which intern provides plots for different aspects of data. (deprecated)
Clone this wiki locally