Monitoring Message Dictionary

The set of supported Simulation Monitoring message types are defined below. The message codes are defined within a controlled vocabulary.

Standard Fields are included in every message below.

0000 - Simulation initialisation

0100 - Simulation ends

1000 - Computing job starts

1100 - Computing job ends

1900 - Computing jobs command failure

1999 - Computing job fails - FATAL simulation has been stopped due to an error

2000 - Post-processing job starts

2100 - Post-processing job ends

2900 - Post-processing jobs command failure

2999 - Post-processing job fails - FATAL post-processing has been stopped due to an error

3000 - Post-processing from checker job starts

3100 - Post-processing from checker job ends

3900 - Post-processing from checker jobs command failure

3999 - Post-processing from checker job fails - FATAL post-processing from checker has been stopped due to an error

7000 - Environment Metrics

7010 - Project Metrics

7100 - Simulation Metrics

8000 - Supervision : late job detection

8001 - Supervision : late job but ok

8100 - Supervision formatter

8200 - Supervision dispatcher

8300 - Supervision verification

8400 - Supervision mail

8888 - Cleanup

Custom fields associated with specific message:

#### 0000 - Simulation initialisation (FirstInitialize)

Standard Fields

Custom Fields

• activity - simulation activity (validated against a controlled vocabulary)

• centre - the computing centre where simulation is being run (validated against a controlled vocabulary)

• startDate - date upon which the simulation starts

• endDate - date upon which the simulation ends

• experiment - experiment being run (validated against a controlled vocabulary)

• jobuid - the job universally unique identifier

• login - computing centre operator login under which the simulation was run (validated against a controlled vocabulary)

• machine - computing centre machine upon which simulation was run (validated against a controlled vocabulary)

• model - the climate model being executed (validated against a controlled vocabulary)

• name - the operator assigned simulation name

• space - the simulation output space (validated against a controlled vocabulary)

• nesting - the execution depth of the current call tree

• simuid - the simulation universally unique identifier

• accountingProject - project providing computing hours

• jobWarningDelay - requested job duration in seconds

• jobSchedulerID - ID attributed by the scheduler to this job

• jobSubmissionPath - Submit directory and job localisation

Attachments

• config card - the simulation .ini configuration file

#### 0100 - Simulation end

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 1000 - Computing job starts

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

• accountingProject - project providing computing hours

• jobWarningDelay - requested job duration in seconds

• jobSchedulerID - ID attributed by the scheduler to this job

• jobSubmissionPath - Submit directory and job localisation

#### 1100 - Computing job ends

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 1900 - PopStack Failure - an error occurred whilst executing a command

Standard Fields

Custom Fields

• command - the command (plus parameters) that failed

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 1999 - FATAL - simulation has been stopped due to an error

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 2000 - Post-processing job starts

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

• accountingProject - project providing computing hours

• jobWarningDelay - requested job duration in seconds

• jobSchedulerID - ID attributed by the scheduler to this job

• jobSubmissionPath - Submit directory and job localisation

• postProcessingName - (like : rebuild_fromWorkdir)

• postProcessingDate - (like : 19801231)

• postProcessingDimn - (like : Chunck3D)

• postProcessingComp - (like : ATM)

• postProcessingFile - (like : Post_1M_histmth)

#### 2100 - Post-processing job ends

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 2900 - Post-processing job fails

Standard Fields

Custom Fields

• command - the command (plus parameters) that failed

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 2999 - FATAL - post-processing has been stopped due to an error

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 3000 - Post-processing from checker job starts

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 3100 - Post-processing from checker job ends

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 3900 - Post-processing from checker job fails

Standard Fields

Custom Fields

• command - the command (plus parameters) that failed

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 3999 - FATAL - post-processing from checker has been stopped due to an error

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

#### 7000 - Environment metrics

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

• actionName -

• size_Mo -

• duration_ms -

• throughput_Mo_s -

• dirFrom -

• dirTo -

#### 7010 - Project metrics

Standard Fields

Custom Fields

• jobuid - the job universally unique identifier

• simuid - the simulation universally unique identifier

• projectName - name of the project we describe

• projectCentre - centre on which the project is active

• projectMachine - machine on which there is a resource allocation

• projectNodeType - architecture on which there is a resource allocation

• projectAllocation - amount of the allocation (hours)

• projectStartDate - start date of the allocation

• projectEndDate - end date of the allocation

• consumptionByProjectDate - date considered

• consumptionByProjectTotal - amount of resources used at date for the above mentioned project. (hours)

• consumptionByLoginLogin - login considered

• consumptionByLoginDate - date considered

• consumptionByLoginTotal - amount of resources used to date by the considered login within the considered project. (hours)

• occupationStoreLogin - login considered

• occupationStoreDate - date considered

• occupationStoreStoreName - name of the storage space

• occupationStoreStoreSize - space used by the considered login (Go)

#### 7100 - Simulation metrics

Standard Fields

Custom Fields

• metricsGroupName : group name metrics should be pushed in

Attachments

• json files -

#### 8000 - Supervision : late job detection (internal message)

Standard Fields

#### 8001 - Supervision : the job is late but still running at HPC

Standard Fields

#### 8100 - Supervision formatter (internal message)

Standard Fields

#### 8200 - Supervision dispatcher (internal message)

Standard Fields

#### 8300 - Supervision verification ok.

Standard Fields

#### 8400 - Supervision : mail to the user if the supervision fails (internal message) ?

Standard Fields

#### 8888 - CleanUp

Standard Fields