| Date: | 26 September 2021 |
|---|
Contents
Plugin_darshan_stream_store - LDMS darshan_stream_store plugin
With LDMS (Lightweight Distributed Metric Service), plugins for the ldmsd (ldms daemon) are configured via ldmsd_controller or a configuration file. The darshan_stream_store plugin writes out a single darshan json stream's data to SOS container. The input data produced by the LDMS darshan plugin consist of two types of messages: "MOD" for module data and "MET for meta data. Both messages saved into the same SOS container.
- config
- name=darshan_stream_store path=<path> stream=<stream> [mode=<mode>]configuration line
- name=<plugin_name>
- This MUST be darshan_stream_store.
- path=<path>
- The path to the root of the SOS container store (should be created by the user)
- stream=<stream>
- stream to which to subscribe.
- mode=<mode>
- The container permission mode for create, (defaults to 0660).
The input json has a "type" field, and this type used to select the the message type between module data and meta data.
A MOD darshan JSON example is shown below:
{"job_id":6582,"rank":0,"ProducerName":"nid00021","file":"N/A","record_id":6222542600266098259,"module":"POSIX","type":"MOD","max_byte":16777215,"switches":0,"cnt":1,"op":"writes_segment_0","seg":[{"off":0,"len":16777216,"dur":0.16,"timestamp":1631904596.737955}]}
A MET darshan JSON example is shown below:
Some fields are set to -1 if they don't have data for that message type.
No known bugs.
This store is in development and may be changed at any time.
Only supports one stream
Within ldmsd_controller or a configuration file:
load name=darshan_stream_store config name=darshan_stream_store path=/tmp/darshan_stream stream=darshanConnector prdcr_add name=localhost1 host=localhost type=active xprt=sock port=52001 interval=20000000 prdcr_subscribe stream=darshanConnector regex=localhost* prdcr_start name=localhost1
ldmsd(8), ldms_quickstart(7), ldmsd_controller(8), ldms_sampler_base(7), darshan_publisher, darshan_sampler, parser.pl (has perlpod), Plugin_darshan_cat_publisher(7)