Branch: master
Find file History
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
..
Failed to load latest commit information.
README.md
leofs.go
leofs_test.go

README.md

LeoFS Input Plugin

The LeoFS plugin gathers metrics of LeoGateway, LeoManager, and LeoStorage using SNMP. See LeoFS Documentation / System Administration / System Monitoring.

Configuration:

# Sample Config:

[[inputs.leofs]]
        servers = ["127.0.0.1:4010"]

Measurements & Fields:

Statistics specific to the internals of LeoManager

Erlang VM

  • 1 min Statistics
    • num_of_processes
    • total_memory_usage
    • system_memory_usage
    • processes_memory_usage
    • ets_memory_usage
    • used_allocated_memory
    • allocated_memory
  • 5 min Statistics
    • num_of_processes_5min
    • total_memory_usage_5min
    • system_memory_usage_5min
    • processes_memory_usage_5min
    • ets_memory_usage_5min
    • used_allocated_memory_5min
    • allocated_memory_5min

Statistics specific to the internals of LeoStorage

Erlang VM

  • 1 min Statistics
    • num_of_processes
    • total_memory_usage
    • system_memory_usage
    • processes_memory_usage
    • ets_memory_usage
    • used_allocated_memory
    • allocated_memory
  • 5 min Statistics
    • num_of_processes_5min
    • total_memory_usage_5min
    • system_memory_usage_5min
    • processes_memory_usage_5min
    • ets_memory_usage_5min
    • used_allocated_memory_5min
    • allocated_memory_5min

Total Number of Requests

  • 1 min Statistics
    • num_of_writes
    • num_of_reads
    • num_of_deletes
  • 5 min Statistics
    • num_of_writes_5min
    • num_of_reads_5min
    • num_of_deletes_5min

Total Number of Objects and Total Size of Objects

  • num_of_active_objects
  • total_objects
  • total_size_of_active_objects
  • total_size

Total Number of MQ Messages

  • num_of_replication_messages,
  • num_of_sync-vnode_messages,
  • num_of_rebalance_messages,
  • mq_num_of_msg_recovery_node
  • mq_num_of_msg_deletion_dir
  • mq_num_of_msg_async_deletion_dir
  • mq_num_of_msg_req_deletion_dir
  • mq_mdcr_num_of_msg_req_comp_metadata
  • mq_mdcr_num_of_msg_req_sync_obj

Note: The following items are available since LeoFS v1.4.0:

  • mq_num_of_msg_recovery_node
  • mq_num_of_msg_deletion_dir
  • mq_num_of_msg_async_deletion_dir
  • mq_num_of_msg_req_deletion_dir
  • mq_mdcr_num_of_msg_req_comp_metadata
  • mq_mdcr_num_of_msg_req_sync_obj

Data Compaction

  • comp_state
  • comp_last_start_datetime
  • comp_last_end_datetime
  • comp_num_of_pending_targets
  • comp_num_of_ongoing_targets
  • comp_num_of_out_of_targets

Note: The all items are available since LeoFS v1.4.0.

Statistics specific to the internals of LeoGateway

Erlang VM

  • 1 min Statistics
    • num_of_processes
    • total_memory_usage
    • system_memory_usage
    • processes_memory_usage
    • ets_memory_usage
    • used_allocated_memory
    • allocated_memory
  • 5 min Statistics
    • num_of_processes_5min
    • total_memory_usage_5min
    • system_memory_usage_5min
    • processes_memory_usage_5min
    • ets_memory_usage_5min
    • used_allocated_memory_5min
    • allocated_memory_5min

Total Number of Requests

  • 1 min Statistics
    • num_of_writes
    • num_of_reads
    • num_of_deletes
  • 5 min Statistics
    • num_of_writes_5min
    • num_of_reads_5min
    • num_of_deletes_5min

Object Cache

  • count_of_cache-hit
  • count_of_cache-miss
  • total_of_files
  • total_cached_size

Tags:

All measurements have the following tags:

  • node

Example output:

LeoManager

$ ./telegraf --config ./plugins/inputs/leofs/leo_manager.conf --input-filter leofs --test
> leofs, host=manager_0, node=manager_0@127.0.0.1
  allocated_memory=78255445,
  allocated_memory_5min=78159025,
  ets_memory_usage=4611900,
  ets_memory_usage_5min=4632599,
  num_of_processes=223,
  num_of_processes_5min=223,
  processes_memory_usage=20201316,
  processes_memory_usage_5min=20186559,
  system_memory_usage=37172701,
  system_memory_usage_5min=37189213,
  total_memory_usage=57373373,
  total_memory_usage_5min=57374653,
  used_allocated_memory=67,
  used_allocated_memory_5min=67
  1524105758000000000

LeoStorage

$ ./telegraf --config ./plugins/inputs/leofs/leo_storage.conf --input-filter leofs --test
> leofs,host=storage_0,node=storage_0@127.0.0.1
  allocated_memory=63504384,
  allocated_memory_5min=0,
  comp_last_end_datetime=0,
  comp_last_start_datetime=0,
  comp_num_of_ongoing_targets=0,
  comp_num_of_out_of_targets=0,
  comp_num_of_pending_targets=8,
  comp_state=0,
  ets_memory_usage=3877824,
  ets_memory_usage_5min=0,
  mq_mdcr_num_of_msg_req_comp_metadata=0,
  mq_mdcr_num_of_msg_req_sync_obj=0,
  mq_num_of_msg_async_deletion_dir=0,
  mq_num_of_msg_deletion_dir=0,
  mq_num_of_msg_recovery_node=0,
  mq_num_of_msg_req_deletion_dir=0,
  num_of_active_objects=70,
  num_of_deletes=0,
  num_of_deletes_5min=0,
  num_of_processes=577,
  num_of_processes_5min=0,
  num_of_reads=1,
  num_of_reads_5min=0,
  num_of_rebalance_messages=0,
  num_of_replication_messages=0,
  num_of_sync-vnode_messages=0,
  num_of_writes=70,
  num_of_writes_5min=0,
  processes_memory_usage=20029464,
  processes_memory_usage_5min=0,
  system_memory_usage=25900472,
  system_memory_usage_5min=0,
  total_memory_usage=45920987,
  total_memory_usage_5min=0,
  total_objects=70,
  total_size=2,
  total_size_of_active_objects=2,
  used_allocated_memory=69,
  used_allocated_memory_5min=0
  1524529826000000000

LeoGateway

$ ./telegraf --config ./plugins/inputs/leofs/leo_gateway.conf --input-filter leofs --test
> leofs, host=gateway_0, node=gateway_0@127.0.0.1
  allocated_memory=87941120,
  allocated_memory_5min=88067672,
  count_of_cache-hit=0,
  count_of_cache-miss=0,
  ets_memory_usage=4843497,
  ets_memory_usage_5min=4841574,
  num_of_deletes=0,
  num_of_deletes_5min=0,
  num_of_processes=555,
  num_of_processes_5min=555,
  num_of_reads=0,
  num_of_reads_5min=0,
  num_of_writes=0,
  num_of_writes_5min=0,
  processes_memory_usage=17388052,
  processes_memory_usage_5min=17413928,
  system_memory_usage=49531263,
  system_memory_usage_5min=49577819,
  total_cached_size=0,
  total_memory_usage=66917393,
  total_memory_usage_5min=66989469,
  total_of_files=0,
  used_allocated_memory=69,
  used_allocated_memory_5min=69 1524105894000000000