fpolicy server dashboard

[T1r0l]

is it possible to make a fpolicy dashboard to see for example the fpolicy server latency and so on.

see ontap statistics:
statistics start -object fpolicy -sample-id vserver
statistics start -object fpolicy_policy -sample-id policy
statistics start -object fpolicy_server -sample-id server

statistics show -sample-id vserver
statistics show -sample-id policy
statistics show -sample-id server

thank you

[rahulguptajss]

@T1r0l Could you share which specific counters you are interested in for these objects? I have listed them below for your reference.

statistics catalog counter show -object fpolicy -counter ?
  aborted_requests                        
  cifs_requests                           
  event_count                             
  failedop_notifications                  
  file_generated_during_outage            
  instance_name                           
  instance_uuid                           
  io_processing_latency                   
  io_processing_latency_base              
  io_processing_latency_hist              
  io_thread_wait_latency                  
  io_thread_wait_latency_base             
  io_thread_wait_latency_hist             
  max_io_processing_latency               
  max_io_thread_wait_latency              
  max_outage_duration                     
  max_outstanding_requests                
  max_outstanding_requests_during_outage  
  max_policy_processing_latency           
  max_policy_thread_wait_latency          
  max_request_latency                     
  max_response_processing_latency         
  max_response_thread_wait_latency        
  nfs_requests                            
  node_name                               
  node_uuid                               
  outstanding_requests                    
  outstanding_requests_during_outage      
  policy_processing_latency               
  policy_processing_latency_base          
  policy_processing_latency_hist          
  policy_thread_wait_latency              
  policy_thread_wait_latency_base         
  policy_thread_wait_latency_hist         
  process_name                            
  processed_requests                      
  processed_requests_during_outage        
  request_latency                         
  request_latency_base                    
  request_latency_hist                    
  requests_dispatched_rate                
  requests_dropped_during_outage          
  requests_received_rate                  
  requests_write_failed_during_outage     
  response_processing_latency             
  response_processing_latency_base        
  response_processing_latency_hist        
  response_thread_wait_latency            
  response_thread_wait_latency_base       
  response_thread_wait_latency_hist       
  total_requests_dropped_during_outage    
  volops_notifications                   

statistics catalog counter show -object fpolicy_policy -counter ?
  aborted_requests                        
  atomic_write_latency_hist               
  atomic_write_request_latency            
  denied_requests                         
  event_count                             
  file_generated_during_outage            
  instance_name                           
  instance_uuid                           
  io_processing_latency                   
  io_processing_latency_base              
  io_processing_latency_hist              
  io_thread_wait_latency                  
  io_thread_wait_latency_base             
  io_thread_wait_latency_hist             
  mandatory_attr_processed_requests       
  max_atomic_write_latency_during_outage  
  max_io_processing_latency               
  max_io_thread_wait_latency              
  max_outage_duration                     
  max_outstanding_requests                
  max_outstanding_requests_during_outage  
  max_policy_processing_latency           
  max_policy_thread_wait_latency          
  max_request_latency                     
  max_requests_waiting_for_send           
  max_response_processing_latency         
  max_response_thread_wait_latency        
  max_throttled_requests                  
  node_name                               
  node_uuid                               
  outstanding_requests                    
  outstanding_requests_during_outage      
  policy_processing_latency               
  policy_processing_latency_base          
  policy_processing_latency_hist          
  policy_thread_wait_latency              
  policy_thread_wait_latency_base         
  policy_thread_wait_latency_hist         
  process_name                            
  processed_requests                      
  processed_requests_during_outage        
  request_latency                         
  request_latency_base                    
  request_latency_hist                    
  requests_dropped_during_outage          
  requests_waiting_for_send               
  requests_write_failed_during_outage     
  response_processing_latency             
  response_processing_latency_base        
  response_processing_latency_hist        
  response_thread_wait_latency            
  response_thread_wait_latency_base       
  response_thread_wait_latency_hist       
  throttled_requests                      
  total_requests_dropped_during_outage    
  volops_notifications                    
  write_latency_base              

statistics catalog counter show -object fpolicy_server -counter ?
  cancelled_offline_read_requests        
  cancelled_requests                     
  error_eagain_on_partial_write          
  error_eagain_on_recv                   
  error_eagain_on_send                   
  failed_requests                        
  instance_name                          
  instance_uuid                          
  max_outstanding_offline_read_requests  
  max_outstanding_requests               
  max_request_latency                    
  max_server_back_pressure_duration      
  node_name                              
  node_uuid                              
  offline_read_request_latency_hist      
  offline_read_requests                  
  outstanding_offline_read_requests      
  outstanding_requests                   
  process_name                           
  processed_requests                     
  reject_status_response                 
  request_latency                        
  request_latency_base                   
  request_latency_hist                   
  request_sent_rate                      
  response_received_rate                 
  secs_since_last_completion             
  secs_since_throttle                    
  select_success_on_eagain               
  select_timeout_on_eagain               
  server_back_pressure                   
  server_connection_broken               
  status_requests 

[rahulguptajss]

Discord discussion here

[T1r0l]

@rahulguptajss, sorry for delay!

I think these counters would be very useful:

Object: fpolicy
Counter Description
--------------------------- ----------------------------------------------
aborted_requests Number of screen requests aborted
cifs_requests Number of cifs screen requests sent to fpolicy server
failedop_notifications Number of failed file operation notifications sent to fpolicy server
instance_name Name of the Vserver
io_processing_latency Average IO processing latency for screen request
io_thread_wait_latency Average IO thread wait latency for screen request

Object: fpolicy_policy
Counter Value
-------------------------------- --------------------------------
aborted_requests Number of screen requests aborted
denied_requests Number of screen requests for which deny is received from fpolicy server
instance_name Name of the policy
io_processing_latency Average IO processing latency for screen request
io_thread_wait_latency Average IO thread wait latency for the screen request
policy_processing_latency Average policy processing latency for screen request
processed_requests Number of screen requests went through fpolicy processing

Object: fpolicy_server
Counter Description
--------------------------- ----------------------------------------------
cancelled_requests Number of screen requests whose processing was cancelled (cancel timeout)
failed_requests Number of screen requests the node failed to send to fpolicy server
instance_name IP Address of the fpolicy server
max_request_latency Maximum latency for a screen request
outstanding_requests Total number of screen requests waiting for response
processed_requests Total number of screen requests processed(sync and async)
request_latency Average latency for screen request

if you find anything else useful, please add!

thank you so much!

[cgrinds]

roller replied in Discord to say that either the ZapiPerf or StatPerf collector would work for them

[rahulguptajss]

@T1r0l FPolicy dashboard is available in nightly build if you want to give it a try and let us know how it works for you.