show statistics am-measurer

If you execute show statistics with the am-measurer process as the argument, information similar to the am-scheduler output will be displayed, divided into individual groups per USTAT.

In addition to rolling average probe rates, the display will contain some CNA-internal statistics, including time spent in internal queues, time spent polling, and thread pool size, as well as the times since the last restart, reconfiguration, or clearing of the am-measurer process.

The display also contains a list of error counters per USTAT.

The following display shows part of the output for a single USTAT; if you use the all keyword, the output will contain similar tables for each USTAT:

 
ssf-neat-5008# show stat am-measurer                  Thu Dec 11 14:01:41 PST 2003
 
module 4: OK
 
Restart Time : 1071018678368 ms, 2003/12/09 17:11:18.368, 1d20h50m22s624ms ago
 
Clear Time   : 1071018678389 ms, 2003/12/09 17:11:18.389, 1d20h50m22s603ms ago
 
Debug Mode   : off
 
Normal Events (per minute)
 
name             total-count    1-min    5-min   60-min     peak peak age
 
Req Received        26147178    10058    10040     9661    29859 1d05:24:06
 
Valid Requests      26147178    10058    10040     9661    29859 1d05:24:06
 
TCP Requests           60801       10       22       22       45 0d05:26:55
 
ICMP Requests       26086377    10048    10018     9638    29850 1d05:24:08
 
TracePrb Req               0        0        0        0        0 1d20:50:22
 
Attempts            26146867    10060    10035     9660    29971 1d05:24:12
 
TCP Probes             51245        8       18       18       37 1d05:25:16
 
ICMP Probes         11354039     4375     4367     4368    13546 1d04:23:50
 
TracePngs                  0        0        0        0        0 1d20:50:22
 
TracePng In Prg            0        0        0        0        0 1d20:50:22
 
TraceRts                   0        0        0        0        0 1d20:50:22
 
TraceRt In Prg             0        0        0        0        0 1d20:50:22
 
Tot TracePrb               0        0        0        0        0 1d20:50:22
 
Error Events (per minute)
 
name             total-count    1-min    5-min   60-min     peak peak age
 
Interrupted Rcv            0        0        0        0        0 1d20:50:22
 
Bad Send Addr              0        0        0        0        0 1d20:50:22
 
Runt Req Packet            0        0        0        0        0 1d20:50:22
 
Bad Target Type            0        0        0        0        0 1d20:50:22
 
Job Queue Full             0        0        0        0        0 1d20:50:22
 
Queue Timeouts             0        0        0        0        0 1d20:50:22
 
Bad Result Type            0        0        0        0        0 1d20:50:22
 
Bad Result Code            0        0        0        0        0 1d20:50:22
 
TCP Timeout             5394        0        2        2        5 0d14:56:30
 
TCP Probe Err           4161        1        1        1        4 0d06:00:49
 
ICMP Timeout        14139853     5469     5436     5067    16282 1d05:24:42
 
ICMP Probe Err        592175      207      210      202      694 1d03:58:56
 
TracePrb T-Out             0        0        0        0        0 1d20:50:22
 
TracePrb Errors            0        0        0        0        0 1d20:50:22
 
RTT Range Err              0        0        0        0        0 1d20:50:22
 
Response Errors            0        0        0        0        0 1d20:50:22
 
Times (in microseconds)
 
name               1-min    5-min   60-min     peak peak age
 
Queue Time             0       19        3     1402 0d21:38:11
 
Run Time             172      173      168      351 1d00:34:01
 
TCP Netwk Time     68765    57891    61821   481343 0d00:40:37
 
ICMP Netwk Time   166726   172476   173563   393642 1d04:52:54
 
TracePng Time          0        0        0        0 1d20:50:22
 
TraceRt Time           0        0        0        0 1d20:50:22
 
TracePrb Time          0        0        0        0 1d20:50:22
 
Other
 
name               1-min    5-min   60-min     peak peak age
 
TCP Pool               0        0        0        4 1d02:13:05
 
ICMP Pool            285      285      266      852 1d05:24:44
 
TraceRt Pool           0        0        0        0 1d20:50:22
 
TracePng Pool          0        0        0        0 1d20:50:22
 
TCP Q Size             0        0        0        0 1d20:50:22
 
ICMP Q Size            0        0        0        0 1d20:50:22
 
TraceRt Q Size         0        0        0        0 1d20:50:22
 
TracePng Q Size        0        0        0        0 1d20:50:22
 
Error Counts
 
Error Name                                                  Count Since Update
 
Network is unreachable                                       6192 0d00:00:35
 
Connection timed out                                     14145247 0d00:00:01
 
Connection refused                                          17133 0d00:00:08
 
No route to host                                           230024 0d00:00:02
 
Traceroutes Underway
 
From VIP        To Target
 
ssf-neat-5008# show active-measurements range-address 4.2.0.0/16
 
Thu Dec 11 14:04:59 PST 2003
 
Summary
 
Rows       Total Timing Out  Net Unrch Host Unrch       Wait   Recovery
 
Shown         21         12          0          0          0          0
 
Found         21         12          0          0          0          0
 
Measurement Results
 
'unk' means no mapped slot number
 
Probing: normal = ., timing out = t, net unreachable = n, host unreachable = h,
 
wait = w, recovery = r
 
Failure Suppression: no failures = ., recent failure = f, suppressed = s,
 
unmeasured = u
 
Errors: DNS = d, Queue Drop = q, Probe Timeout = t, Network Unreachable = n,
 
Host Unreachable = h, Port Unreachable = p, Other = o
 
PS Group   Target          Address         Type Ustat (Slot)     Success Errors
 
tu top-n-e (EFC)           4.2.143.75      icmp 4 (4)                  0 203t
 
tu top-n-e (EFC)           4.2.143.75      icmp 5 (5)                  0 201t
 
tu top-n-e (EFC)           4.2.143.75      icmp 6 (6)                  0 204t,1o
 
tu top-n-e (EFC)           4.2.143.76      icmp 4 (4)                  0 202t
 
tu top-n-e (EFC)           4.2.143.76      icmp 5 (5)                  0 204t
 

• Restart Time values refer to the most recent restart of the am-measurer process.
• Clear Time values refer to the most recent execution of the clear active-measurements command.

The “Normal Events (per minute)” block shows rolling averages of per-minute rates of probes sent. The 1-min column shows average probes per minute during the previous 60 seconds; the 5-min column shows average per-minute rate during the previous five minutes, and the 60-min column shows average per-minute rate during the previous hour.

• Req Rcvd and Valid Req values represent packet arrivals from the am-scheduler process. Under normal circumstances they should be identical, and equal to the sum of TCP and ICMP requests. Arriving packets are transferred to a job queue to await processing.
• The Attempts values refer to the number of packets removed from the queue and processed, regardless of outcome.
• The TCP Probes and ICMP Probes values refer to probes that were successfully sent and for which reply packets were received. Differences between TCP Req and TCP Probes, and between ICMP Req and ICMP Probes, are indicators that your active probes are not finding their targets, or targets are not replying, or the reply packets are not getting back to the CNA system.
• TracePngs is the number of trace-ping operations per minute.
• TracePng In Prg represents the number of trace-ping requests dropped because a traceroute to that target was already underway.
• Tracerts is number of traceroute operations per minute
• TraceRt In Prg is number of traceroute requests dropped because a traceroute to that target was already underway.
• Tot TracePrb is number of traceprobe measurements per minute, including both traceroute and trace-ping.

The block that shows “Error Events (per minute)” has the following items:

Interrupted Receives shows the number of times a probe request from the am-scheduler process was interrupted.

Bad Send Addresses represents an internal addressing error.

Runt Request Packets counts the number request packets received from the am-scheduler process that were shorter than the minimum size for the type of packet. This should be an extremely rare event, possibly caused by a hardware problem.

Bad Target Type means the probe was not configured for either TCP or ICMP. This is a fail-safe counter. Since the CNA CLI will not allow you to enter a probe with any other type, this counter should never increment.

Job Queue Full and Queue Timeouts counters refer to an internal queue of probes received from the am-scheduler process and awaiting processing by the am-measurer process. High numbers in either of these counters means your probes are timing out--taking too long to complete, which causes the am-measurer process to cancel the request and move on to the next.

Invalid Result Target Type and Bad Result Code represent internal errors. Under normal circumstances, you should not see values for these items.

TCP Timeout shows the number of TCP-type probes that were sent but for which the targets did not respond.

TCP Probe Err counts the number of TCP protocol errors encountered.

ICMP Timeout shows the number of ICMP-type probes that were sent but for which the targets did not respond.

ICMP Probe Err counts the number ICMP protocol errors encountered.

TracePrb T-out shows the number of traceroute-type probes that were sent but for which the targets did not respond.

TracePrb Err counts the number traceroute errors encountered.

RTT Range Err counts the number of times a measure round trip time yielded incorrect results (e.g., a negative number, or greater than the timeout value). This could indicate a network time problem.

The next table, “Times (in microseconds)”, in the show command output shows rolling averages of such things as time spent in the job queue and size of the job queue and thread pool:

The information in this table is primarily of value when investigating CNA-related questions rather than active-probe configuration problems.

The last section, “Traceroutes Underway”, shows which traceroutes the am-measurer process is currently running.