Rabbit holes and "This is fine" situation.

[careaper]

Having issues with pulse monitoring my standalone proxmox node. Looking for some guidance.
I have 10 x 2TB, SATA HDDs for my ZFS pool. They are connected to their own HBA, Serial Attached SCSI controller: Broadcom / LSI SAS3224 PCI-Express Fusion-MPT SAS-3 (rev 01).

Prior versions of pulse would monitor these just fine. Now it is hitting a timeout or something just getting the list of disks.

I am guilty of spending lots of time with AI, trying different things, with no joy.

Pulse is running in a docker container on a Raspberry pi 5, using a USB 3.0 external SSD. Not the best, but what I got for now. It runs pretty decent and snappy.

Running smartctl commands pulling temps from CLI runs about 3 seconds on average.

Previously pulse was running on a VM on my node, but that doesn't make too much sense, does it LOL.

Any insight or guidance is very much appreciated. Is there a way to increase the timeout. I don't mind if the disks are monitored every 30 minutes even. I tried changing the poll settings as well as the smart poll frequency, with no help.

Closest I got was it getting half way through listing some of the details of the disks, if that helps.

I am on 6.1.2 - yes I removed all of the old agents and proxys. I have started over a few times already just to be sure.

context deadline exceeded (Client.Timeout exceeded while awaiting headers)","component":"pulse","time":"2026-08-06T22:13:20-04:00","message":"Failed to get disk list"}

Yes my disks are hot! Working on some modifications of the case.

/dev/sda: 60
/dev/sdb: 63
/dev/sdc: 58
/dev/sdd: 64
/dev/sde: 64
/dev/sdf: 64
/dev/sdg: 57
/dev/sdh: 59
/dev/sdi: 62
/dev/sdj: 56

real 0m4.117s
user 0m0.160s
sys 0m0.061s

This is what I see in Physical Disks on pulse web ui:

Unknown
Health state is not reported.

Serial number is unexpectedly missing: disk serial was not reported

Temperature is temporarily unavailable: SMART probe returned no usable temperature data

Thanks,
Rob

[FabienD74]

Hi ,
I also have a proxmox with multiple HDD ( Toshiba) connected to a very old SAS controller (Chinese one i guess from Amazon) that i flashed a long time ago to be HBA mode.
It is currently seen using lspci as:

10:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)

I'm not running any "Pulse agent" on it to keep it small/nice/clean/secured

if i run lsblk -o NAME,SIZE,MODEL,SERIAL,LABEL,UUID,PARTLABEL,PARTUUID i have this:

05:09:25 root@proxmox1 ~$ lsblk -o NAME,SIZE,MODEL,SERIAL,LABEL,UUID,PARTLABEL,PARTUUID
NAME          SIZE MODEL                   SERIAL         LABEL      UUID                                 PARTLABEL                    PARTUUID
sda           7.3T TOSHIBA HDWG480         91Q0A0C4FA3H                                                                                
|-sda1        3.6T                                        raid_data1 9979945688815883149                  D01P01                       0e8dffd6-9ef3-7747-91e5-3dafcc2ae368
`-sda2        1.8T                                        raid_data2 14418553243075537090                 D01P02                       69f84503-fff7-9340-a27f-bc3a5bf8afe2
sdb           5.5T TOSHIBA HDWG460         91W0A09GFA4H                                                                                
|-sdb1        3.6T                                        raid_data1 9979945688815883149                  D04P01                       6d327013-b14d-3d48-9fd0-b1eedf4c555c
`-sdb2        1.8T                                        raid_data2 14418553243075537090                 D04P02                       e5e263b9-5744-c64d-9f54-d90b68e5b376
sdc           7.3T TOSHIBA HDWG480         93G0A0R7FA3H                                                                                
|-sdc1        3.6T                                        raid_data1 9979945688815883149                  D06P01                       fbf895f5-ab44-f84d-959e-15dffa52c3e3
`-sdc2        1.8T                                        raid_data2 14418553243075537090                 D06P02                       082572db-e2c6-1d46-b6ee-d47174e0669a
sdd           7.3T TOSHIBA HDWG480         93H0A0EPFA3H                                                                                
|-sdd1        3.6T                                        raid_data1 9979945688815883149                  D07P01                       b0132246-9677-d64f-9b84-f6850f4a4423
`-sdd2        1.8T                                        raid_data2 14418553243075537090                 D07P02                       8bf882b0-2c90-fd47-aad4-9506ca87592f
sde           5.5T TOSHIBA HDWG460         Z130A01HFA4H                                                                                
|-sde1        3.6T                                        raid_data1 9979945688815883149                  D05P01                       dd3e5f18-5bb6-9841-9611-e1004bc43ac8
`-sde2        1.8T                                        raid_data2 14418553243075537090                 D05P02                       78aea110-a80d-7b49-8b48-e9d6f3a32f80

I would like to know how you've got the list of temperatures and the timings. Could you share ?

If i can help...
I wish i could execute pulse-agent manually without having to install it an run extra/unknown scripts... ;-)

[FabienD74]

your temperatures are way too high....
I started the proxmox and executed a scrub.
using hddtemp :

06:16:47 root@proxmox1 ~$ uptime ; hddtemp /dev/sd[a-z] ; zpool status raid_data1  -LP
 06:17:12 up  1:19,  2 users,  load average: 2.11, 2.29, 2.33
/dev/sda: TOSHIBA HDWG480: 26 C
/dev/sdb: TOSHIBA HDWG460: 26 C
/dev/sdc: TOSHIBA HDWG480: 27 C
/dev/sdd: TOSHIBA HDWG480: 27 C
/dev/sde: TOSHIBA HDWG460: 25 C
/dev/sdf: USB3.0 Super Speed: S.M.A.R.T. not available
  pool: raid_data1
 state: ONLINE
  scan: scrub in progress since Fri Aug  7 05:37:09 2026
        5.25T / 7.29T scanned at 2.24G/s, 2.38T / 7.29T issued at 1.02G/s
        0B repaired, 32.70% done, 01:22:24 to go
config:

        NAME           STATE     READ WRITE CKSUM
        raid_data1     ONLINE       0     0     0
          raidz1-0     ONLINE       0     0     0
            /dev/sda1  ONLINE       0     0     0
            /dev/sdb1  ONLINE       0     0     0
            /dev/sde1  ONLINE       0     0     0
            /dev/sdc1  ONLINE       0     0     0
            /dev/sdd1  ONLINE       0     0     0

errors: No known data errors

[careaper]

I know the disks are too hot. You should have seen them before! hitting 90 C, they did not last long. Was changing one out, once a week or so LOL. One of the unintended side effects of cramming 2, 5 bay disk modules into a gaming case, I affectionately call nibbler.

I need to swap out my 5 bay modules as the fans have died. They are old! Just FYI, this system was built using mostly discarded parts.

I have a box of spare disks for now. LOL

my zpool appears to be fine though. I can run a scrub and see if anything pops up. But that should not effect the smartctl scans that pulse does right?

Checking temps manually is not the issue. Only pulse fails. I tried also to configure a wrapper for smartctl to get it to pull data more quickly. That did not help.

For temps. I use:

for dev in {a..j}; do echo -n "/dev/sd$dev: "; smartctl -A /dev/sd$dev | grep -i Temperature | awk '{print $10}'; done

To time commands, just put "time" in front of the command.

time for dev in {a..j}; do echo -n "/dev/sd$dev: "; smartctl -A /dev/sd$dev | grep -i Temperature | awk '{print $10}'; done

[pulse-triage[bot]]

The three messages together point at the probe rather than the disks. The agent asks smartctl --scan how to address each device, and behind a SAS HBA SATA drives commonly enumerate as -d scsi. Probed that way a SATA drive returns none of the ATA data your manual run gets through automatic sat detection, which would take out health, serial and temperature in one go. The agent also adds a standby guard on rotational disks that some SAS topologies answer incorrectly.

Outputs from the Proxmox node that would pin it:

smartctl --scan
lsblk -d -o NAME,TRAN,TYPE,ROTA
smartctl -d sat -i -A -H --json=o /dev/sda | head -50

plus the agent version Pulse shows for that host and any smart related lines from its agent log.

_{Posted by an automated triage run. rcourtman reviews everything it does. See the AI transparency statement.}

[careaper]

Seems to be correct. So how do I ask the pulse agent to probe the disks, so it gets the data? Or do I have it wrong, and the data is obtained with the API connection?

 smartctl --scan
/dev/sda -d scsi # /dev/sda, SCSI device
/dev/sdb -d scsi # /dev/sdb, SCSI device
/dev/sdc -d scsi # /dev/sdc, SCSI device
/dev/sdd -d scsi # /dev/sdd, SCSI device
/dev/sde -d scsi # /dev/sde, SCSI device
/dev/sdf -d scsi # /dev/sdf, SCSI device
/dev/sdg -d scsi # /dev/sdg, SCSI device
/dev/sdh -d scsi # /dev/sdh, SCSI device
/dev/sdi -d scsi # /dev/sdi, SCSI device
/dev/sdj -d scsi # /dev/sdj, SCSI device
/dev/sdk -d scsi # /dev/sdk, SCSI device
/dev/sdl -d scsi # /dev/sdl, SCSI device

lsblk -d -o NAME,TRAN,TYPE,ROTA
NAME  TRAN   TYPE ROTA
sda   sas    disk    1
sdb   sas    disk    1
sdc   sas    disk    1
sdd   sas    disk    1
sde   sas    disk    1
sdf   sas    disk    1
sdg   sas    disk    1
sdh   sas    disk    1
sdi   sas    disk    1
sdj   sas    disk    1
sdk   sata   disk    0
sdl   sata   disk    0
sdm   usb    disk    1
zd0          disk    0
zd16         disk    0
zd32         disk    0
zd48         disk    0
zd64         disk    0
zd80         disk    0
zd96         disk    0
zd112        disk    0

smartctl -d sat -i -A -H --json=o /dev/sda | head -50
{
  "json_format_version": [
    1,
    0
  ],
  "smartctl": {
    "version": [
      7,
      5
    ],
    "pre_release": false,
    "svn_revision": "5714",
    "platform_info": "x86_64-linux-7.0.14-11-pve",
    "build_info": "(local build)",
    "argv": [
      "smartctl",
      "-d",
      "sat",
      "-i",
      "-A",
      "-H",
      "--json=o",
      "/dev/sda"
    ],
    "output": [
      "smartctl 7.5 2025-04-30 r5714 [x86_64-linux-7.0.14-11-pve] (local build)",
      "Copyright (C) 2002-25, Bruce Allen, Christian Franke, www.smartmontools.org",
      "",
      "=== START OF INFORMATION SECTION ===",
      "Model Family:     Hitachi Ultrastar A7K2000",
      "Device Model:     Hitachi HUA722020ALA330",
      "Serial Number:    JK11A1YAJNX41V",
      "LU WWN Device Id: 5 000cca 221e5b007",
      "Firmware Version: JKAOA3EA",
      "User Capacity:    2,000,398,934,016 bytes [2.00 TB]",
      "Sector Size:      512 bytes logical/physical",
      "Rotation Rate:    7200 rpm",
      "Form Factor:      3.5 inches",
      "Device is:        In smartctl database 7.5/5706",
      "ATA Version is:   ATA8-ACS T13/1699-D revision 4",
      "SATA Version is:  SATA 2.6, 3.0 Gb/s",
      "Local Time is:    Sat Aug  8 13:10:55 2026 EDT",
      "SMART support is: Available - device has SMART capability.",
      "SMART support is: Enabled",
      "",
      "=== START OF READ SMART DATA SECTION ===",
      "SMART overall-health self-assessment test result: PASSED",
      "",
      "SMART Attributes Data Structure revision number: 16",
      "Vendor Specific SMART Attributes with Thresholds:",

[rcourtman]

The SMART identity, health, and temperature values come from the Unified Agent on the Proxmox host; they are not supplied by the PVE API disk-list request.

Current v6.2.1 automatically handles the exact SAT-behind-SAS shape shown here. Commit 25b2df0 makes the agent treat a disk whose SCSI-layer vendor is ATA as SATA even when the HBA exposes a SAS address, so it retains the -d sat probe instead of trusting the smartctl --scan -d scsi hint. There is no manual probe override to configure.

Because this was reported on v6.1.2, which should already contain that change, please post:

/usr/local/bin/pulse-agent --version
cat /sys/block/sda/device/vendor
journalctl -u pulse-agent --no-pager -n 300 | grep -iE 'smart|sda|sat|scsi' | tail -80

If the agent is older than v6.2.1, update it first and repeat the last command after one collection cycle. If it is current, those evidence lines will show whether this is a remaining probe-selection regression or a different collection failure.

The Failed to get disk list timeout is a separate PVE REST collection path. It can explain incomplete API inventory, but it does not prevent a working Unified Agent SMART report from supplying the disk telemetry.

[careaper]

I updated pulse, and started over removing the agent and the API tokens. Re-added nibbler as if pulse were a fresh installation.

I ran the commands requested:

root@nibbler:~# /usr/local/bin/pulse-agent --version
cat /sys/block/sda/device/vendor
journalctl -u pulse-agent --no-pager -n 300 | grep -iE 'smart|sda|sat|scsi' | tail -80
v6.2.1
ATA     
root@nibbler:~#

All of my disks show listed in the Physical Disks section, but unfortunately that is all I get:

Hitachi_HUA722020ALA330
/dev/sda
nibbler
PVE
S/N: JK11A1YAJNX41V
History:
Disk history range
Last 24 hours
Temperature is unsupported: Proxmox disk inventory does not expose temperature

Disk I/O is unsupported: Proxmox disk inventory does not expose physical-disk I/O counters

Controller association is unexpectedly missing: controller association was not reported

Infrastructure shows that nibbler is active for both API + Agent:

nibbler
API + Agent
Backups, Containers, Storage, VMs, Host telemetry
Active
29s ago
Manage

Pulse Agent Doctor report (2 agents; 2 healthy)

nibbler (nibbler)
Connection agent:b87d367d-cadb-420d-8c48-5e75613de081
Status Healthy
Reported agent v6.2.1
Supported target 6.2.1
Last seen 2026-08-11T11:57:14.502Z
Identity evidence

• Connection: agent:b87d367d-cadb-420d-8c48-5e75613de081
• Hostname: nibbler
• Platform: linux

nibbler (Host agent)
Connection agent:b87d367d-cadb-420d-8c48-5e75613de081-c75ff5bf
Status Healthy
Reported agent v6.2.1
Last seen 2026-08-11T11:57:14.502Z
Identity evidence

• Last updater check: 2026-08-11T11:19:45.223060428Z
• Machine identity: sha256:66cdf2ef1d4d163c
• Reported interface: 192.168.1.12/24
• Reported interface: 192.168.2.7/24
• Reported interface: fd1e:20e4:752d:9e80:3e7c:3fff:fe82:77d1/64
• Reported interface: fe80::3e7c:3fff:fe82:77d1/64

Please let me know if there is any more information that I can provide.

Thanks,
Rob

[pulse-triage[bot]]

Progress. The rows you pasted come from the PVE API inventory, which is now working, that is where the identity and serials come from. Temperature and health are enriched separately by the agent's smartctl collector, and that collector logs its probe decisions and failures only at debug level, so your empty journal grep does not tell us whether it ran clean or failed. That is the missing evidence.

Set the agent to debug for one collection cycle:

sudo systemctl edit pulse-agent

Add this drop-in, then save:

[Service]
Environment=LOG_LEVEL=debug

Then:

sudo systemctl daemon-reload
sudo systemctl restart pulse-agent
sleep 180
journalctl -u pulse-agent --no-pager --since "-5m" | grep -iE "smartctl|smart" | tail -60

Revert afterwards with sudo systemctl revert pulse-agent and a restart. Those lines show which probe type each disk was given and what smartctl returned, which pins whether the SAT-behind-SAS classification is still going wrong on your SAS3224 or the data is collected and then dropped later.

_{Posted by an automated triage run. rcourtman reviews everything it does. See the AI transparency statement.}

[careaper]

root@nibbler:~# systemctl restart pulse-agent
root@nibbler:~# sleep 180
journalctl -u pulse-agent --no-pager --since "-5m" | grep -iE "smartctl|smart" | tail -60
root@nibbler:~# journalctl -u pulse-agent --no-pager --since "-5m" | grep -iE "smartctl|smart" | tail -60
Aug 12 13:16:18 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sde","sizeBytes":2000398934016,"time":"2026-08-12T13:16:18-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:18 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdf","sizeBytes":2000398934016,"time":"2026-08-12T13:16:18-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:18 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdg","sizeBytes":2000398934016,"time":"2026-08-12T13:16:18-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:18 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdh","sizeBytes":2000398934016,"time":"2026-08-12T13:16:18-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:18 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdi","sizeBytes":2000398934016,"time":"2026-08-12T13:16:18-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:18 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdj","sizeBytes":2000398934016,"time":"2026-08-12T13:16:18-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:18 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdm","sizeBytes":8001389854720,"time":"2026-08-12T13:16:18-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:18 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"collect_local_complete","devices_discovered":13,"devices_collected":13,"time":"2026-08-12T13:16:18-04:00","message":"Completed SMART collection for local devices"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-0","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-1","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-10","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-2","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-3","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-4","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-5","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-6","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-7","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-8","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/dm-9","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/loop0","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/loop1","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/loop2","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/loop3","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/loop4","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/loop5","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/loop6","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/loop7","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/zd0","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/zd112","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/zd16","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/zd32","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/zd48","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/zd64","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/zd80","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_virtual_device","device":"/dev/zd96","reason":"virtual/logical device prefix","time":"2026-08-12T13:16:46-04:00","message":"Skipping non-physical device for SMART collection"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"collect_device_smart_success","device":"sdk [scsi]","type":"sata","model":"C400-MTFDDAC512MAM","temperature":0,"health":"PASSED","time":"2026-08-12T13:16:46-04:00","message":"collected SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"collect_device_smart_success","device":"sdl [scsi]","type":"sata","model":"OCZ-VERTEX4","temperature":0,"health":"PASSED","time":"2026-08-12T13:16:46-04:00","message":"collected SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sda [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sdb [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sdc [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sdd [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sde [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sdf [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sdg [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sdh [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sdi [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sdj [scsi]","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"skip_no_smart_data","device":"sdm","time":"2026-08-12T13:16:46-04:00","message":"Device returned no usable SMART data, skipping"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sda","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdb","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdc","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdd","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sde","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdf","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdg","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdh","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdi","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdj","sizeBytes":2000398934016,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"identity_only_disk","device":"sdm","sizeBytes":8001389854720,"time":"2026-08-12T13:16:46-04:00","message":"Reporting identity-only entry for physical disk without usable SMART data"}
Aug 12 13:16:46 nibbler pulse-agent[2868879]: {"level":"debug","component":"smartctl_collector","action":"collect_local_complete","devices_discovered":13,"devices_collected":13,"time":"2026-08-12T13:16:46-04:00","message":"Completed SMART collection for local devices"}

[pulse-triage[bot]]

That log narrows it. The two disks that collected are your SSDs, which the agent probes without its spin-up guard. All ten failures are the rotational disks behind the SAS3224, and every probe on those carries the guard, while your manual run that worked used -d sat without it. So the open question is what the guard's power-mode check does through this HBA's SAT translation.

Please run these two, they are the agent's exact invocations, and paste both outputs in full with the exit lines

smartctl -n standby,3 -i -A -H --json=o /dev/sda ; echo "exit=$?"
smartctl -d sat -n standby,3 -i -A -H --json=o /dev/sda ; echo "exit=$?"

That pins whether the guard aborts, the query comes back empty, or the data is there and the agent is mis-parsing it, and each of those is a different fix on my side.

_{Posted by an automated triage run. rcourtman reviews everything it does. See the AI transparency statement.}

[pulse-triage[bot]]

Root cause found without needing the outputs after all, though they are still worth running. smartmontools 7.5, which your host carries, started reporting the power state as a structured JSON object whenever the agent's spin-up guard is active, and the guard is applied exactly to rotational disks. The agent's parser expected the old shape, so the whole reading failed and every spinning disk degraded to "no usable SMART data" while your two SSDs, probed without the guard, kept working. Your log's rotational-only split is that bug precisely.

Fixed on main in a399351 and it lands in the next release, please retest on it. The two commands from my last comment still settle one remaining question, if they print exit=0 the release restores temperatures and health outright, and if they print exit=3 your HBA is also misreporting spinning disks as standby, which the fixed agent would then show as disks in standby, and that would be the next thing to chase.

_{Posted by an automated triage run. rcourtman reviews everything it does. See the AI transparency statement.}

[careaper]

root@nibbler:~# smartctl -n standby,3 -i -A -H --json=o /dev/sda ; echo "exit=$?"
{
  "json_format_version": [
    1,
    0
  ],
  "smartctl": {
    "version": [
      7,
      5
    ],
    "pre_release": false,
    "svn_revision": "5714",
    "platform_info": "x86_64-linux-7.0.14-11-pve",
    "build_info": "(local build)",
    "argv": [
      "smartctl",
      "-n",
      "standby,3",
      "-i",
      "-A",
      "-H",
      "--json=o",
      "/dev/sda"
    ],
    "output": [
      "smartctl 7.5 2025-04-30 r5714 [x86_64-linux-7.0.14-11-pve] (local build)",
      "Copyright (C) 2002-25, Bruce Allen, Christian Franke, www.smartmontools.org",
      "",
      "=== START OF INFORMATION SECTION ===",
      "Model Family:     Hitachi Ultrastar A7K2000",
      "Device Model:     Hitachi HUA722020ALA330",
      "Serial Number:    JK11A1YAJNX41V",
      "LU WWN Device Id: 5 000cca 221e5b007",
      "Firmware Version: JKAOA3EA",
      "User Capacity:    2,000,398,934,016 bytes [2.00 TB]",
      "Sector Size:      512 bytes logical/physical",
      "Rotation Rate:    7200 rpm",
      "Form Factor:      3.5 inches",
      "Device is:        In smartctl database 7.5/5706",
      "ATA Version is:   ATA8-ACS T13/1699-D revision 4",
      "SATA Version is:  SATA 2.6, 3.0 Gb/s",
      "Local Time is:    Thu Aug 13 09:24:18 2026 EDT",
      "SMART support is: Available - device has SMART capability.",
      "SMART support is: Enabled",
      "Power mode is:    ACTIVE or IDLE",
      "",
      "=== START OF READ SMART DATA SECTION ===",
      "SMART overall-health self-assessment test result: PASSED",
      "",
      "SMART Attributes Data Structure revision number: 16",
      "Vendor Specific SMART Attributes with Thresholds:",
      "ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE",
      "  1 Raw_Read_Error_Rate     0x000b   096   096   016    Pre-fail  Always       -       262148",
      "  2 Throughput_Performance  0x0005   132   132   054    Pre-fail  Offline      -       106",
      "  3 Spin_Up_Time            0x0007   115   115   024    Pre-fail  Always       -       631 (Average 627)",
      "  4 Start_Stop_Count        0x0012   100   100   000    Old_age   Always       -       141",
      "  5 Reallocated_Sector_Ct   0x0033   100   100   005    Pre-fail  Always       -       0",
      "  7 Seek_Error_Rate         0x000b   100   100   067    Pre-fail  Always       -       0",
      "  8 Seek_Time_Performance   0x0005   121   121   020    Pre-fail  Offline      -       35",
      "  9 Power_On_Hours          0x0012   091   091   000    Old_age   Always       -       63027",
      " 10 Spin_Retry_Count        0x0013   100   100   060    Pre-fail  Always       -       0",
      " 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       139",
      "192 Power-Off_Retract_Count 0x0032   099   099   000    Old_age   Always       -       2073",
      "193 Load_Cycle_Count        0x0012   099   099   000    Old_age   Always       -       2073",
      "194 Temperature_Celsius     0x0002   103   103   000    Old_age   Always       -       58 (Min/Max 16/88)",
      "196 Reallocated_Event_Count 0x0032   100   100   000    Old_age   Always       -       0",
      "197 Current_Pending_Sector  0x0022   100   100   000    Old_age   Always       -       0",
      "198 Offline_Uncorrectable   0x0008   100   100   000    Old_age   Offline      -       0",
      "199 UDMA_CRC_Error_Count    0x000a   200   200   000    Old_age   Always       -       0",
      ""
    ],
    "drive_database_version": {
      "string": "7.5/5706"
    },
    "exit_status": 0
  },
  "local_time": {
    "time_t": 1786627458,
    "asctime": "Thu Aug 13 09:24:18 2026 EDT"
  },
  "device": {
    "name": "/dev/sda",
    "info_name": "/dev/sda [SAT]",
    "type": "sat",
    "protocol": "ATA"
  },
  "power_mode": {
    "ata_value": 255,
    "name": "ACTIVE or IDLE"
  },
  "model_family": "Hitachi Ultrastar A7K2000",
  "model_name": "Hitachi HUA722020ALA330",
  "serial_number": "JK11A1YAJNX41V",
  "wwn": {
    "naa": 5,
    "oui": 3274,
    "id": 9158635527
  },
  "firmware_version": "JKAOA3EA",
  "user_capacity": {
    "blocks": 3907029168,
    "bytes": 2000398934016
  },
  "logical_block_size": 512,
  "physical_block_size": 512,
  "rotation_rate": 7200,
  "form_factor": {
    "ata_value": 2,
    "name": "3.5 inches"
  },
  "trim": {
    "supported": false
  },
  "in_smartctl_database": true,
  "ata_version": {
    "string": "ATA8-ACS T13/1699-D revision 4",
    "major_value": 508,
    "minor_value": 41
  },
  "sata_version": {
    "string": "SATA 2.6",
    "value": 31
  },
  "interface_speed": {
    "max": {
      "sata_value": 6,
      "string": "3.0 Gb/s",
      "units_per_second": 30,
      "bits_per_unit": 100000000
    }
  },
  "smart_support": {
    "available": true,
    "enabled": true
  },
  "smart_status": {
    "passed": true
  },
  "ata_smart_attributes": {
    "revision": 16,
    "table": [
      {
        "id": 1,
        "name": "Raw_Read_Error_Rate",
        "value": 96,
        "worst": 96,
        "thresh": 16,
        "when_failed": "",
        "flags": {
          "value": 11,
          "string": "PO-R-- ",
          "prefailure": true,
          "updated_online": true,
          "performance": false,
          "error_rate": true,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 262148,
          "string": "262148"
        }
      },
      {
        "id": 2,
        "name": "Throughput_Performance",
        "value": 132,
        "worst": 132,
        "thresh": 54,
        "when_failed": "",
        "flags": {
          "value": 5,
          "string": "P-S--- ",
          "prefailure": true,
          "updated_online": false,
          "performance": true,
          "error_rate": false,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 106,
          "string": "106"
        }
      },
      {
        "id": 3,
        "name": "Spin_Up_Time",
        "value": 115,
        "worst": 115,
        "thresh": 24,
        "when_failed": "",
        "flags": {
          "value": 7,
          "string": "POS--- ",
          "prefailure": true,
          "updated_online": true,
          "performance": true,
          "error_rate": false,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 55875666551,
          "string": "631 (Average 627)"
        }
      },
      {
        "id": 4,
        "name": "Start_Stop_Count",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 18,
          "string": "-O--C- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": false
        },
        "raw": {
          "value": 141,
          "string": "141"
        }
      },
      {
        "id": 5,
        "name": "Reallocated_Sector_Ct",
        "value": 100,
        "worst": 100,
        "thresh": 5,
        "when_failed": "",
        "flags": {
          "value": 51,
          "string": "PO--CK ",
          "prefailure": true,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": true
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 7,
        "name": "Seek_Error_Rate",
        "value": 100,
        "worst": 100,
        "thresh": 67,
        "when_failed": "",
        "flags": {
          "value": 11,
          "string": "PO-R-- ",
          "prefailure": true,
          "updated_online": true,
          "performance": false,
          "error_rate": true,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 8,
        "name": "Seek_Time_Performance",
        "value": 121,
        "worst": 121,
        "thresh": 20,
        "when_failed": "",
        "flags": {
          "value": 5,
          "string": "P-S--- ",
          "prefailure": true,
          "updated_online": false,
          "performance": true,
          "error_rate": false,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 35,
          "string": "35"
        }
      },
      {
        "id": 9,
        "name": "Power_On_Hours",
        "value": 91,
        "worst": 91,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 18,
          "string": "-O--C- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": false
        },
        "raw": {
          "value": 63027,
          "string": "63027"
        }
      },
      {
        "id": 10,
        "name": "Spin_Retry_Count",
        "value": 100,
        "worst": 100,
        "thresh": 60,
        "when_failed": "",
        "flags": {
          "value": 19,
          "string": "PO--C- ",
          "prefailure": true,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": false
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 12,
        "name": "Power_Cycle_Count",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 50,
          "string": "-O--CK ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": true
        },
        "raw": {
          "value": 139,
          "string": "139"
        }
      },
      {
        "id": 192,
        "name": "Power-Off_Retract_Count",
        "value": 99,
        "worst": 99,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 50,
          "string": "-O--CK ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": true
        },
        "raw": {
          "value": 2073,
          "string": "2073"
        }
      },
      {
        "id": 193,
        "name": "Load_Cycle_Count",
        "value": 99,
        "worst": 99,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 18,
          "string": "-O--C- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": false
        },
        "raw": {
          "value": 2073,
          "string": "2073"
        }
      },
      {
        "id": 194,
        "name": "Temperature_Celsius",
        "value": 103,
        "worst": 103,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 2,
          "string": "-O---- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 377958170682,
          "string": "58 (Min/Max 16/88)"
        }
      },
      {
        "id": 196,
        "name": "Reallocated_Event_Count",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 50,
          "string": "-O--CK ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": true
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 197,
        "name": "Current_Pending_Sector",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 34,
          "string": "-O---K ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": false,
          "auto_keep": true
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 198,
        "name": "Offline_Uncorrectable",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 8,
          "string": "---R-- ",
          "prefailure": false,
          "updated_online": false,
          "performance": false,
          "error_rate": true,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 199,
        "name": "UDMA_CRC_Error_Count",
        "value": 200,
        "worst": 200,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 10,
          "string": "-O-R-- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": true,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      }
    ]
  },
  "spare_available": {
    "current_percent": 100,
    "threshold_percent": 5
  },
  "power_on_time": {
    "hours": 63027
  },
  "power_cycle_count": 139,
  "temperature": {
    "current": 58
  }
}
exit=0

root@nibbler:~# smartctl -d sat -n standby,3 -i -A -H --json=o /dev/sda ; echo "exit=$?"
{
  "json_format_version": [
    1,
    0
  ],
  "smartctl": {
    "version": [
      7,
      5
    ],
    "pre_release": false,
    "svn_revision": "5714",
    "platform_info": "x86_64-linux-7.0.14-11-pve",
    "build_info": "(local build)",
    "argv": [
      "smartctl",
      "-d",
      "sat",
      "-n",
      "standby,3",
      "-i",
      "-A",
      "-H",
      "--json=o",
      "/dev/sda"
    ],
    "output": [
      "smartctl 7.5 2025-04-30 r5714 [x86_64-linux-7.0.14-11-pve] (local build)",
      "Copyright (C) 2002-25, Bruce Allen, Christian Franke, www.smartmontools.org",
      "",
      "=== START OF INFORMATION SECTION ===",
      "Model Family:     Hitachi Ultrastar A7K2000",
      "Device Model:     Hitachi HUA722020ALA330",
      "Serial Number:    JK11A1YAJNX41V",
      "LU WWN Device Id: 5 000cca 221e5b007",
      "Firmware Version: JKAOA3EA",
      "User Capacity:    2,000,398,934,016 bytes [2.00 TB]",
      "Sector Size:      512 bytes logical/physical",
      "Rotation Rate:    7200 rpm",
      "Form Factor:      3.5 inches",
      "Device is:        In smartctl database 7.5/5706",
      "ATA Version is:   ATA8-ACS T13/1699-D revision 4",
      "SATA Version is:  SATA 2.6, 3.0 Gb/s",
      "Local Time is:    Thu Aug 13 09:27:18 2026 EDT",
      "SMART support is: Available - device has SMART capability.",
      "SMART support is: Enabled",
      "Power mode is:    ACTIVE or IDLE",
      "",
      "=== START OF READ SMART DATA SECTION ===",
      "SMART overall-health self-assessment test result: PASSED",
      "",
      "SMART Attributes Data Structure revision number: 16",
      "Vendor Specific SMART Attributes with Thresholds:",
      "ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE",
      "  1 Raw_Read_Error_Rate     0x000b   096   096   016    Pre-fail  Always       -       262148",
      "  2 Throughput_Performance  0x0005   132   132   054    Pre-fail  Offline      -       106",
      "  3 Spin_Up_Time            0x0007   115   115   024    Pre-fail  Always       -       631 (Average 627)",
      "  4 Start_Stop_Count        0x0012   100   100   000    Old_age   Always       -       141",
      "  5 Reallocated_Sector_Ct   0x0033   100   100   005    Pre-fail  Always       -       0",
      "  7 Seek_Error_Rate         0x000b   100   100   067    Pre-fail  Always       -       0",
      "  8 Seek_Time_Performance   0x0005   121   121   020    Pre-fail  Offline      -       35",
      "  9 Power_On_Hours          0x0012   091   091   000    Old_age   Always       -       63027",
      " 10 Spin_Retry_Count        0x0013   100   100   060    Pre-fail  Always       -       0",
      " 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       139",
      "192 Power-Off_Retract_Count 0x0032   099   099   000    Old_age   Always       -       2073",
      "193 Load_Cycle_Count        0x0012   099   099   000    Old_age   Always       -       2073",
      "194 Temperature_Celsius     0x0002   103   103   000    Old_age   Always       -       58 (Min/Max 16/88)",
      "196 Reallocated_Event_Count 0x0032   100   100   000    Old_age   Always       -       0",
      "197 Current_Pending_Sector  0x0022   100   100   000    Old_age   Always       -       0",
      "198 Offline_Uncorrectable   0x0008   100   100   000    Old_age   Offline      -       0",
      "199 UDMA_CRC_Error_Count    0x000a   200   200   000    Old_age   Always       -       0",
      ""
    ],
    "drive_database_version": {
      "string": "7.5/5706"
    },
    "exit_status": 0
  },
  "local_time": {
    "time_t": 1786627638,
    "asctime": "Thu Aug 13 09:27:18 2026 EDT"
  },
  "device": {
    "name": "/dev/sda",
    "info_name": "/dev/sda [SAT]",
    "type": "sat",
    "protocol": "ATA"
  },
  "power_mode": {
    "ata_value": 255,
    "name": "ACTIVE or IDLE"
  },
  "model_family": "Hitachi Ultrastar A7K2000",
  "model_name": "Hitachi HUA722020ALA330",
  "serial_number": "JK11A1YAJNX41V",
  "wwn": {
    "naa": 5,
    "oui": 3274,
    "id": 9158635527
  },
  "firmware_version": "JKAOA3EA",
  "user_capacity": {
    "blocks": 3907029168,
    "bytes": 2000398934016
  },
  "logical_block_size": 512,
  "physical_block_size": 512,
  "rotation_rate": 7200,
  "form_factor": {
    "ata_value": 2,
    "name": "3.5 inches"
  },
  "trim": {
    "supported": false
  },
  "in_smartctl_database": true,
  "ata_version": {
    "string": "ATA8-ACS T13/1699-D revision 4",
    "major_value": 508,
    "minor_value": 41
  },
  "sata_version": {
    "string": "SATA 2.6",
    "value": 31
  },
  "interface_speed": {
    "max": {
      "sata_value": 6,
      "string": "3.0 Gb/s",
      "units_per_second": 30,
      "bits_per_unit": 100000000
    }
  },
  "smart_support": {
    "available": true,
    "enabled": true
  },
  "smart_status": {
    "passed": true
  },
  "ata_smart_attributes": {
    "revision": 16,
    "table": [
      {
        "id": 1,
        "name": "Raw_Read_Error_Rate",
        "value": 96,
        "worst": 96,
        "thresh": 16,
        "when_failed": "",
        "flags": {
          "value": 11,
          "string": "PO-R-- ",
          "prefailure": true,
          "updated_online": true,
          "performance": false,
          "error_rate": true,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 262148,
          "string": "262148"
        }
      },
      {
        "id": 2,
        "name": "Throughput_Performance",
        "value": 132,
        "worst": 132,
        "thresh": 54,
        "when_failed": "",
        "flags": {
          "value": 5,
          "string": "P-S--- ",
          "prefailure": true,
          "updated_online": false,
          "performance": true,
          "error_rate": false,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 106,
          "string": "106"
        }
      },
      {
        "id": 3,
        "name": "Spin_Up_Time",
        "value": 115,
        "worst": 115,
        "thresh": 24,
        "when_failed": "",
        "flags": {
          "value": 7,
          "string": "POS--- ",
          "prefailure": true,
          "updated_online": true,
          "performance": true,
          "error_rate": false,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 55875666551,
          "string": "631 (Average 627)"
        }
      },
      {
        "id": 4,
        "name": "Start_Stop_Count",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 18,
          "string": "-O--C- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": false
        },
        "raw": {
          "value": 141,
          "string": "141"
        }
      },
      {
        "id": 5,
        "name": "Reallocated_Sector_Ct",
        "value": 100,
        "worst": 100,
        "thresh": 5,
        "when_failed": "",
        "flags": {
          "value": 51,
          "string": "PO--CK ",
          "prefailure": true,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": true
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 7,
        "name": "Seek_Error_Rate",
        "value": 100,
        "worst": 100,
        "thresh": 67,
        "when_failed": "",
        "flags": {
          "value": 11,
          "string": "PO-R-- ",
          "prefailure": true,
          "updated_online": true,
          "performance": false,
          "error_rate": true,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 8,
        "name": "Seek_Time_Performance",
        "value": 121,
        "worst": 121,
        "thresh": 20,
        "when_failed": "",
        "flags": {
          "value": 5,
          "string": "P-S--- ",
          "prefailure": true,
          "updated_online": false,
          "performance": true,
          "error_rate": false,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 35,
          "string": "35"
        }
      },
      {
        "id": 9,
        "name": "Power_On_Hours",
        "value": 91,
        "worst": 91,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 18,
          "string": "-O--C- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": false
        },
        "raw": {
          "value": 63027,
          "string": "63027"
        }
      },
      {
        "id": 10,
        "name": "Spin_Retry_Count",
        "value": 100,
        "worst": 100,
        "thresh": 60,
        "when_failed": "",
        "flags": {
          "value": 19,
          "string": "PO--C- ",
          "prefailure": true,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": false
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 12,
        "name": "Power_Cycle_Count",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 50,
          "string": "-O--CK ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": true
        },
        "raw": {
          "value": 139,
          "string": "139"
        }
      },
      {
        "id": 192,
        "name": "Power-Off_Retract_Count",
        "value": 99,
        "worst": 99,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 50,
          "string": "-O--CK ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": true
        },
        "raw": {
          "value": 2073,
          "string": "2073"
        }
      },
      {
        "id": 193,
        "name": "Load_Cycle_Count",
        "value": 99,
        "worst": 99,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 18,
          "string": "-O--C- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": false
        },
        "raw": {
          "value": 2073,
          "string": "2073"
        }
      },
      {
        "id": 194,
        "name": "Temperature_Celsius",
        "value": 103,
        "worst": 103,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 2,
          "string": "-O---- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 377958170682,
          "string": "58 (Min/Max 16/88)"
        }
      },
      {
        "id": 196,
        "name": "Reallocated_Event_Count",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 50,
          "string": "-O--CK ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": true,
          "auto_keep": true
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 197,
        "name": "Current_Pending_Sector",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 34,
          "string": "-O---K ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": false,
          "event_count": false,
          "auto_keep": true
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 198,
        "name": "Offline_Uncorrectable",
        "value": 100,
        "worst": 100,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 8,
          "string": "---R-- ",
          "prefailure": false,
          "updated_online": false,
          "performance": false,
          "error_rate": true,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      },
      {
        "id": 199,
        "name": "UDMA_CRC_Error_Count",
        "value": 200,
        "worst": 200,
        "thresh": 0,
        "when_failed": "",
        "flags": {
          "value": 10,
          "string": "-O-R-- ",
          "prefailure": false,
          "updated_online": true,
          "performance": false,
          "error_rate": true,
          "event_count": false,
          "auto_keep": false
        },
        "raw": {
          "value": 0,
          "string": "0"
        }
      }
    ]
  },
  "spare_available": {
    "current_percent": 100,
    "threshold_percent": 5
  },
  "power_on_time": {
    "hours": 63027
  },
  "power_cycle_count": 139,
  "temperature": {
    "current": 58
  }
}
exit=0

[rcourtman]

Thanks, those outputs settle it. Both probes exited 0 and the drive reports ACTIVE or IDLE, so the standby guard behaves and your HBA is not misreporting power state. Your paste also shows the exact culprit. smartctl 7.5 returns power_mode as an object, {"ata_value": 255, "name": "ACTIVE or IDLE"}, where the agent expected a plain string, so the whole JSON document failed to parse on every guarded rotational probe. That is why all ten spinners degraded to identity-only while your two SSDs, probed without the guard, kept working.

The fix is in v6.2.2-rc.2, published earlier today as a pre-release. Your sda already returns PASSED and 58 C with the guard active, so temperatures and health should come straight back once the parser accepts the new shape.

To test now on your Docker install, point your compose file at the release candidate image, rcourtman/pulse:v6.2.2-rc.2, then:

docker compose pull
docker compose up -d

The latest tag stays on stable, so pulling alone without changing the tag would leave you on 6.2.1.

The agent on nibbler updates itself from the server, so it should move to the new version within a few minutes of the container coming back. If you would rather stay on stable, the same fix ships in v6.2.2.

One last thing, remember to revert the debug logging with sudo systemctl revert pulse-agent and a restart.