[BACKPORT][v1.6.1][BUG][1.6.0] ENGINE v2 : disk /dev/xxxx is already used by AIO bdev disk-x

[github-actions]

backport #8129

[longhorn-io-github-bot]

Pre Ready-For-Testing Checklist

• Where is the reproduce steps/test steps documented?
  The reproduce steps/test steps are at:

1. Enable v2-data-engine
2. Create two block devices such as loop devices
3. Add the two disks to block-type disks
4. One of the two disks shows the error message ... is already used by AIO bdev ... in node.status.diskStatus

After the fix, the two disks can be added successfully.

• Does the PR include the explanation for the fix or the feature?

• Have the backend code been merged (Manager, Engine, Instance Manager, BackupStore etc) (including backport-needed/*)?
  The PR is at

longhorn/longhorn-instance-manager#430

• Which areas/issues this PR might have potential impacts on?
  Area: v2 volume
  Issues

[chriscchien]

Verified pass on longhorn v1.6.x(longhorn-instance-manager 7a1637) with test steps

Can add two block devices as block-type disks on the same longhorn node without problem

    disk-3:
      conditions:
      - lastProbeTime: ""
        lastTransitionTime: "2024-03-11T07:28:13Z"
        message: Disk disk-3(/dev/loop5) on node ip-172-31-44-108 is ready
        reason: ""
        status: "True"
        type: Ready
      - lastProbeTime: ""
        lastTransitionTime: "2024-03-11T07:28:13Z"
        message: Disk disk-3(/dev/loop5) on node ip-172-31-44-108 is schedulable
        reason: ""
        status: "True"
        type: Schedulable
      diskType: block
      diskUUID: a5017ece-5d7d-47f3-b4d9-65cc3006be27
      filesystemType: ""
      scheduledReplica: {}
      storageAvailable: 10590617600
      storageMaximum: 10694426624
      storageScheduled: 0
    disk-4:
      conditions:
      - lastProbeTime: ""
        lastTransitionTime: "2024-03-11T08:18:43Z"
        message: Disk disk-4(/dev/loop7) on node ip-172-31-44-108 is ready
        reason: ""
        status: "True"
        type: Ready
      - lastProbeTime: ""
        lastTransitionTime: "2024-03-11T08:18:43Z"
        message: Disk disk-4(/dev/loop7) on node ip-172-31-44-108 is schedulable
        reason: ""
        status: "True"
        type: Schedulable
      diskType: block
      diskUUID: f33fa13f-e07d-41e7-827b-f6dc2e90af2d
      filesystemType: ""
      scheduledReplica: {}
      storageAvailable: 10590617600
      storageMaximum: 10694426624
      storageScheduled: 0