Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Badfish failure with verify_ssl on Dell R730xd / iDRAC8 #190

Closed
sadsfae opened this issue Oct 7, 2021 · 1 comment
Closed

[BUG] Badfish failure with verify_ssl on Dell R730xd / iDRAC8 #190

sadsfae opened this issue Oct 7, 2021 · 1 comment
Labels
bug Something isn't working Dell python

Comments

@sadsfae
Copy link
Member

sadsfae commented Oct 7, 2021

Have gotten reports that current upstream badfish fails to work on Dell R730xd systems, I have been able to reproduce this as well pulling from latest upstream (via setuptools method).

This seems to stem from

- DEBUG - _request() got an unexpected keyword argument 'verify_ssl'

This could potentially be from this code here:

badfish/src/badfish/badfish.py

Line 107 in cf72061

async def get_request(self, uri, _continue=False):

This seems to work on R730XD as of 158161b

(user report)

[stack@f13-h26-b08-5039ms ~]$ ~/.local/bin/badfish --host-list ./mgmt-interfaces -u quads -p rdu2@1425 -i ./badfish/config/idrac_interfaces.yml --boot-to-type foreman
[mgmt-f25-h11-000-r730xd] - ERROR    - Failed to communicate with server.
[mgmt-f25-h19-000-r730xd] - ERROR    - Failed to communicate with server.
[mgmt-f25-h13-000-r730xd] - ERROR    - Failed to communicate with server.
[mgmt-f25-h21-000-r730xd] - ERROR    - Failed to communicate with server.
[mgmt-f25-h07-000-r730xd] - ERROR    - Failed to communicate with server.
[mgmt-f25-h23-000-r730xd] - ERROR    - Failed to communicate with server.
[mgmt-f25-h15-000-r730xd] - ERROR    - Failed to communicate with server.
[mgmt-f25-h17-000-r730xd] - ERROR    - Failed to communicate with server.
[mgmt-f25-h11-000-r730xd] - ERROR    - There was something wrong executing Badfish
[mgmt-f25-h11-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h19-000-r730xd] - ERROR    - There was something wrong executing Badfish
[mgmt-f25-h19-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h13-000-r730xd] - ERROR    - There was something wrong executing Badfish
[mgmt-f25-h13-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h21-000-r730xd] - ERROR    - There was something wrong executing Badfish
[mgmt-f25-h21-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h07-000-r730xd] - ERROR    - There was something wrong executing Badfish
[mgmt-f25-h07-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h23-000-r730xd] - ERROR    - There was something wrong executing Badfish
[mgmt-f25-h23-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h15-000-r730xd] - ERROR    - There was something wrong executing Badfish
[mgmt-f25-h15-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h17-000-r730xd] - ERROR    - There was something wrong executing Badfish
[mgmt-f25-h17-000-r730xd] - INFO     - ************************************************
[badfish.badfish] - INFO     - RESULTS:
[badfish.badfish] - INFO     - mgmt-f25-h07-000-r730xd.rdu2.scalelab.example.com: FAILED
[badfish.badfish] - INFO     - mgmt-f25-h11-000-r730xd.rdu2.scalelab.example.com: FAILED
[badfish.badfish] - INFO     - mgmt-f25-h13-000-r730xd.rdu2.scalelab.example.com: FAILED
[badfish.badfish] - INFO     - mgmt-f25-h15-000-r730xd.rdu2.scalelab.example.com: FAILED
[badfish.badfish] - INFO     - mgmt-f25-h17-000-r730xd.rdu2.scalelab.example.com: FAILED
[badfish.badfish] - INFO     - mgmt-f25-h19-000-r730xd.rdu2.scalelab.example.com: FAILED
[badfish.badfish] - INFO     - mgmt-f25-h21-000-r730xd.rdu2.scalelab.example.com: FAILED
[badfish.badfish] - INFO     - mgmt-f25-h23-000-r730xd.rdu2.scalelab.example.com: FAILED
  • This works with a previous git checkout against an older commit
[stack@f13-h26-b08-5039ms badfish]$ git checkout 158161b3c721c6d52d68692f6def0c7a9058826c

[stack@f13-h26-b08-5039ms badfish]$ python3 setup.py build
running build
running build_py
copying src/badfish/badfish.py -> build/lib/badfish
[stack@f13-h26-b08-5039ms badfish]$ python3 setup.py install --prefix ~/.local


[stack@f13-h26-b08-5039ms ~]$ ~/.local/bin/badfish --host-list ./mgmt-interfaces -u quads -p rdu2@1425 -i ./badfish/config/idrac_interfaces.yml --boot-to-type foreman
[mgmt-f25-h23-000-r730xd] - INFO     - Executing actions on host: mgmt-f25-h23-000-r730xd.rdu2.scalelab.example.com
[mgmt-f25-h23-000-r730xd] - WARNING  - iDRAC version installed does not support DellJobService
[mgmt-f25-h23-000-r730xd] - WARNING  - Clearing job queue for job IDs: ['JID_327126037398'].
[mgmt-f25-h23-000-r730xd] - INFO     - Job queue for iDRAC mgmt-f25-h23-000-r730xd.rdu2.scalelab.example.com successfully cleared.
[mgmt-f25-h11-000-r730xd] - INFO     - Executing actions on host: mgmt-f25-h11-000-r730xd.rdu2.scalelab.example.com
[mgmt-f25-h21-000-r730xd] - INFO     - Executing actions on host: mgmt-f25-h21-000-r730xd.rdu2.scalelab.example.com
[mgmt-f25-h23-000-r730xd] - INFO     - Command passed to set BIOS attribute pending values.
[mgmt-f25-h15-000-r730xd] - INFO     - Executing actions on host: mgmt-f25-h15-000-r730xd.rdu2.scalelab.example.com
[mgmt-f25-h13-000-r730xd] - INFO     - Executing actions on host: mgmt-f25-h13-000-r730xd.rdu2.scalelab.example.com
[mgmt-f25-h07-000-r730xd] - INFO     - Executing actions on host: mgmt-f25-h07-000-r730xd.rdu2.scalelab.example.com
[mgmt-f25-h19-000-r730xd] - INFO     - Executing actions on host: mgmt-f25-h19-000-r730xd.rdu2.scalelab.example.com
[mgmt-f25-h17-000-r730xd] - INFO     - Executing actions on host: mgmt-f25-h17-000-r730xd.rdu2.scalelab.example.com
[mgmt-f25-h23-000-r730xd] - INFO     - POST command passed to create target config job.
[mgmt-f25-h23-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h15-000-r730xd] - WARNING  - iDRAC version installed does not support DellJobService
[mgmt-f25-h11-000-r730xd] - WARNING  - iDRAC version installed does not support DellJobService
[mgmt-f25-h19-000-r730xd] - WARNING  - iDRAC version installed does not support DellJobService
[mgmt-f25-h21-000-r730xd] - WARNING  - iDRAC version installed does not support DellJobService
[mgmt-f25-h07-000-r730xd] - WARNING  - iDRAC version installed does not support DellJobService
[mgmt-f25-h13-000-r730xd] - WARNING  - iDRAC version installed does not support DellJobService
[mgmt-f25-h11-000-r730xd] - WARNING  - Clearing job queue for job IDs: ['JID_327125909328'].
[mgmt-f25-h21-000-r730xd] - WARNING  - Clearing job queue for job IDs: ['JID_327155680004'].
[mgmt-f25-h17-000-r730xd] - WARNING  - iDRAC version installed does not support DellJobService
[mgmt-f25-h15-000-r730xd] - WARNING  - Clearing job queue for job IDs: ['JID_327125845896'].
[mgmt-f25-h07-000-r730xd] - WARNING  - Clearing job queue for job IDs: ['JID_327125927729'].
[mgmt-f25-h13-000-r730xd] - WARNING  - Clearing job queue for job IDs: ['JID_327125924071'].
[mgmt-f25-h19-000-r730xd] - WARNING  - Clearing job queue for job IDs: ['JID_327125904899'].
[mgmt-f25-h11-000-r730xd] - INFO     - Job queue for iDRAC mgmt-f25-h11-000-r730xd.rdu2.scalelab.example.com successfully cleared.
[mgmt-f25-h21-000-r730xd] - INFO     - Job queue for iDRAC mgmt-f25-h21-000-r730xd.rdu2.scalelab.example.com successfully cleared.
[mgmt-f25-h15-000-r730xd] - INFO     - Job queue for iDRAC mgmt-f25-h15-000-r730xd.rdu2.scalelab.example.com successfully cleared.
[mgmt-f25-h17-000-r730xd] - WARNING  - Clearing job queue for job IDs: ['JID_327125959350'].
[mgmt-f25-h07-000-r730xd] - INFO     - Job queue for iDRAC mgmt-f25-h07-000-r730xd.rdu2.scalelab.example.com successfully cleared.
[mgmt-f25-h13-000-r730xd] - INFO     - Job queue for iDRAC mgmt-f25-h13-000-r730xd.rdu2.scalelab.example.com successfully cleared.
[mgmt-f25-h19-000-r730xd] - INFO     - Job queue for iDRAC mgmt-f25-h19-000-r730xd.rdu2.scalelab.example.com successfully cleared.
[mgmt-f25-h17-000-r730xd] - INFO     - Job queue for iDRAC mgmt-f25-h17-000-r730xd.rdu2.scalelab.example.com successfully cleared.
[mgmt-f25-h15-000-r730xd] - INFO     - Command passed to set BIOS attribute pending values.
[mgmt-f25-h11-000-r730xd] - INFO     - Command passed to set BIOS attribute pending values.
[mgmt-f25-h07-000-r730xd] - INFO     - Command passed to set BIOS attribute pending values.
[mgmt-f25-h13-000-r730xd] - INFO     - Command passed to set BIOS attribute pending values.
[mgmt-f25-h19-000-r730xd] - INFO     - Command passed to set BIOS attribute pending values.
[mgmt-f25-h21-000-r730xd] - INFO     - Command passed to set BIOS attribute pending values.
[mgmt-f25-h17-000-r730xd] - INFO     - Command passed to set BIOS attribute pending values.
[mgmt-f25-h11-000-r730xd] - INFO     - POST command passed to create target config job.
[mgmt-f25-h11-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h15-000-r730xd] - INFO     - POST command passed to create target config job.
[mgmt-f25-h15-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h19-000-r730xd] - INFO     - POST command passed to create target config job.
[mgmt-f25-h19-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h21-000-r730xd] - INFO     - POST command passed to create target config job.
[mgmt-f25-h21-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h13-000-r730xd] - INFO     - POST command passed to create target config job.
[mgmt-f25-h13-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h07-000-r730xd] - INFO     - POST command passed to create target config job.
[mgmt-f25-h07-000-r730xd] - INFO     - ************************************************
[mgmt-f25-h17-000-r730xd] - INFO     - POST command passed to create target config job.
[mgmt-f25-h17-000-r730xd] - INFO     - ************************************************
[badfish.badfish] - INFO     - RESULTS:
[badfish.badfish] - INFO     - mgmt-f25-h07-000-r730xd.rdu2.scalelab.example.com: SUCCESSFUL
[badfish.badfish] - INFO     - mgmt-f25-h11-000-r730xd.rdu2.scalelab.example.com: SUCCESSFUL
[badfish.badfish] - INFO     - mgmt-f25-h13-000-r730xd.rdu2.scalelab.example.com: SUCCESSFUL
[badfish.badfish] - INFO     - mgmt-f25-h15-000-r730xd.rdu2.scalelab.example.com: SUCCESSFUL
[badfish.badfish] - INFO     - mgmt-f25-h17-000-r730xd.rdu2.scalelab.example.com: SUCCESSFUL
[badfish.badfish] - INFO     - mgmt-f25-h19-000-r730xd.rdu2.scalelab.example.com: SUCCESSFUL
[badfish.badfish] - INFO     - mgmt-f25-h21-000-r730xd.rdu2.scalelab.example.com: SUCCESSFUL
[badfish.badfish] - INFO     - mgmt-f25-h23-000-r730xd.rdu2.scalelab.example.com: SUCCESSFUL
@sadsfae sadsfae added bug Something isn't working Dell and removed bug Something isn't working labels Oct 7, 2021
@sadsfae
Copy link
Member Author

sadsfae commented Oct 7, 2021 •
edited

At first this looked like a pip/pypy packaging issue with some OpenSSL library, however with the older commit 158161b this works

# badfish -H mgmt-f25-h11-000-r730xd.rdu2.scalelab.example.com -u quads -p XXXXXX  --check-boot -v
- DEBUG    - Systems service: /redfish/v1/Systems/System.Embedded.1.
- DEBUG    - Managers service: /redfish/v1/Managers/iDRAC.Embedded.1.
- DEBUG    - Getting bios boot mode.
- DEBUG    - Getting BIOS attribute.
- INFO     - Current boot order:
- INFO     - 1: HardDisk.List.1-1
- INFO     - 2: NIC.Integrated.1-2-1
- INFO     - 3: NIC.Integrated.1-3-1

This works for me with podman

-=>>podman pull quay.io/quads/badfish
Trying to pull quay.io/quads/badfish:latest...
Getting image source signatures
Copying blob 02e5da7e751e done  
Copying blob 472f8c18fd1c done  
Copying blob ba51967de001 done  
Copying blob a0d0a0d46f8b done  
Copying blob f60364742cee done  
Copying blob 957de7efb4e3 done  
Copying blob 5a8ffd621f2d done  
Copying blob 4fb488c7b13b done  
Copying blob 13472c143e72 done  
Copying blob 2f1d8e6bd606 done  
Copying blob 63398757fce7 done  
Copying config a41c48da89 done  
Writing manifest to image destination
Storing signatures
a41c48da89b4c6240f1a679a6af8644abb4eba4987d22498d4899ed95d89831b
(wfoster@turbobars) - (19:32) - (~)
-=>>podman run -it --rm --dns 10.1.32.3 quay.io/quads/badfish -H mgmt-f25-h11-000-r730xd.rdu2.scalelab.example.com -u quads -p XXXXXX --check-boot -v
- DEBUG    - Systems service: /redfish/v1/Systems/System.Embedded.1.
- DEBUG    - Managers service: /redfish/v1/Managers/iDRAC.Embedded.1.
- DEBUG    - Getting bios boot mode.
- DEBUG    - Getting BIOS attribute.
- INFO     - Current boot order:
- INFO     - 1: HardDisk.List.1-1
- INFO     - 2: NIC.Integrated.1-2-1
- INFO     - 3: NIC.Integrated.1-3-1

This fails for me on Python 3.8 or Python 3.9

badfish -H mgmt-f25-h11-000-r730xd.rdu2.scalelab.example.com -u quads -p XXXXX  --check-boot -v
- DEBUG    - _request() got an unexpected keyword argument 'verify_ssl'
- ERROR    - Failed to communicate with server.
- DEBUG    - 
- ERROR    - There was something wrong executing Badfish

@sadsfae sadsfae added bug Something isn't working python compatibility and removed bug Something isn't working compatibility labels Oct 7, 2021
@grafuls grafuls mentioned this issue Oct 8, 2021
Merged
@sadsfae sadsfae closed this as completed in 583d64b Oct 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working Dell python
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@sadsfae