Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[OpenBMC] rflash over a range using the directory option, ends early with no reason #5299

Closed
whowutwut opened this issue Jun 18, 2018 · 10 comments
Closed

[OpenBMC] rflash over a range using the directory option, ends early with no reason #5299

whowutwut opened this issue Jun 18, 2018 · 10 comments
Assignees
@bybai
Labels
component:openbmc sprint1 type:bug
Milestone
2.14.3

Comments

@whowutwut
Copy link
Member

whowutwut commented Jun 18, 2018 •
edited
Loading

I ran the following:

[root@briggs01 xcat_clusters]# rflash dd21 -d /mnt/xcat/iso/openbmc/910.1806.20180609a_1742Fx-r9
Attempting to upload /mnt/xcat/iso/openbmc/910.1806.20180609a_1742Fx-r9/obmc-phosphor-image-witherspoon.ubi.mtd.tar and /mnt/xcat/iso/openbmc/910.1806.20180609a_1742Fx-r9/witherspoon.pnor.squashfs.tar, please wait...
mid05tor12cn15: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
mid05tor12cn15: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
mid05tor12cn15: Error: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation failed.
mid05tor12cn13: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
mid05tor12cn13: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
mid05tor12cn16: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
mid05tor12cn16: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
mid05tor12cn16: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation successful.
mid05tor12cn16: Firmware ibm-v2.0-0-r46-0-gbed584c activation successful.
mid05tor12cn16: BMC reboot
mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
mid05tor12cn13: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation successful.
mid05tor12cn13: Firmware ibm-v2.0-0-r46-0-gbed584c activation successful.
mid05tor12cn13: BMC reboot
mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
mid05tor12cn16: BMC Ready
mid05tor12cn16: reset

let's focus only on mid05tor12cn13 here.. it looks like we get the BMC reboot step, but right after this, control comes back to the console. So looks like our counter is not updated correctly and we just break out....

Right after, I list out... and the BMC is rebooting, so of course it does not reply:

[root@briggs01 xcat_clusters]# rflash dd21 -l
mid05tor12cn13: Error: [500] Login to BMC failed: 500 Can't connect to 172.11.139.13:443.
mid05tor12cn13: Error: BMC did not respond. Validate BMC configuration and retry the command.
mid05tor12cn15: ID       Purpose State      Version
mid05tor12cn15: -------------------------------------------------------
mid05tor12cn15: d8368f51 Host    Failed     IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn15: bf1721b8 Host    Active(*)  IBM-witherspoon-ibm-OP9-v2.0-2.9
mid05tor12cn15: b04fff27 BMC     Active     ibm-v2.0-0-r46-0-gbed584c
mid05tor12cn15: 718dbc93 BMC     Active(*)  ibm-v2.1-438-g0030304-r11-0-g80e9668
mid05tor12cn15:
mid05tor12cn16: ID       Purpose State      Version
mid05tor12cn16: -------------------------------------------------------
mid05tor12cn16: d8368f51 Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn16: 7c6bacc0 Host    Active     IBM-witherspoon-ibm-OP9_v1.19_1.167
mid05tor12cn16: 7a1ce9fe BMC     Active     ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn16: b04fff27 BMC     Active(*)  ibm-v2.0-0-r46-0-gbed584c
mid05tor12cn16:

Problem here now is that the host is not rebooted...

[root@briggs01 xcat_clusters]# rflash mid05tor12cn13 -l
mid05tor12cn13: ID       Purpose State      Version
mid05tor12cn13: -------------------------------------------------------
mid05tor12cn13: d8368f51 Host    Active(+)  IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn13: 49b8ef1f Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.149
mid05tor12cn13: 7a1ce9fe BMC     Active     ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn13: b04fff27 BMC     Active(*)  ibm-v2.0-0-r46-0-gbed584c
mid05tor12cn13:
@bybai bybai added this to the 2.14.2 milestone Jun 19, 2018
@bybai bybai added the sprint2 label Jun 19, 2018
@bybai
Copy link
Contributor

bybai commented Jun 19, 2018

Hi @whowutwut,
The work around is manually rpower mid05tor12cn13 boot.
I tried to reproduce this issue. I got this result

  1. I can not reproduce reset process is missing from output, do you paste the whole output?
  2. I can reproduce host is not on issue. after bmc and pnor are uploaded and activated, execute bmc reboot and get bmc Ready state, then rflash send power reset to mid05tor12cn13, but mid05tor12cn13 is only off, openbmc does not handle power on for mid05tor12cn13. From the output, I always got the whole process, it seemed all rflash steps were done, power reset for mid05tor12cn13 did not work well.

Then I manually rflash mid05tor12cn13 -a ...", manually rpower mid05tor12cn13 bmcreboot, manually execute rpower mid05tor12cn13 reset, I got the same result that new pnor did not take effect. So I think it is not rflash -d` specific issue, it is related to mid05tor12cn13 openbmc.

  1. rflash -d result:
[root@briggs01 ~]# rpower mid05tor12cn13 state
mid05tor12cn13: off
[root@briggs01 ~]# rflash mid05tor12cn13 -l
mid05tor12cn13: ID       Purpose State      Version
mid05tor12cn13: -------------------------------------------------------
mid05tor12cn13: d8368f51 Host    Active(+)  IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn13: 49b8ef1f Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.149
mid05tor12cn13: 7a1ce9fe BMC     Active     ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn13: b04fff27 BMC     Active(*)  ibm-v2.0-0-r46-0-gbed584c

The rflash process:

[root@briggs01 ~]# rflash dd21 -d /mnt/xcat/iso/openbmc/910.1806.20180609a_1742Fx-r9 |tee log1
Attempting to upload /mnt/xcat/iso/openbmc/910.1806.20180609a_1742Fx-r9/obmc-phosphor-image-witherspoon.ubi.mtd.tar and /mnt/xcat/iso/openbmc/910.1806.20180609a_1742Fx-r9/witherspoon.pnor.squashfs.tar, please wait...
mid05tor12cn15: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
mid05tor12cn15: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
mid05tor12cn15: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation successful.
mid05tor12cn15: Firmware ibm-v2.0-0-r46-0-gbed584c activation successful.
mid05tor12cn15: BMC reboot
mid05tor12cn16: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
mid05tor12cn16: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
mid05tor12cn16: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation successful.
mid05tor12cn16: Firmware ibm-v2.0-0-r46-0-gbed584c activation successful.
mid05tor12cn16: BMC reboot
mid05tor12cn15: Retry BMC state, wait for 15 seconds ...
mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
mid05tor12cn13: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
mid05tor12cn13: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
mid05tor12cn15: Retry BMC state, wait for 15 seconds ...
mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
mid05tor12cn15: Retry BMC state, wait for 15 seconds ...
mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
mid05tor12cn15: Retry BMC state, wait for 15 seconds ...
mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
mid05tor12cn16: BMC Ready
mid05tor12cn15: BMC Ready
mid05tor12cn13: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation successful.
mid05tor12cn13: Firmware ibm-v2.0-0-r46-0-gbed584c activation successful.
mid05tor12cn13: BMC reboot
mid05tor12cn15: reset
mid05tor12cn16: reset
mid05tor12cn13: Retry BMC state, wait for 15 seconds ...
mid05tor12cn13: Retry BMC state, wait for 15 seconds ...
mid05tor12cn13: Retry BMC state, wait for 15 seconds ...
mid05tor12cn13: Retry BMC state, wait for 15 seconds ...
mid05tor12cn13: Retry BMC state, wait for 15 seconds ...
mid05tor12cn13: BMC Ready
mid05tor12cn13: reset
  1. manually rflash -a, rpower bmcreboot, rpower reset
[root@briggs01 ~]# rflash mid05tor12cn13 -a b04fff27
Attempting to activate ID=b04fff27, please wait...
mid05tor12cn13: Firmware activation successful.
-------------------------------------------------------
Firmware update complete: Total=1 Success=1 Failed=0
-------------------------------------------------------
[root@briggs01 ~]# rflash mid05tor12cn13 -a d8368f51
Attempting to activate ID=d8368f51, please wait...
mid05tor12cn13: Firmware activation successful.
-------------------------------------------------------
Firmware update complete: Total=1 Success=1 Failed=0
-------------------------------------------------------
[root@briggs01 ~]# rflash mid05tor12cn13 -l
mid05tor12cn13: ID       Purpose State      Version
mid05tor12cn13: -------------------------------------------------------
mid05tor12cn13: d8368f51 Host    Active(+)  IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn13: 49b8ef1f Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.149
mid05tor12cn13: 7a1ce9fe BMC     Active(*)  ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn13: b04fff27 BMC     Active(+)  ibm-v2.0-0-r46-0-gbed584c
mid05tor12cn13:
[root@briggs01 ~]# rpower mid05tor12cn13 bmcreboot
mid05tor12cn13: Firmware will be flashed on reboot, deleting all BMC diagnostics...
mid05tor12cn13: BMC reboot
[root@briggs01 ~]# rflash mid05tor12cn13 -l
mid05tor12cn13: ID       Purpose State      Version
mid05tor12cn13: -------------------------------------------------------
mid05tor12cn13: d8368f51 Host    Active(+)  IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn13: 49b8ef1f Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.149
mid05tor12cn13: 7a1ce9fe BMC     Active     ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn13: b04fff27 BMC     Active(*)  ibm-v2.0-0-r46-0-gbed584c
mid05tor12cn13:
[root@briggs01 ~]# rpower mid05tor12cn13 reset
mid05tor12cn13: off
[root@briggs01 ~]# rpower mid05tor12cn13 state
mid05tor12cn13: on (Chassis)
[root@briggs01 ~]# rflash mid05tor12cn13 -l
mid05tor12cn13: ID       Purpose State      Version
mid05tor12cn13: -------------------------------------------------------
mid05tor12cn13: d8368f51 Host    Active(+)  IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn13: 49b8ef1f Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.149
mid05tor12cn13: 7a1ce9fe BMC     Active     ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn13: b04fff27 BMC     Active(*)  ibm-v2.0-0-r46-0-gbed584c
mid05tor12cn13:

@whowutwut
Copy link
Member Author

@bybai On briggs01: vi /var/log/xcat/5299.commands.log

   1767 ====================================================
   1768 [Date]       2018-06-18 13:59:33
   1769 [ClientType] cli
   1770 [Request]    rflash dd21 -d '/mnt/xcat/iso/openbmc/910.1806.20180609a_1742Fx-r9'
   1771 [Response]
   1772 Attempting to upload /mnt/xcat/iso/openbmc/910.1806.20180609a_1742Fx-r9/obmc-phosphor-image-witherspoon.ubi.mtd.tar and /mnt/xcat/iso/openbmc/910.1806.20180609a_174        2Fx-r9/witherspoon.pnor.squashfs.tar, please wait...
   1773 mid05tor12cn15: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
   1774 mid05tor12cn15: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
   1775 mid05tor12cn15: Error: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation failed.
   1776 mid05tor12cn13: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
   1777 mid05tor12cn13: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
   1778 mid05tor12cn16: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
   1779 mid05tor12cn16: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
   1780 mid05tor12cn16: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation successful.
   1781 mid05tor12cn16: Firmware ibm-v2.0-0-r46-0-gbed584c activation successful.
   1782 mid05tor12cn16: BMC reboot
   1783 mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
   1784 mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
   1785 mid05tor12cn13: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation successful.
   1786 mid05tor12cn13: Firmware ibm-v2.0-0-r46-0-gbed584c activation successful.
   1787 mid05tor12cn13: BMC reboot
   1788 mid05tor12cn16: Retry BMC state, wait for 15 seconds ...
   1789 mid05tor12cn16: BMC Ready
   1790 mid05tor12cn16: reset
   1791 [ElapsedTime] 530.475 s
   1792 ====================================================

Looks like cn13 never had a line saying reset.

Maybe a glitch.. but strange ...

@bybai
Copy link
Contributor

bybai commented Jun 20, 2018

hi @whowutwut, based on my investigation, after mid05tor12cn13 is updated firmware, manually reset host and rflash -d reset have the same result: mid05tor12cn13 is off, but it is not on. So I think it is not rflash specific bug.

@bybai
Copy link
Contributor

bybai commented Jun 21, 2018 •
edited
Loading

@whowutwut you can reproduce use the steps, it is easily reproduce on mid05tor12cn13 :
1, use rflash to activate the old firmware like this:

[root@briggs01 ~]# rflash mid05tor12cn13 -l
mid05tor12cn13: ID       Purpose State      Version
mid05tor12cn13: -------------------------------------------------------
mid05tor12cn13: d8368f51 Host    Active     IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn13: 49b8ef1f Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.149
mid05tor12cn13: 7a1ce9fe BMC     Active(*)  ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn13: b04fff27 BMC     Active     ibm-v2.0-0-r46-0-gbed584c

2, use rflash -a to use new firmware:

[root@briggs01 ~]# rflash mid05tor12cn13 -a b04fff27
Attempting to activate ID=b04fff27, please wait...
mid05tor12cn13: Firmware activation successful.
-------------------------------------------------------
Firmware update complete: Total=1 Success=1 Failed=0
-------------------------------------------------------
[root@briggs01 ~]# rflash mid05tor12cn13 -a d8368f51
Attempting to activate ID=d8368f51, please wait...
mid05tor12cn13: Firmware activation successful.
-------------------------------------------------------
Firmware update complete: Total=1 Success=1 Failed=0
-------------------------------------------------------
[root@briggs01 ~]# rpower mid05tor12cn13 state
mid05tor12cn13: on
[root@briggs01 ~]# rflash mid05tor12cn13 -l
mid05tor12cn13: ID       Purpose State      Version
mid05tor12cn13: -------------------------------------------------------
mid05tor12cn13: d8368f51 Host    Active(+)  IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn13: 49b8ef1f Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.149
mid05tor12cn13: 7a1ce9fe BMC     Active(*)  ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn13: b04fff27 BMC     Active(+)  ibm-v2.0-0-r46-0-gbed584c

3, reboot BMC, and 2 minutes later, new BMC is Active(*):

[root@briggs01 ~]# rpower mid05tor12cn13 bmcreboot
mid05tor12cn13: Firmware will be flashed on reboot, deleting all BMC diagnostics...
mid05tor12cn13: BMC reboot
[root@briggs01 ~]# rflash mid05tor12cn13 -l
mid05tor12cn13: ID       Purpose State      Version
mid05tor12cn13: -------------------------------------------------------
mid05tor12cn13: d8368f51 Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn13: 49b8ef1f Host    Active(+)  IBM-witherspoon-ibm-OP9_v1.19_1.149
mid05tor12cn13: 7a1ce9fe BMC     Active(*)  ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn13: b04fff27 BMC     Active     ibm-v2.0-0-r46-0-gbed584c

4, rpower reset host immediately, here I got error message several times, then I got off state:

[root@briggs01 ~]# rpower mid05tor12cn13 reset
mid05tor12cn13: Error: Received wrong format response: {u'/xyz/openbmc_project/state/chassis0': {u'CurrentPowerState': u'xyz.openbmc_project.State.Chassis.PowerState.Off', u'RequestedPowerTransition': u'xyz.openbmc_project.State.Chassis.Transition.Off'}, u'/xyz/openbmc_project/state/bmc0': {u'CurrentBMCState': u'xyz.openbmc_project.State.BMC.BMCState.NotReady', u'RequestedBMCTransition': u'xyz.openbmc_project.State.BMC.Transition.None'}}
[root@briggs01 ~]# rflash mid05tor12cn13 -l
mid05tor12cn13: ID       Purpose State      Version
mid05tor12cn13: -------------------------------------------------------
mid05tor12cn13: d8368f51 Host    Active(*)  IBM-witherspoon-ibm-OP9_v1.19_1.172
mid05tor12cn13: 49b8ef1f Host    Active     IBM-witherspoon-ibm-OP9_v1.19_1.149
mid05tor12cn13: 7a1ce9fe BMC     Active     ibm-v2.0-0-r43-0-gdb0b7b3
mid05tor12cn13: b04fff27 BMC     Active(*)  ibm-v2.0-0-r46-0-gbed584c
mid05tor12cn13:
[root@briggs01 ~]# rpower mid05tor12cn13 reset
mid05tor12cn13: Error: Received wrong format response: {u'/xyz/openbmc_project/state/chassis0': {u'CurrentPowerState': u'xyz.openbmc_project.State.Chassis.PowerState.Off', u'RequestedPowerTransition': u'xyz.openbmc_project.State.Chassis.Transition.Off'}, u'/xyz/openbmc_project/state/bmc0': {u'CurrentBMCState': u'xyz.openbmc_project.State.BMC.BMCState.NotReady', u'RequestedBMCTransition': u'xyz.openbmc_project.State.BMC.Transition.None'}}
[root@briggs01 ~]# rpower mid05tor12cn13 reset
mid05tor12cn13: off

I think this rflash -d hit the same problem as rpower reset command, but soon after this error, rpower reset got off.

@bybai
Copy link
Contributor

bybai commented Jun 22, 2018

@whowutwut , I think this is not rflash specific bug, so could we close it?

@moralesj
Copy link

Re-opening issue since we have it once more on the Austin Coral Combined cluster

Attempting to upload /firmware/Witherspoon/OP910/OP910_1742FxR9-910.1806.20180611a-pnorOnlyUpdate/obmc-phosphor-image-witherspoon-20180419204345.ubi.mtd.tar and /firmware/Witherspoon/OP910/OP910_1742FxR9-910.1806.20180611a-pnorOnlyUpdate/witherspoon-IBM-OP9_v1.19_1.172.pnor.squashfs.tar, please wait...
cn07: Firmware upload successful. Attempting to activate firmware: IBM-witherspoon-ibm-OP9_v1.19_1.172 (ID: d8368f51)
cn07: Firmware upload successful. Attempting to activate firmware: ibm-v2.0-0-r46-0-gbed584c (ID: b04fff27)
cn07: Firmware IBM-witherspoon-ibm-OP9_v1.19_1.172 activation successful.
cn07: Firmware ibm-v2.0-0-r46-0-gbed584c activation successful.
cn07: BMC reboot
cn07: Retry BMC state, wait for 15 seconds ...
cn07: Retry BMC state, wait for 15 seconds ...
cn07: Retry BMC state, wait for 15 seconds ...
cn07: Retry BMC state, wait for 15 seconds ...
cn07: BMC Ready
cn07: reset

@gurevichmark
Copy link
Contributor

gurevichmark commented Jul 10, 2018 •
edited
Loading

Reopening. @moralesj ran into this again today.
Perhaps we should try to catch errors like "mid05tor12cn13: Error: Received wrong format response..." in rflash and exit gracefully ?

@gurevichmark gurevichmark reopened this Jul 10, 2018
@xcat2 xcat2 deleted a comment from chuckbrazie Jul 10, 2018
@xcat2 xcat2 deleted a comment from chuckbrazie Jul 10, 2018
@xcat2 xcat2 deleted a comment from chuckbrazie Jul 10, 2018
@bybai
Copy link
Contributor

bybai commented Jul 11, 2018 •
edited
Loading

"mid05tor12cn13: Error: Received wrong format response..." happen in rpower mid05tor12cn13 reset, I think this cause rflash -d failure.

[root@briggs01 ~]# rpower mid05tor12cn13 reset
mid05tor12cn13: Error: Received wrong format response: 
{u'/xyz/openbmc_project/state/chassis0': 
{u'CurrentPowerState': u'xyz.openbmc_project.State.Chassis.PowerState.Off', 
u'RequestedPowerTransition': u'xyz.openbmc_project.State.Chassis.Transition.Off'}, 
u'/xyz/openbmc_project/state/bmc0':
 {u'CurrentBMCState': u'xyz.openbmc_project.State.BMC.BMCState.NotReady', 
u'RequestedBMCTransition': u'xyz.openbmc_project.State.BMC.Transition.None'}}

@bybai
Copy link
Contributor

bybai commented Jul 11, 2018

@whowutwut and @gurevichmark , it is seldom reproduced.
In failure case, after rpower mid05tor12cn13 reset , mid05tor12cn13 power state is off, on process fail, so I will add check for rflash -d to check: after rpower reset, 5 seconds later, if power state is still off, send the rpower on request to let host on to resolve the problem.

@bybai bybai modified the milestones: 2.14.2, 2.14.3 Jul 11, 2018
@xcat2 xcat2 deleted a comment from chuckbrazie Jul 11, 2018
@xcat2 xcat2 deleted a comment from chuckbrazie Jul 11, 2018
@bybai bybai added sprint1 and removed sprint2 labels Jul 18, 2018
@bybai bybai mentioned this issue Jul 18, 2018
Merged
@bybai
Copy link
Contributor

bybai commented Aug 21, 2018

this is fixed, so close it now.

@bybai bybai closed this as completed Aug 21, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bybai bybai

Labels
component:openbmc sprint1 type:bug
Projects
None yet
Milestone
2.14.3
Development

No branches or pull requests
4 participants
@bybai @whowutwut @moralesj @gurevichmark