OTA invalid magic byte (IDFGH-10674) #11903

baldhead69 · 2023-07-19T00:39:24Z

Answers checklist.

I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report

Hi,

I am implementing the example "advanced_https_ota_example" https://github.com/espressif/esp-idf/bl ... _example.c with some particular changes.

After ota app update at new partition( 0x1010000 ), appear this error message, and ESP32-S3 boot from old partition ( 0x20000 ).

E (129) esp_image: image at 0x1010000 has invalid magic byte (nothing flashed here?)
E (137) boot: OTA app partition slot 1 is not bootable

Maybe the size of flash memory with 32MB is not supported ?!

More informations here:
https://www.esp32.com/viewtopic.php?f=13&t=34682&p=117009#p117009

Thank's.

The text was updated successfully, but these errors were encountered:

mythbuster5 · 2023-07-19T06:45:35Z

related docs: https://docs.espressif.com/projects/esp-idf/en/latest/esp32s3/api-reference/peripherals/spi_flash/spi_flash_optional_feature.html#bit-address-flash-chips

baldhead69 · 2023-07-20T01:41:21Z

related docs: https://docs.espressif.com/projects/esp-idf/en/latest/esp32s3/api-reference/peripherals/spi_flash/spi_flash_optional_feature.html#bit-address-flash-chips

My board use octal flash communication( i configured in this way ), so, i think that docs not apply and my memory chip is different, i think it is MX25UM25645G.
"This option only valid for 4-line flash. Octal flash doesn’t need this."

And i dont have sure if the problem is the memory size ( 32MB ).

baldhead69 · 2023-07-21T00:42:47Z

The problem, i think, is flash memory size ( 32MB ).

I changed the partition table to address below 16MB and it worked.

How to make it work for addresses above 16MB too ???

Updated answer here:
https://www.esp32.com/viewtopic.php?f=13&t=34682&p=117182#p117182

ESP32DE · 2023-08-01T18:49:48Z

hi @baldhead69
espressif/esptool#883
best wishes
;-)

baldhead69 · 2023-08-01T19:22:44Z

hi @ESP32DE,

In my case the ota update by wifi achieves flash the image on flash memory without problems.

When the ota update restart the chip, the message "OTA invalid magic byte" appear and the esp32-s3 use the old firmware to start.

The problem only appears if the address of the new firmware is above 16 MB( specified in the partition file ).

Thank's.

mythbuster5 · 2023-10-12T04:46:44Z

ota_32M.txt
Sorry for the late reply. I'm working on other stuff these days... rename it to ota_32M.patch, and apply it. I think this will solve your problem

baldhead69 · 2023-10-17T04:15:12Z

Hi @mythbuster5,

I applied the patch and errors appeared.
I dont know if i applied the patch correctly.

esp-idf: v5.1

mythbuster5 · 2023-10-17T07:35:47Z

5.1? My version is based on the latest, let me check.

baldhead69 · 2023-10-17T15:02:34Z

5.1 is the latest stable version, no ?

baldhead69 · 2023-10-19T22:48:27Z

@mythbuster5 ,

you can change the latest stable version of esp idf.

I download the latest stable version, just tell me what it is, I think it's version 5.1.1 (give me the download link so we can be sure we are working with the same version of esp-idf).

Thank's.

baldhead69 · 2023-10-25T11:20:57Z

@mythbuster5 ,

you can change the latest stable version of esp idf.

I download the latest stable version, just tell me what it is, I think it's version 5.1.1 (give me the download link so we can be sure we are working with the same version of esp-idf).

@mythbuster5 ,

Completed ?

baldhead69 · 2023-10-25T18:20:53Z

please reopen this issue

mythbuster5 · 2023-10-31T04:19:07Z

Please pick this commit to your branch 6cea72b The backport on 5.1 has not been arrived.

baldhead69 · 2023-10-31T11:27:48Z

Work on latest stable version ?

I think latest stable version is v5.1.1

baldhead69 · 2023-11-07T13:57:47Z

@mythbuster5,

I updated esp-idf to v5.2-dev-3775-gb4268c874a and got errors yet.

@igrr, could you help me with this issue ?

Closes #11903

baldhead69 · 2023-11-08T14:14:04Z

Hi,

Someone can open this issue again, since this hasn't been solved yet.

Closes #11903

baldhead69 · 2023-11-14T13:24:20Z

?????????

ginkgm · 2023-11-15T03:17:01Z

Hi @baldhead69

5.1.2 is going to be released soon, you may wait for that.

Closes #11903

baldhead69 · 2023-11-23T23:23:04Z

@mythbuster5 and @igrr and @ginkgm ,

I want to know why this issue was not reopened ???

Open this issue again, please.

This issue is not solved yet.

I have already asked to reopen this issue several times, I don't know why espressif team closed this issue

Close the issue when i confirm that the solution worked.

I downloaded esp-idf v5.1.2 and the SAME problem persists.

ESP-ROM:esp32s3-20210327
Build:Mar 27 2021
rst:0x3 (RTC_SW_SYS_RST),boot:0x18 (SPI_FAST_FLASH_BOOT)
Saved PC:0x40379c47
0x40379c47: esp_restart_noos_dig at C:/esp-idf/components/esp_system/port/esp_system_chip.c:57 (discriminator 1)

SPIWP:0xee
Octal Flash Mode Enabled
For OPI Flash, Use Default Flash Boot Mode
mode:SLOW_RD, clock div:1
load:0x3fce3818,len:0x17fc
load:0x403c9700,len:0x4
load:0x403c9704,len:0xcb4
load:0x403cc700,len:0x3008
entry 0x403c9984
I (38) boot: ESP-IDF v5.1.2 2nd stage bootloader
I (38) boot: compile time Nov 23 2023 19:31:29
I (38) boot: Multicore bootloader
I (41) boot: chip revision: v0.1
I (45) boot.esp32s3: Boot SPI Speed : 80MHz
I (49) boot.esp32s3: SPI Mode       : SLOW READ
I (55) boot.esp32s3: SPI Flash Size : 32MB
I (59) boot: Enabling RNG early entropy source...
I (65) boot: Partition Table:
I (68) boot: ## Label            Usage          Type ST Offset   Length
I (76) boot:  0 nvs              WiFi data        01 02 00009000 00006000
I (83) boot:  1 otadata          OTA data         01 00 0000f000 00002000
I (91) boot:  2 ota_0            OTA app          00 10 00020000 00fe7000
I (98) boot:  3 ota_1            OTA app          00 11 01010000 00fe7000
I (106) boot: End of partition table
E (110) esp_image: image at 0x1010000 has invalid magic byte (nothing flashed here?)
E (118) boot: OTA app partition slot 1 is not bootable
I (124) esp_image: segment 0: paddr=00020020 vaddr=3c0c0020 size=86c20h (551968) map
I (257) esp_image: segment 1: paddr=000a6c48 vaddr=3fc9d000 size=05678h ( 22136) load
I (263) esp_image: segment 2: paddr=000ac2c8 vaddr=40378000 size=03d50h ( 15696) load
I (267) esp_image: segment 3: paddr=000b0020 vaddr=42000020 size=bb358h (766808) map
I (444) esp_image: segment 4: paddr=0016b380 vaddr=4037bd50 size=11290h ( 70288) load
I (470) boot: Loaded app from partition at offset 0x20000

Spritetm · 2023-11-24T06:56:35Z

Reopened as apparently this is not fixed yet.

baldhead69 · 2023-11-28T23:55:33Z

Considering that my idea is to divide the 32 MB memory into two 16 MB partitions and that for accessing the first 16 MB only need 3 bytes of address ( 2^24 = 16.777.216 -> 0 to 16.777.215 ), 16.777.215 = 11111111 11111111 11111111 and for acessing 32 MB only need 25 bits ( 2^25 = 33.554.432 -> 0 to 33.554.431 ), 33.554.431 = 0001 11111111 11111111 11111111, means that only bit 24 changes the value when accessing the two partitions.

For performance reasons, wouldn't there be a way (command on flash memory) informing the memory that which partition will be accessed in that moment, ie: 0 - 16MB or 16MB-32MB ?

This way only need to send 3 bytes of address to memory instead of 4 bytes.

Closes espressif#11903

baldhead69 · 2023-12-20T22:01:20Z

@Spritetm ,

Do you have some position on this ?

Thanks.

igrr · 2023-12-20T22:30:12Z

The fix on release/v5.1 branch is linked above — bb7544e. This commit is not in v5.1.2 release, it will be included in v5.1.3.

baldhead69 · 2023-12-20T22:44:03Z

@igrr

I have version 5.1.2.

How do I use this commit in version 5.1.2 ?

"c:\esp-idf>git cherry-pick -n bb7544e"    ???

"c:\esp-idf>git cherry-pick bb7544e65aba750aad7dfd641a2b166b9e0a2ffe"    ???

baldhead69 · 2023-12-25T16:27:47Z

????

baldhead69 · 2024-01-04T07:40:43Z

@igrr

igrr · 2024-01-04T09:20:32Z

@baldhead69 Please try this:

git cherry-pick bb7544e
git cherry-pick 8f6213c9

(the 2nd commit is the fix for the compilation issue reported in #12850, linked above)

baldhead69 · 2024-01-10T20:31:52Z

@igrr

baldhead69 · 2024-01-10T20:34:14Z

The fix on release/v5.1 branch is linked above — bb7544e. This commit is not in v5.1.2 release, it will be included in v5.1.3.

Is esp_idf v5.1.3 already available ?

baldhead69 · 2024-01-11T03:25:02Z

fetch.txt

I tried this:
fatal: bad revision while cherry-picking a commit!
This happens when your local git remains oblivious of the existence of the commit. To fix this, fetch all the branches, and then cherry-pick again.

From here:
https://blog.mayadata.io/openebs/avoiding-git-panic-part-i-novice#:~:text=fatal%3A%20bad%20revision%20while%20cherry,and%20then%20cherry%2Dpick%20again.

But not worked.

baldhead69 · 2024-02-08T00:35:22Z

The ota is working now.

Solution here:
https://www.esp32.com/viewtopic.php?f=13&t=37734

Alvin1Zhang · 2024-02-08T07:01:26Z

Thanks for sharing the feedback, feel free to reopen.

Closes espressif#11903

espressif-bot added the Status: Opened Issue is new label Jul 19, 2023

github-actions bot changed the title ~~OTA invalid magic byte~~ OTA invalid magic byte (IDFGH-10674) Jul 19, 2023

baldhead69 mentioned this issue Oct 11, 2023

Ping timeout (IDFGH-10552) #11792

Closed

3 tasks

espressif-bot closed this as completed in 6cea72b Oct 25, 2023

baldhead69 mentioned this issue Oct 30, 2023

High level style of string manipulation in c language (IDFGH-10764) #11980

Closed

espressif-bot pushed a commit that referenced this issue Nov 8, 2023

fix(ota): Fixed OTA fail on octal flash with 32MB memory,

643b0ab

Closes #11903

espressif-bot pushed a commit that referenced this issue Nov 14, 2023

fix(ota): Fixed OTA fail on octal flash with 32MB memory,

f5e80b6

Closes #11903

igrr pushed a commit that referenced this issue Nov 16, 2023

fix(ota): Fixed OTA fail on octal flash with 32MB memory,

bb7544e

Closes #11903

Spritetm reopened this Nov 24, 2023

movsb pushed a commit to movsb/esp-idf that referenced this issue Dec 1, 2023

fix(ota): Fixed OTA fail on octal flash with 32MB memory,

bc420c9

Closes espressif#11903

huming2207 mentioned this issue Dec 21, 2023

Cannot build bootloader on IDFv5.1 for ESP32S3 + 32MB OSPI flash due to bootloader API missing (IDFGH-11748) #12850

Closed

3 tasks

espressif-bot added Status: Done Issue is done internally Resolution: Done Issue is done internally and removed Status: Opened Issue is new labels Feb 8, 2024

Alvin1Zhang closed this as completed Feb 8, 2024

hathach pushed a commit to adafruit/esp-idf that referenced this issue Mar 27, 2024

fix(ota): Fixed OTA fail on octal flash with 32MB memory,

9a9874d

Closes espressif#11903

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

OTA invalid magic byte (IDFGH-10674) #11903

OTA invalid magic byte (IDFGH-10674) #11903

baldhead69 commented Jul 19, 2023 •

edited

mythbuster5 commented Jul 19, 2023

baldhead69 commented Jul 20, 2023 •

edited

baldhead69 commented Jul 21, 2023 •

edited

ESP32DE commented Aug 1, 2023

baldhead69 commented Aug 1, 2023

mythbuster5 commented Oct 12, 2023

baldhead69 commented Oct 17, 2023 •

edited

mythbuster5 commented Oct 17, 2023

baldhead69 commented Oct 17, 2023

baldhead69 commented Oct 19, 2023 •

edited

baldhead69 commented Oct 25, 2023

baldhead69 commented Oct 25, 2023

mythbuster5 commented Oct 31, 2023

baldhead69 commented Oct 31, 2023

baldhead69 commented Nov 7, 2023

baldhead69 commented Nov 8, 2023

baldhead69 commented Nov 14, 2023

ginkgm commented Nov 15, 2023

baldhead69 commented Nov 23, 2023 •

edited

Spritetm commented Nov 24, 2023

baldhead69 commented Nov 28, 2023 •

edited

baldhead69 commented Dec 20, 2023

igrr commented Dec 20, 2023

baldhead69 commented Dec 20, 2023 •

edited

baldhead69 commented Dec 25, 2023

baldhead69 commented Jan 4, 2024

igrr commented Jan 4, 2024

baldhead69 commented Jan 10, 2024 •

edited

baldhead69 commented Jan 10, 2024

baldhead69 commented Jan 11, 2024

baldhead69 commented Feb 8, 2024

Alvin1Zhang commented Feb 8, 2024

OTA invalid magic byte (IDFGH-10674) #11903

OTA invalid magic byte (IDFGH-10674) #11903

Comments

baldhead69 commented Jul 19, 2023 • edited

Answers checklist.

General issue report

mythbuster5 commented Jul 19, 2023

baldhead69 commented Jul 20, 2023 • edited

baldhead69 commented Jul 21, 2023 • edited

ESP32DE commented Aug 1, 2023

baldhead69 commented Aug 1, 2023

mythbuster5 commented Oct 12, 2023

baldhead69 commented Oct 17, 2023 • edited

mythbuster5 commented Oct 17, 2023

baldhead69 commented Oct 17, 2023

baldhead69 commented Oct 19, 2023 • edited

baldhead69 commented Oct 25, 2023

baldhead69 commented Oct 25, 2023

mythbuster5 commented Oct 31, 2023

baldhead69 commented Oct 31, 2023

baldhead69 commented Nov 7, 2023

baldhead69 commented Nov 8, 2023

baldhead69 commented Nov 14, 2023

ginkgm commented Nov 15, 2023

baldhead69 commented Nov 23, 2023 • edited

Spritetm commented Nov 24, 2023

baldhead69 commented Nov 28, 2023 • edited

baldhead69 commented Dec 20, 2023

igrr commented Dec 20, 2023

baldhead69 commented Dec 20, 2023 • edited

baldhead69 commented Dec 25, 2023

baldhead69 commented Jan 4, 2024

igrr commented Jan 4, 2024

baldhead69 commented Jan 10, 2024 • edited

baldhead69 commented Jan 10, 2024

baldhead69 commented Jan 11, 2024

baldhead69 commented Feb 8, 2024

Alvin1Zhang commented Feb 8, 2024

baldhead69 commented Jul 19, 2023 •

edited

baldhead69 commented Jul 20, 2023 •

edited

baldhead69 commented Jul 21, 2023 •

edited

baldhead69 commented Oct 17, 2023 •

edited

baldhead69 commented Oct 19, 2023 •

edited

baldhead69 commented Nov 23, 2023 •

edited

baldhead69 commented Nov 28, 2023 •

edited

baldhead69 commented Dec 20, 2023 •

edited

baldhead69 commented Jan 10, 2024 •

edited