ARV752DPW Lantiq XWay Major Version Upgrade to 23 bricks device

[Yemtex]

Describe the bug

Hi,

after upgrading from version 22.03.6 to 23.05 my Arcadyan ARV752DPW (Easybox 802) was bricked.
https://openwrt.org/toh/arcadyan/arv752dpw

I connected a serial cable to it.
When booting the new OpenWrt Image (23.05.*), I get the following output. The devices just hangs and does nothing else, like it froze. No serial input accepted. Needs full device restart.

U-Boot 2010.03 (Apr 09 2012 - 01:10:47)

Board: ARV752DPW
SoC: Danube/Twinpass/Vinax-VE V1.5, DDR Speed 166 MHz, CPU Speed 333 MHz
DRAM:  64 MB
Flash:  8 MB
*** Warning - bad CRC, using default environment

Net:   
searching for rtl8306 switch ... found
Reset Hard
Done
Reset Soft
Success

lq_cpe_eth
Hit any key to stop autoboot:  0 
## Booting kernel from Legacy Image at b0020000 ...
   Image Name:   MIPS OpenWrt Linux-5.15.137
   Created:      2023-11-14  13:38:11 UTC
   Image Type:   MIPS Linux Kernel Image (lzma compressed)
   Data Size:    2726841 Bytes =  2.6 MB
   Load Address: 80002000
   Entry Point:  80002000
   Verifying Checksum ... OK
   Uncompressing Kernel Image ... OK

Starting kernel ...

[    0.000000] Linux version 5.15.137 (builder@buildhost) (mips-openwrt-linux-musl-gcc (OpenWrt GCC 12.3.0 r23630-842932a63d) 12.3.0, GNU ld (GNU Binutils) 2.40.0) #0 SMP Tue Nov 14 13:38:11 2023
[    0.000000] SoC: Danube rev 1.5
[    0.000000] printk: bootconsole [early0] enabled
[    0.000000] CPU0 revision is: 00019641 (MIPS 24KEc)
[    0.000000] MIPS: machine is Arcor 802
[    0.000000] Initrd not found or empty - disabling initrd

Can you please help me, getting the new firmware to run.

OpenWrt version

r23630-842932a63d

OpenWrt release

23.05.2

OpenWrt target/subtarget

lantiq/xway

Device

Arcor 802

Image kind

Official downloaded image

Steps to reproduce

1. Copy image via tftpboot to RAM
2. Erase flash memory
3. Copy image from RAM to flash storage
4. Reset u-boot
5. Let OpenWrt start

Actual behaviour

1. Device starts normally.
2. Bootloader start OpenWrt Image
3. Device freezes

Expected behaviour

OpenWrt boots up.

Additional info

No response

Diffconfig

No response

Terms

• I am reporting an issue for OpenWrt, not an unsupported fork.

[brada4]

Please get back to v22, issue is already documented:
https://openwrt.org/toh/arcadyan/arv752dpw

[Yemtex]

I did that. I updated the documentation for other people, so they don't have to struggle.

[action-server]

I have a spare Arcadyan ARV7506PW11 that doesn't work with openwrt version 23 and up.
Serial console with u-boot shows following message:

*** Warning - bad CRC, using default environment
...
...
...
Starting kernel ...

[ 0.000000] Linux version 5.15.145 (builder@buildhost) (mips-openwrt-linux-musl-gcc (OpenWrt GCC 12.3.0 r24698-b799dd3c70) 12.3.0, GNU ld (GNU Binutils) 2.40.0) #0 SMP Wed Dec 27 15:01:30 2023
[ 0.000000] SoC: Danube rev 1.5
[ 0.000000] printk: bootconsole [early0] enabled
[ 0.000000] CPU0 revision is: xxxxxxx (MIPS 24KEc)
[ 0.000000] MIPS: machine is Alice/O2 IAD 4421
[ 0.000000] Initrd not found or empty - disabling initrd

Will be using lower versions in the meantime

[brada4]

check in v22 if 4x64k growth in v23 depletes rootfs_data to under 320k meaning likely first boot config cannot be written. Though should not die thst early.

[Yemtex]

Just for your info. I also have a https://openwrt.org/toh/t-com/speedport_w_504v with the same architecture.

[Yemtex]

check in v22 if 4x64k growth in v23 depletes rootfs_data to under 320k meaning likely first boot config cannot be written. Though should not die thst early.

Im sorry, but could you explain what you mean with 4x64k?
What should I do?

[brada4]

cat /proc/mtd
i believe flash eraseblocks are 64k in size, so check 256k firmware growth still leaves 320k free for jffs overlay. I.e. if jffs /overlay is at least 576k in size in v22.

[Yemtex]

okey.

root@EasyBox802:~# cat /proc/mtd
dev:    size   erasesize  name
mtd0: 00010000 00002000 "uboot"
mtd1: 00010000 00010000 "u-boot-env"
mtd2: 007d0000 00010000 "firmware"
mtd3: 002633e1 00010000 "kernel"
mtd4: 0056cc1f 00010000 "rootfs"
mtd5: 00110000 00010000 "rootfs_data"
mtd6: 00010000 00010000 "board_config"
root@EasyBox802:~# df -h
Filesystem                Size      Used Available Use% Mounted on
/dev/root                 4.5M      4.5M         0 100% /rom
tmpfs                    27.7M    236.0K     27.4M   1% /tmp
/dev/mtdblock5            1.1M    252.0K    836.0K  23% /overlay
overlayfs:/overlay        1.1M    252.0K    836.0K  23% /
tmpfs                   512.0K         0    512.0K   0% /dev
root@EasyBox802:~#

I want to learn more about this. What documentation could help me understand more about what you are talking?

[brada4]

linux-mtd project etc...
64k erase block size., and in this regard enough space for upgrade.

[Yemtex]

Okey, nice to know.
So how can I proceed to debug this and maybe give this issue enough info?

[Yemtex]

Related issues: #13934 and #13891

[brada4]

seems about right, neither case overfills flash space leading to freeze or no conf persistance later.

[Yemtex]

What could I try next, do you have any ideas?
Thanks in advance.

[brada4]

should be smp and ram detection right after

[abajk]

Reverting smp patch fixes this issue?

[zuzia-dev]

Reverting smp patch fixes this issue?

Yes. The image uploads properly.

ROM VER: 1.0.3
CFG 01
Read EEPROMX
 X


U-Boot 2010.03 (May 11 2012 - 02:54:15)

Board: ARV4518PW
SoC: Danube/Twinpass/Vinax-VE V1.5, DDR Speed 166 MHz, CPU Speed 333 MHz
DRAM:  64 MB
Flash:  8 MB
*** Warning - bad CRC, using default environment

Net:   
searching for rtl8306 switch ... found
lq_cpe_eth
Hit any key to stop autoboot:  0 
## Booting kernel from Legacy Image at b0020000 ...
   Image Name:   MIPS OpenWrt Linux-5.15.139
   Created:      2023-12-28  13:27:49 UTC
   Image Type:   MIPS Linux Kernel Image (lzma compressed)
   Data Size:    2586472 Bytes =  2.5 MB
   Load Address: 80002000
   Entry Point:  80002000
   Verifying Checksum ... OK
   Uncompressing Kernel Image ... OK

Starting kernel ...

[    0.000000] Linux version 5.15.139 (EASYBOX@zuzia-dev) (mips-openwrt-linux-musl-gcc (OpenWrt GCC 12.3.0 r23674-60e49cf170) 12.3.0, GNU ld (GNU Binutils) 2.40.0) #0 Thu Dec 28 13:27:49 2023
[    0.000000] SoC: Danube rev 1.5
[    0.000000] printk: bootconsole [early0] enabled
[    0.000000] CPU0 revision is: 00019641 (MIPS 24KEc)
[    0.000000] MIPS: machine is Arcor 802
[    0.000000] Initrd not found or empty - disabling initrd
[    0.000000] Primary instruction cache 16kB, VIPT, 4-way, linesize 32 bytes.
[    0.000000] Primary data cache 16kB, 4-way, VIPT, no aliases, linesize 32 bytes
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000000000000-0x0000000003ffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000000003ffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x0000000003ffffff]
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 16240
[    0.000000] Kernel command line: console=ttyLTQ0,115200
[    0.000000] Dentry cache hash table entries: 8192 (order: 3, 32768 bytes, linear)
[    0.000000] Inode-cache hash table entries: 4096 (order: 2, 16384 bytes, linear)
[    0.000000] Writing ErrCtl register=0006bf50
[    0.000000] Readback ErrCtl register=0006bf50
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 55148K/65536K available (6324K kernel code, 604K rwdata, 1356K rodata, 1172K init, 213K bss, 10388K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] NR_IRQS: 256
[    0.000000] CPU Clock: 333MHz
[    0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 11467562657 ns
[    0.000004] sched_clock: 32 bits at 166MHz, resolution 6ns, wraps every 12884901885ns
[    0.008134] Calibrating delay loop... 221.18 BogoMIPS (lpj=1105920)
[    0.094350] pid_max: default: 32768 minimum: 301
[    0.101848] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.109127] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.140367] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.150175] futex hash table entries: 256 (order: -1, 3072 bytes, linear)
[    0.157382] pinctrl core: initialized pinctrl subsystem
[    0.166927] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.200072] pinctrl-xway 1e100b10.pinmux: Init done
[    0.214976] dma-xway 1e104100.dma: Init done - hw rev: 3, ports: 5, channels: 20
[    0.262032] usbcore: registered new interface driver usbfs
[    0.267668] usbcore: registered new interface driver hub
[    0.273017] usbcore: registered new device driver usb
[    0.280774] PCI host bridge to bus 0000:00
[    0.284746] pci_bus 0000:00: root bus resource [mem 0x18000000-0x19ffffff]
[    0.291766] pci_bus 0000:00: root bus resource [io  0x1ae00000-0x1affffff]
[    0.298629] pci_bus 0000:00: No busn resource found for root bus, will use [bus 00-ff]
[    0.308447] pci 0000:00:0e.0: [1814:0601] type 00 class 0x028000
[    0.314380] pci 0000:00:0e.0: reg 0x10: [mem 0xffff0000-0xffffffff]
[    0.320909] pci 0000:00:0e.0: PME# supported from D0 D3hot D3cold
[    0.329587] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to 00
[    0.336194] pci 0000:00:0e.0: BAR 0: assigned [mem 0x18000000-0x1800ffff]
[    0.343869] clocksource: Switched to clocksource MIPS
[    0.352950] NET: Registered PF_INET protocol family
[    0.358380] IP idents hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.367317] tcp_listen_portaddr_hash hash table entries: 512 (order: 0, 4096 bytes, linear)
[    0.375698] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.383407] TCP established hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.391214] TCP bind hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.398322] TCP: Hash tables configured (established 1024 bind 1024)
[    0.405071] UDP hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.411526] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.419675] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.425464] PCI: CLS 0 bytes, default 32
[    0.429365] gptu: totally 6 16-bit timers/counters
[    0.434413] gptu: misc_register on minor 127
[    0.438602] gptu: succeeded to request irq 126
[    0.443106] gptu: succeeded to request irq 127
[    0.447725] gptu: succeeded to request irq 128
[    0.452242] gptu: succeeded to request irq 129
[    0.456747] gptu: succeeded to request irq 130
[    0.461160] gptu: succeeded to request irq 131
[    0.472417] lantiq,vmmc 1f107000.vmmc: requested GPIO 465
[    0.477808] lantiq,vmmc 1f107000.vmmc: reserved 1MB at 0x(ptrval)
[    0.496762] workingset: timestamp_bits=14 max_order=14 bucket_order=0
[    0.521944] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.527765] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[    0.548267] 1e100c00.serial: ttyLTQ0 at MMIO 0x1e100c00 (irq = 112, base_baud = 0) is a lantiq,asc
[    0.557265] printk: console [ttyLTQ0] enabled
[    0.557265] printk: console [ttyLTQ0] enabled
[    0.565719] printk: bootconsole [early0] disabled
[    0.565719] printk: bootconsole [early0] disabled
[    0.577598] lantiq nor flash device: 00800000 at 10000000
[    0.581790] ltq_nor: Found 1 x16 devices at 0x0 in 16-bit bank. Manufacturer ID 0x0000c2 Chip ID 0x0022cb
[    0.590975] Amd/Fujitsu Extended Query Table at 0x0040
[    0.595878]   Amd/Fujitsu Extended Query version 1.1.
[    0.600646] number of CFI chips: 1
[    0.604196] 4 fixed-partitions partitions found on MTD device ltq_nor
[    0.611742] Creating 4 MTD partitions on "ltq_nor":
[    0.615208] 0x000000000000-0x000000010000 : "uboot"
[    0.639507] 0x000000010000-0x000000020000 : "u-boot-env"
[    0.646294] 0x000000020000-0x0000007f0000 : "firmware"
[    0.655846] 2 uimage-fw partitions found on MTD device firmware
[    0.660240] 0x000000020000-0x0000002977a8 : "kernel"
[    0.665163] mtd: partition "kernel" doesn't end on an erase/write block -- force read-only
[    0.677374] 0x0000002977a8-0x0000007f0000 : "rootfs"
[    0.680824] mtd: partition "rootfs" doesn't start on an erase/write block boundary -- force read-only
[    0.692311] mtd: setting mtd4 (rootfs) as root device
[    0.696077] 1 squashfs-split partitions found on MTD device rootfs
[    0.701844] 0x0000006c0000-0x0000007f0000 : "rootfs_data"
[    0.713126] 0x0000007f0000-0x000000800000 : "board_config"
[    0.825469] Registering RTL8306SDM switch with Chip ID: 0x5988, version: 0x0000
[    0.831260] Realtek RTL8306S 1e180000.etop-ffffffff:00: attached PHY driver (mii_bus:phy_addr=1e180000.etop-ffffffff:00, irq=POLL)
[    0.856011] NET: Registered PF_INET6 protocol family
[    0.892068] Segment Routing with IPv6
[    0.894597] In-situ OAM (IOAM) with IPv6
[    0.898291] NET: Registered PF_PACKET protocol family
[    0.903199] 8021q: 802.1Q VLAN Support v1.8
[    0.948797] VFS: Mounted root (squashfs filesystem) readonly on device 31:4.
[    0.961643] Freeing unused kernel image (initmem) memory: 1172K
[    0.966133] This architecture does not have kernel memory protection.
[    0.972294] Run /sbin/init as init process
[    2.562689] init: Console is alive
[    2.565673] init: - watchdog -
[    6.436773] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[    6.796853] SCSI subsystem initialized
[    6.829700] dwc2 1e101000.usb: supply vusb_d not found, using dummy regulator
[    6.836167] dwc2 1e101000.usb: supply vusb_a not found, using dummy regulator
[    6.884646] dwc2 1e101000.usb: DWC OTG Controller
[    6.887986] dwc2 1e101000.usb: new USB bus registered, assigned bus number 1
[    6.894845] dwc2 1e101000.usb: irq 62, io mem 0x1e101000
[    6.902489] hub 1-0:1.0: USB hub found
[    6.906484] hub 1-0:1.0: 1 port detected
[    6.925337] usbcore: registered new interface driver usb-storage
[    6.932316] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[    6.949032] init: - preinit -
[    7.275810] dwc2 1e101000.usb: Mode Mismatch Interrupt: currently in Host mode
[    7.281502] dwc2 1e101000.usb: Mode Mismatch Interrupt: currently in Host mode
[    7.832322] usb 1-1: new high-speed USB device number 2 using dwc2
[    7.837298] dwc2 1e101000.usb: Mode Mismatch Interrupt: currently in Host mode
[    7.844092] dwc2 1e101000.usb: Mode Mismatch Interrupt: currently in Host mode
[    8.415928] hub 1-1:1.0: USB hub found
[    8.418399] hub 1-1:1.0: 4 ports detected
[    8.934635] random: procd: uninitialized urandom read (4 bytes read)
[    9.560095] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
Press the [f] key and hit [enter] to enter failsafe mode
Press the [1], [2], [3] or [4] key and hit [enter] to select the debug level
[    9.814059] random: crng init done
[   12.060337] mount_root: jffs2 not ready yet, using temporary tmpfs overlay
[   12.109878] urandom-seed: Seed file not found (/etc/urandom.seed)
[   12.428489] procd: - early -
[   12.430615] procd: - watchdog -
[   13.582038] procd: - watchdog -
[   13.585957] procd: - ubus -
[   13.775123] procd: - init -
Please press Enter to activate this console.
[   17.908805] kmodloader: loading kernel modules from /etc/modules.d/*
[   19.062448] IFXOS, Version 1.7.1 (c) Copyright 2009, Lantiq Deutschland GmbH
[   19.112371] Lantiq TAPI device driver, version 3.13.0.2, (c) 2001-2010 Lantiq Deutschland GmbH
[   19.143539] NET: Registered PF_ATMPVC protocol family
[   19.147229] NET: Registered PF_ATMSVC protocol family
[   19.200939] PPP generic driver version 2.4.2
[   19.281435] IFX MEI Version 5.00.00
[   19.345024] Infineon CPE API Driver version: DSL CPE API V3.24.4.4
[   19.416679] Loading modules backported from Linux version v6.1.24-0-g0102425ac76b
[   19.422609] Backport generated by backports.git v5.15.92-1-44-gd6ea70fafd36
[   19.484168] Lantiq MIPS24KEc MPS driver, version 2.2.2.5, (c) 2006-2010 Lantiq Deutschland GmbH
[   19.491340] request_timer(3, 0x000001AE, 1)...
[   19.491405] successful!
[   19.498668] Lantiq VMMC device driver, version 1.9.0.3, (c) 2006-2010 Lantiq Deutschland GmbH
[   19.596446] NET: Registered PF_PPPOX protocol family
[   19.629836] usbcore: registered new interface driver usbserial_generic
[   19.635251] usbserial: USB Serial support registered for generic
[   19.687526] usbcore: registered new interface driver cdc_ether
[   21.218280] usbcore: registered new interface driver rndis_host
[   21.310812] usbcore: registered new interface driver option
[   21.315322] usbserial: USB Serial support registered for GSM modem (1-port)
[   21.403355] rt2800pci 0000:00:0e.0: enabling device (0000 -> 0002)
[   21.409507] rt2800pci 0000:00:0e.0: loaded eeprom from mtd device "board_config"
[   21.415472] ieee80211 phy0: rt2x00_set_rt: Info - RT chipset 2860, rev 0103 detected
[   21.423092] ieee80211 phy0: rt2x00_set_rf: Info - RF chipset 0001 detected
[   21.674833] kmodloader: done loading kernel modules from /etc/modules.d/*
[   29.355060] urngd: v1.0.2 started.
[  215.031859] jffs2_scan_eraseblock(): End of filesystem marker found at 0x0
[  215.074088] jffs2_build_filesystem(): unlocking the mtd device... 
[  215.074129] done.
[  215.080602] jffs2_build_filesystem(): erasing all blocks after the end marker... 
[  223.867057] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  223.917119] br-lan: port 1(eth0.1) entered blocking state
[  223.921040] br-lan: port 1(eth0.1) entered disabled state
[  223.927360] device eth0.1 entered promiscuous mode
[  223.930913] device eth0 entered promiscuous mode
[  223.994176] br-lan: port 1(eth0.1) entered blocking state
[  223.998129] br-lan: port 1(eth0.1) entered forwarding state
[  224.914916] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
[  231.054194] done.
[  231.054734] jffs2: notice: (1542) jffs2_build_xattr_subsystem: complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan) and 0 of xref (0 dead, 0 orphan) found.
[  231.900997] overlayfs: upper fs does not support tmpfile.

DISTRIB_ID='OpenWrt'
DISTRIB_RELEASE='23.05-SNAPSHOT'
DISTRIB_REVISION='r23674-60e49cf170'
DISTRIB_TARGET='lantiq/xway'
DISTRIB_ARCH='mips_24kc'
DISTRIB_DESCRIPTION='OpenWrt 23.05-SNAPSHOT r23674-60e49cf170'
DISTRIB_TAINTS='no-all busybox'

dev:    size   erasesize  name
mtd0: 00010000 00002000 "uboot"
mtd1: 00010000 00010000 "u-boot-env"
mtd2: 007d0000 00010000 "firmware"
mtd3: 002777a8 00010000 "kernel"
mtd4: 00558858 00010000 "rootfs"
mtd5: 00130000 00010000 "rootfs_data"
mtd6: 00010000 00010000 "board_config"

[action-server]

Reverting smp patch fixes this issue?

I cant also confirm reverting that patch fixed the issue for me.

Will someone merge it into snapshot?

[action-server]

Or rather backport it to stable, cause it bricks aforementioned devices.

[abajk]

Will prepare PR. From what I remember, this change also caused performance degradation on ARX100.