Skip to content

kernel panic with 4.4.0-rc8 #5

@umiddelb

Description

@umiddelb

Under heavy load, the kernel panics from time to time ...

Bad mode in Synchronous Abort handler detected, code 0x86000005 -- IABT (current EL)
CPU: 2 PID: 0 Comm: swapper/2 Not tainted 4.4.0-rc8 #5
Hardware name: Pine64+ (DT)
task: ffffffc0304e7300 ti: ffffffc0304ec000 task.ti: ffffffc0304ec000
PC is at 0x200000
LR is at sched_clock+0x50/0xd8
pc : [<0000000000200000>] lr : [<ffffffc000158788>] pstate: 200001c5
sp : ffffffc0304ef9b0
x29: ffffffc0304ef9b0 x28: 0000000000000002
x27: 0000000000000007 x26: ffffffc000d76988
x25: 0000000001000000 x24: ffffffc03dfd1c80
x23: ffffffc03dfd2530 x22: ffffffc000d76980
x21: 0000000000000000 x20: ffffffc000d3ada0
x19: ffffffc000d76988 x18: 0000007fd3bf0b70
x17: 000000000043b280 x16: ffffffc000240668
x15: ffffffffffffffff x14: 0000000000000000
x13: 0000000000000000 x12: 0000000000000000
x11: 1ffffff805f1df8a x10: 1ffffff807bf9e33
x9 : ffffff8807bf9e33 x8 : dfffff9000000000
x7 : 0000000000000000 x6 : 00225510229b6000
x5 : dfffff9000000000 x4 : 0000000000000000
x3 : 00000000f4f4f404 x2 : 1ffffff8001aed34
x1 : dfffff9000000000 x0 : 0000000000200000

Internal error: Oops - bad mode: 0 [#1] PREEMPT SMP
Modules linked in:
CPU: 2 PID: 0 Comm: swapper/2 Not tainted 4.4.0-rc8 #5
Hardware name: Pine64+ (DT)
task: ffffffc0304e7300 ti: ffffffc0304ec000 task.ti: ffffffc0304ec000
PC is at 0x200000
LR is at sched_clock+0x50/0xd8
pc : [<0000000000200000>] lr : [<ffffffc000158788>] pstate: 200001c5
sp : ffffffc0304ef9b0
x29: ffffffc0304ef9b0 x28: 0000000000000002
x27: 0000000000000007 x26: ffffffc000d76988
x25: 0000000001000000 x24: ffffffc03dfd1c80
x23: ffffffc03dfd2530 x22: ffffffc000d76980
x21: 0000000000000000 x20: ffffffc000d3ada0
x19: ffffffc000d76988 x18: 0000007fd3bf0b70
x17: 000000000043b280 x16: ffffffc000240668
x15: ffffffffffffffff x14: 0000000000000000
x13: 0000000000000000 x12: 0000000000000000
x11: 1ffffff805f1df8a x10: 1ffffff807bf9e33
x9 : ffffff8807bf9e33 x8 : dfffff9000000000
x7 : 0000000000000000 x6 : 00225510229b6000
x5 : dfffff9000000000 x4 : 0000000000000000
x3 : 00000000f4f4f404 x2 : 1ffffff8001aed34
x1 : dfffff9000000000 x0 : 0000000000200000

Process swapper/2 (pid: 0, stack limit = 0xffffffc0304ec020)
Stack: (0xffffffc0304ef9b0 to 0xffffffc0304f0000)
f9a0:                                   ffffffc0304efa10 ffffffc0001041d8
f9c0: ffffffc03dfd1c80 ffffffc000d3ada0 0000000000000002 00000000ffff56b8
f9e0: ffffffc03dfd2530 ffffffc03dfd1c80 0000000000000000 0000000000000002
fa00: 0000000000000007 ffffffc0000ce228 ffffffc0304efa20 ffffffc0000f8f84
fa20: ffffffc0304efa50 ffffffc0000f9218 ffffffc03dfd1c80 ffffffc000d3ada0
fa40: 0000000000000002 ffffffc0000f9208 ffffffc0304efa70 ffffffc000107494
fa60: ffffffc03dfd1c80 ffffffc000107470 ffffffc0304efb30 ffffffc0001128d0
fa80: ffffffc000d1fc80 ffffffc000d3a300 ffffffc000d3ada0 00000000ffff56b8
faa0: 1ffffff80609df78 ffffffc03dfd1c80 0000000000000000 0000000000000002
fac0: 0000000000000007 0000000000000002 ffffffc0304e7300 0000000000000002
fae0: 0000000000000001 ffffffc000d3adb0 ffffffc0008d3f40 0000000000000140
fb00: ffffffc03dfd1c80 ffffffc0304efb00 ffffffc0304efb30 ffffffc0000fe908
fb20: ffffffc0304efb30 ffffffc0001128bc ffffffc0304efc20 ffffffc000112e88
fb40: ffffffc000d1fc80 000000003d2b2000 ffffffc03dfd1c80 0000000000000002
fb60: ffffffc03dfd1c80 00000000ffff56b8 ffffffc000d3a000 000000003d2b2000
fb80: 0000000000000007 0000000000000002 ffffffc0304efbb0 ffffffc000143dd0
fba0: ffffffc03dfcdb80 ffffffc000143dc4 ffffffc0304efcb0 ffffffc0000cd7ac
fbc0: 0000000041b58ab3 ffffffc000bed188 ffffffc000112820 ffffffc000d3a200
fbe0: ffffffc000000001 ffffffc0304ec018 0000000000000101 000000003d2b2000
fc00: 0000000000000001 00000000000000a0 ffffffc0304efc20 ffffffc000112ca0
fc20: ffffffc0304efcb0 ffffffc0000cd7ac 0000000000000007 0000000000000028
fc40: ffffffc000d3a238 ffffffc000d3a210 ffffffc0304ec000 ffffffc0304ec018
fc60: 0000000000000101 000000003d2b2000 0000000000000007 0000000000000002
fc80: ffffffc000d3adb0 ffffffc0006e77e8 ffffffc03dfd5200 ffffffc000d1ba38
fca0: ffffffc0304efcb0 ffffffc000000000 ffffffc0304efd50 ffffffc0000cdd2c
fcc0: ffffffc000d3a000 ffffffc000fcb280 0000000000000100 000000003d2b2000
fce0: 0000000000000000 0000000000000001 ffffffc030410000 ffffffc0304efe10
fd00: ffffffc000d3a000 0000000000000002 00200040304efd60 00000000ffff56b9
fd20: ffffffc00000000a ffffffc000d1ddf8 ffffffc000fcb280 ffffffc0304efcb0
fd40: ffffffc000d1ba38 ffffffc000d1ba5c ffffffc0304efd80 ffffffc00012958c
fd60: ffffffc000d1d000 ffffffc000d1ddf8 0000000000000000 000000003d2b2000
fd80: ffffffc0304efdd0 ffffffc000082808 ffffff900001400c ffffffc0304efe10
fda0: ffffffc000d3d000 ffffff9000014010 ffffff9000015000 ffffffc000d1bac0
fdc0: 0000000000000000 ffffffc0304eff60 ffffffc0304eff30 ffffffc0000855a8
fde0: ffffffc0304ec000 ffffffc0008cd680 ffffffc0304eff30 ffffffc0000868a0
fe00: 0000000020000145 ffffffc02f475080 0000000000000000 dfffff9000000000
fe20: 1ffffff80609d800 0000000000000000 0000000000000000 0000000000000018
fe40: 0021dafe229a6600 0000000000000000 ffffffc0304e7ac0 ffffffc0304efe70
fe60: 0000000000000760 1ffffff805f1df8a 0000000000000000 0000000000000000
fe80: 0000000000000000 ffffffffffffffff ffffffc000240668 000000000043b280
fea0: 0000007fd3bf0b70 ffffffc0304ec000 ffffffc0008cd680 ffffffc000d3a000
fec0: ffffffc0304ec01c 0000000000000000 ffffffc000d1bac0 0000000000000000
fee0: ffffffc0304eff60 ffffffc000d3a000 0000000000000002 ffffffc0304eff30
ff00: ffffffc00008689c ffffffc0304eff30 ffffffc0000868a0 0000000020000145
ff20: 00000000000001c0 ffffffc00013b110 ffffffc0304eff40 ffffffc00011c180
ff40: ffffffc0304eff60 ffffffc00011c460 ffffffc0304ec000 ffffffc00011c36c
ff60: ffffffc0304effc0 ffffffc00009097c ffffffc0008bc480 0000000000000002
ff80: 0000000000000002 ffffffc0304e7300 0000000000000000 0000000000000000
ffa0: 0000000042011000 0000000042014000 ffffffc000082b30 0000000000000000
ffc0: 0000000000000000 0000000041082b1c 0000000000000000 0000000000000e11
ffe0: ffffffc000fc8f60 0000000000000000 8204004040800040 0808840410000804
Call trace:
[<0000000000200000>] 0x200000
[<ffffffc0001041d8>] sched_clock_cpu+0x18/0x28
[<ffffffc0000f8f84>] update_rq_clock.part.12+0x24/0x68
[<ffffffc0000f9218>] update_rq_clock+0x28/0x38
[<ffffffc000107494>] update_blocked_averages+0x5c/0x818
[<ffffffc0001128d0>] rebalance_domains+0xb0/0x3f8
[<ffffffc000112e88>] run_rebalance_domains+0x270/0x2c0
[<ffffffc0000cd7ac>] __do_softirq+0x18c/0x310
[<ffffffc0000cdd2c>] irq_exit+0xfc/0x120
[<ffffffc00012958c>] __handle_domain_irq+0x7c/0xe8
[<ffffffc000082808>] gic_handle_irq+0x58/0xa8
Exception stack(0xffffffc0304efde0 to 0xffffffc0304eff00)
fde0: ffffffc0304ec000 ffffffc0008cd680 ffffffc0304eff30 ffffffc0000868a0
fe00: 0000000020000145 ffffffc02f475080 0000000000000000 dfffff9000000000
fe20: 1ffffff80609d800 0000000000000000 0000000000000000 0000000000000018
fe40: 0021dafe229a6600 0000000000000000 ffffffc0304e7ac0 ffffffc0304efe70
fe60: 0000000000000760 1ffffff805f1df8a 0000000000000000 0000000000000000
fe80: 0000000000000000 ffffffffffffffff ffffffc000240668 000000000043b280
fea0: 0000007fd3bf0b70 ffffffc0304ec000 ffffffc0008cd680 ffffffc000d3a000
fec0: ffffffc0304ec01c 0000000000000000 ffffffc000d1bac0 0000000000000000
fee0: ffffffc0304eff60 ffffffc000d3a000 0000000000000002 ffffffc0304eff30
[<ffffffc0000855a8>] el1_irq+0x68/0xd8
[<ffffffc00011c180>] default_idle_call+0x28/0x48
[<ffffffc00011c460>] cpu_startup_entry+0x240/0x290
[<ffffffc00009097c>] secondary_start_kernel+0x17c/0x1a8
[<0000000041082b1c>] 0x41082b1c
Code: bad PC value
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=5247
        (detected by 3, t=5254 jiffies, g=1796, c=1795, q=787)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
systemd[1]: Starting Journal Service...
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=20989
        (detected by 3, t=21009 jiffies, g=1796, c=1795, q=1023)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=36735
        (detected by 3, t=36764 jiffies, g=1796, c=1795, q=1027)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
systemd[1]: systemd-journald.service stop-sigterm timed out. Killing.
systemd[1]: Starting Journal Service...
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=52479
        (detected by 3, t=52519 jiffies, g=1796, c=1795, q=1048)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
systemd[1]: systemd-journald.service still around after SIGKILL. Ignoring.
systemd[1]: Starting Journal Service...
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=68222
        (detected by 3, t=68274 jiffies, g=1796, c=1795, q=1060)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
systemd[1]: systemd-journald.service stop-final-sigterm timed out. Killing.
systemd[1]: Starting Journal Service...
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=83965
        (detected by 3, t=84029 jiffies, g=1796, c=1795, q=1070)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=99711
        (detected by 3, t=99784 jiffies, g=1796, c=1795, q=1074)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
systemd[1]: systemd-journald.service still around after final SIGKILL. Entering failed mode.
systemd[1]: Unit systemd-journald.service entered failed state.
systemd[1]: systemd-journald.service has no holdoff time, scheduling restart.
systemd[1]: Stopping Journal Service...
systemd[1]: Starting Journal Service...
INFO: rcu_sched detected stalls on CPUs/tasks:
        0-...: (1 GPs behind) idle=d09/1/0 softirq=1302/3861 fqs=5253
        2-...: (1 GPs behind) idle=157/2/0 softirq=1341/3334 fqs=5254
        (detected by 3, t=5255 jiffies, g=-93, c=-94, q=1)
Task dump for CPU 0:
swapper/0       R  running task        0     0      0 0x00000002
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=115439
        (detected by 3, t=115539 jiffies, g=1796, c=1795, q=1113)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_sched detected stalls on CPUs/tasks:
        0-...: (1 GPs behind) idle=d09/1/0 softirq=1302/3861 fqs=20997
        2-...: (1 GPs behind) idle=157/2/0 softirq=1341/3334 fqs=20998
        (detected by 3, t=21010 jiffies, g=-93, c=-94, q=1)
Task dump for CPU 0:
swapper/0       R  running task        0     0      0 0x00000002
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=131171
        (detected by 3, t=131294 jiffies, g=1796, c=1795, q=1130)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_sched detected stalls on CPUs/tasks:
        0-...: (1 GPs behind) idle=d09/1/0 softirq=1302/3861 fqs=36741
        2-...: (1 GPs behind) idle=157/2/0 softirq=1341/3334 fqs=36742
        (detected by 3, t=36765 jiffies, g=-93, c=-94, q=1)
Task dump for CPU 0:
swapper/0       R  running task        0     0      0 0x00000002
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=146903
        (detected by 3, t=147049 jiffies, g=1796, c=1795, q=1142)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_sched detected stalls on CPUs/tasks:
        0-...: (1 GPs behind) idle=d09/1/0 softirq=1302/3861 fqs=52485
        2-...: (1 GPs behind) idle=157/2/0 softirq=1341/3334 fqs=52486
        (detected by 3, t=52520 jiffies, g=-93, c=-94, q=1)
Task dump for CPU 0:
swapper/0       R  running task        0     0      0 0x00000002
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=162644
        (detected by 1, t=162802 jiffies, g=1796, c=1795, q=1154)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_sched detected stalls on CPUs/tasks:
        0-...: (1 GPs behind) idle=d09/1/0 softirq=1302/3861 fqs=68225
        2-...: (1 GPs behind) idle=157/2/0 softirq=1341/3334 fqs=68226
        (detected by 3, t=68275 jiffies, g=-93, c=-94, q=1)
Task dump for CPU 0:
swapper/0       R  running task        0     0      0 0x00000002
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=178377
        (detected by 3, t=178559 jiffies, g=1796, c=1795, q=1166)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_sched detected stalls on CPUs/tasks:
        0-...: (1 GPs behind) idle=d09/1/0 softirq=1302/3861 fqs=83969
        2-...: (1 GPs behind) idle=157/2/0 softirq=1341/3334 fqs=83970
        (detected by 3, t=84030 jiffies, g=-93, c=-94, q=1)
Task dump for CPU 0:
swapper/0       R  running task        0     0      0 0x00000002
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)
INFO: rcu_preempt detected stalls on CPUs/tasks:
        2-...: (1 GPs behind) idle=157/2/0 softirq=3334/3334 fqs=194108
        (detected by 3, t=194314 jiffies, g=1796, c=1795, q=1178)
Task dump for CPU 2:
swapper/2       R  running task        0     0      1 0x00000000
Call trace:
[<ffffffc000086ed4>] __switch_to+0xd4/0xf8
[<          (null)>]           (null)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions