WSL keeps crashing on p9_fcall_init

[the-ress]

Version

Microsoft Windows [Version 10.0.22621.457]

WSL Version

• WSL 2
• WSL 1

Kernel Version

5.10.102.1

Distro Version

Ubuntu 20.04

Other Software

VS Code 1.71.0 with Remote-WSL Extension 0.66.3

Repro Steps

I have a project opened in VS code via Remote-WSL. The project is on Windows filesystem.

Expected Behavior

Not crashing

Actual Behavior

WSL2/Linux keeps crashing every ~15-90 minutes as I'm working on the project in VS Code with p9_fcall_init in the stack trace.
(I then get it back up by restarting the LxssManager service.)

Diagnostic Logs

Guest message:
[ 1126.203605] RSP: 0018:ffffc90007af79d8 EFLAGS: 00010202
[ 1126.204180] RAX: 0000000000020000 RBX: 0000000000040000 RCX: 000000000007c42d
[ 1126.205691] RDX: 000000000007c42c RSI: 0000000000000c40 RDI: 0000607e08c050a0
[ 1126.207453] RBP: ffff888100abf0c0 R08: ffffe8ffffc050a0 R09: 0000000000000c40
[ 1126.208236] R10: 0000000000000000 R11: 0000000000000000 R12: 0100006f00000016
[ 1126.209021] R13: 0000000000000000 R14: 0000000000000c40 R15: 000000000000006e
[ 1126.209901] FS:  00007ff61e7fc700(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
[ 1126.210804] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1126.211535] CR2: 00007ff6343c3f90 CR3: 000000018a260002 CR4: 00000000003706b0
[ 1126.212197] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1126.212827] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1126.213530] Call Trace:
[ 1126.213753]  p9_fcall_init.isra.0+0x54/0x70
[ 1126.214072]  p9_client_prepare_req.part.0+0xb1/0x240
[ 1126.214504]  p9_client_rpc+0xa4/0x4f0
[ 1126.214826]  ? idr_alloc_u32+0x8d/0xc0
[ 1126.215142]  p9_client_walk+0x8f/0x210
[ 1126.215513]  ? v9fs_fid_find+0x5b/0x70
[ 1126.215858]  ? v9fs_vfs_lookup.part.0+0x67/0x140
[ 1126.216303]  v9fs_vfs_lookup.part.0+0x67/0x140
[ 1126.216747]  __lookup_slow+0x84/0x140
[ 1126.217119]  walk_component+0x13b/0x1b0
[ 1126.217552]  link_path_walk.part.0+0x221/0x360
[ 1126.218179]  ? path_init+0x2af/0x390
[ 1126.218626]  path_openat+0xad/0xe80
[ 1126.219218]  ? atime_needs_update+0x73/0xd0
[ 1126.219620]  ? touch_atime+0x33/0x100
[ 1126.220006]  do_filp_open+0x91/0x100
[ 1126.220458]  ? __check_object_size+0x136/0x150
[ 1126.221010]  do_sys_openat2+0x222/0x2e0
[ 1126.221561]  do_sys_open+0x44/0x80
[ 1126.222059]  do_syscall_64+0x33/0x80
[ 1126.222840]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 1126.223877] RIP: 0033:0x4039ce
[ 1126.224341] Code: 48 89 6c 24 38 48 8d 6c 24 38 e8 0d 00 00 00 48 8b 6c 24 38 48 83 c4 40 c3 cc cc cc 49 89 f2 48 89 fa 48 89 ce 48 89 df 0f 05 <48> 3d 01 f0 ff ff 76 15 48 f7 d8 48 89 c1 48 c7 c0 ff ff ff ff 48
[ 1126.227081] RSP: 002b:000000c0001fd498 EFLAGS: 00000206 ORIG_RAX: 0000000000000101
[ 1126.228014] RAX: ffffffffffffffda RBX: ffffffffffffff9c RCX: 00000000004039ce
[ 1126.229108] RDX: 0000000000080000 RSI: 000000c0002bf400 RDI: ffffffffffffff9c
[ 1126.230169] RBP: 000000c0001fd4d8 R08: 0000000000000000 R09: 0000000000000000
[ 1126.230772] R10: 0000000000000000 R11: 0000000000000206 R12: 000000c0002bf400
[ 1126.231368] R13: 0000000000000000 R14: 000000c0000061a0 R15: ffffffffffffffff
[ 1126.232098] Modules linked in:
[ 1126.232594] ---[ end trace 0973ddf60a27aa91 ]---
[ 1126.233285] RIP: 0010:kmem_cache_alloc+0xd4/0x3c0
[ 1126.233823] Code: 65 4c 03 05 06 be d6 7e 49 83 78 10 00 4d 8b 20 0f 84 a3 02 00 00 4d 85 e4 0f 84 9a 02 00 00 8b 45 28 48 8d 4a 01 48 8b 7d 00 <49> 8b 1c 04 4c 89 e0 65 48 0f c7 0f 0f 94 c0 84 c0 74 ba 8b 45 28
[ 1126.235519] RSP: 0018:ffffc90007af79d8 EFLAGS: 00010202
[ 1126.236088] RAX: 0000000000020000 RBX: 0000000000040000 RCX: 000000000007c42d
[ 1126.236752] RDX: 000000000007c42c RSI: 0000000000000c40 RDI: 0000607e08c050a0
[ 1126.237888] RBP: ffff888100abf0c0 R08: ffffe8ffffc050a0 R09: 0000000000000c40
[ 1126.239114] R10: 0000000000000000 R11: 0000000000000000 R12: 0100006f00000016
[ 1126.239873] R13: 0000000000000000 R14: 0000000000000c40 R15: 000000000000006e
[ 1126.240742] FS:  00007ff61e7fc700(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
[ 1126.241571] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1126.242190] CR2: 00007ff6343c3f90 CR3: 000000018a260002 CR4: 00000000003706b0
[ 1126.243136] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1126.244217] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1126.244886] Kernel panic - not syncing: Fatal exception
[ 1126.300336] Kernel Offset: disabled

more logs

Guest message:
[ 1126.203605] RSP: 0018:ffffc90007af79d8 EFLAGS: 00010202
[ 1126.204180] RAX: 0000000000020000 RBX: 0000000000040000 RCX: 000000000007c42d
[ 1126.205691] RDX: 000000000007c42c RSI: 0000000000000c40 RDI: 0000607e08c050a0
[ 1126.207453] RBP: ffff888100abf0c0 R08: ffffe8ffffc050a0 R09: 0000000000000c40
[ 1126.208236] R10: 0000000000000000 R11: 0000000000000000 R12: 0100006f00000016
[ 1126.209021] R13: 0000000000000000 R14: 0000000000000c40 R15: 000000000000006e
[ 1126.209901] FS:  00007ff61e7fc700(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
[ 1126.210804] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1126.211535] CR2: 00007ff6343c3f90 CR3: 000000018a260002 CR4: 00000000003706b0
[ 1126.212197] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1126.212827] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1126.213530] Call Trace:
[ 1126.213753]  p9_fcall_init.isra.0+0x54/0x70
[ 1126.214072]  p9_client_prepare_req.part.0+0xb1/0x240
[ 1126.214504]  p9_client_rpc+0xa4/0x4f0
[ 1126.214826]  ? idr_alloc_u32+0x8d/0xc0
[ 1126.215142]  p9_client_walk+0x8f/0x210
[ 1126.215513]  ? v9fs_fid_find+0x5b/0x70
[ 1126.215858]  ? v9fs_vfs_lookup.part.0+0x67/0x140
[ 1126.216303]  v9fs_vfs_lookup.part.0+0x67/0x140
[ 1126.216747]  __lookup_slow+0x84/0x140
[ 1126.217119]  walk_component+0x13b/0x1b0
[ 1126.217552]  link_path_walk.part.0+0x221/0x360
[ 1126.218179]  ? path_init+0x2af/0x390
[ 1126.218626]  path_openat+0xad/0xe80
[ 1126.219218]  ? atime_needs_update+0x73/0xd0
[ 1126.219620]  ? touch_atime+0x33/0x100
[ 1126.220006]  do_filp_open+0x91/0x100
[ 1126.220458]  ? __check_object_size+0x136/0x150
[ 1126.221010]  do_sys_openat2+0x222/0x2e0
[ 1126.221561]  do_sys_open+0x44/0x80
[ 1126.222059]  do_syscall_64+0x33/0x80
[ 1126.222840]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 1126.223877] RIP: 0033:0x4039ce
[ 1126.224341] Code: 48 89 6c 24 38 48 8d 6c 24 38 e8 0d 00 00 00 48 8b 6c 24 38 48 83 c4 40 c3 cc cc cc 49 89 f2 48 89 fa 48 89 ce 48 89 df 0f 05 <48> 3d 01 f0 ff ff 76 15 48 f7 d8 48 89 c1 48 c7 c0 ff ff ff ff 48
[ 1126.227081] RSP: 002b:000000c0001fd498 EFLAGS: 00000206 ORIG_RAX: 0000000000000101
[ 1126.228014] RAX: ffffffffffffffda RBX: ffffffffffffff9c RCX: 00000000004039ce
[ 1126.229108] RDX: 0000000000080000 RSI: 000000c0002bf400 RDI: ffffffffffffff9c
[ 1126.230169] RBP: 000000c0001fd4d8 R08: 0000000000000000 R09: 0000000000000000
[ 1126.230772] R10: 0000000000000000 R11: 0000000000000206 R12: 000000c0002bf400
[ 1126.231368] R13: 0000000000000000 R14: 000000c0000061a0 R15: ffffffffffffffff
[ 1126.232098] Modules linked in:
[ 1126.232594] ---[ end trace 0973ddf60a27aa91 ]---
[ 1126.233285] RIP: 0010:kmem_cache_alloc+0xd4/0x3c0
[ 1126.233823] Code: 65 4c 03 05 06 be d6 7e 49 83 78 10 00 4d 8b 20 0f 84 a3 02 00 00 4d 85 e4 0f 84 9a 02 00 00 8b 45 28 48 8d 4a 01 48 8b 7d 00 <49> 8b 1c 04 4c 89 e0 65 48 0f c7 0f 0f 94 c0 84 c0 74 ba 8b 45 28
[ 1126.235519] RSP: 0018:ffffc90007af79d8 EFLAGS: 00010202
[ 1126.236088] RAX: 0000000000020000 RBX: 0000000000040000 RCX: 000000000007c42d
[ 1126.236752] RDX: 000000000007c42c RSI: 0000000000000c40 RDI: 0000607e08c050a0
[ 1126.237888] RBP: ffff888100abf0c0 R08: ffffe8ffffc050a0 R09: 0000000000000c40
[ 1126.239114] R10: 0000000000000000 R11: 0000000000000000 R12: 0100006f00000016
[ 1126.239873] R13: 0000000000000000 R14: 0000000000000c40 R15: 000000000000006e
[ 1126.240742] FS:  00007ff61e7fc700(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
[ 1126.241571] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1126.242190] CR2: 00007ff6343c3f90 CR3: 000000018a260002 CR4: 00000000003706b0
[ 1126.243136] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1126.244217] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1126.244886] Kernel panic - not syncing: Fatal exception
[ 1126.300336] Kernel Offset: disabled

Guest message:
[ 4671.079828] RSP: 0018:ffffc900052bb9a8 EFLAGS: 00010282
[ 4671.080266] RAX: 0000000000020000 RBX: 0000000000040000 RCX: 000000000011a13c
[ 4671.080914] RDX: 000000000011a13b RSI: 0000000000000c40 RDI: 0000607e08c049b0
[ 4671.081576] RBP: ffff8881f70fa900 R08: ffffe8ffffc049b0 R09: 0000000000040000
[ 4671.082185] R10: 0000000000000000 R11: 0000000000000000 R12: ff00007900000007
[ 4671.082827] R13: 0000000000000000 R14: 0000000000000c40 R15: 000000000000006e
[ 4671.083435] FS:  00007f3c262a1700(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
[ 4671.084012] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 4671.084556] CR2: 0000000000a636c0 CR3: 00000001871fe002 CR4: 00000000003706b0
[ 4671.085212] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 4671.085832] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 4671.086483] Call Trace:
[ 4671.087054]  p9_fcall_init.isra.0+0x54/0x70
[ 4671.087380]  p9_client_prepare_req.part.0+0xb1/0x240
[ 4671.087784]  p9_client_rpc+0xa4/0x4f0
[ 4671.088121]  ? idr_alloc_u32+0x8d/0xc0
[ 4671.088420]  p9_client_walk+0x8f/0x210
[ 4671.089095]  ? v9fs_fid_find+0x5b/0x70
[ 4671.089445]  ? v9fs_vfs_lookup.part.0+0x67/0x140
[ 4671.089879]  v9fs_vfs_lookup.part.0+0x67/0x140
[ 4671.090965]  __lookup_slow+0x84/0x140
[ 4671.091394]  walk_component+0x13b/0x1b0
[ 4671.091739]  link_path_walk.part.0+0x221/0x360
[ 4671.092164]  ? path_init+0x2af/0x390
[ 4671.092469]  path_lookupat.isra.0+0x3e/0x150
[ 4671.092905]  filename_lookup+0xae/0x140
[ 4671.093297]  ? __check_object_size+0x136/0x150
[ 4671.093737]  ? strncpy_from_user+0x4e/0x140
[ 4671.094059]  vfs_statx+0x72/0x110
[ 4671.094445]  __do_sys_newfstatat+0x31/0x70
[ 4671.094777]  ? __x64_sys_getcwd+0x12e/0x200
[ 4671.095109]  ? exit_to_user_mode_prepare+0x50/0xe0
[ 4671.095524]  do_syscall_64+0x33/0x80
[ 4671.095847]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 4671.096342] RIP: 0033:0x4039ce
[ 4671.096649] Code: 48 89 6c 24 38 48 8d 6c 24 38 e8 0d 00 00 00 48 8b 6c 24 38 48 83 c4 40 c3 cc cc cc 49 89 f2 48 89 fa 48 89 ce 48 89 df 0f 05 <48> 3d 01 f0 ff ff 76 15 48 f7 d8 48 89 c1 48 c7 c0 ff ff ff ff 48
[ 4671.098151] RSP: 002b:000000c0000efcd8 EFLAGS: 00000202 ORIG_RAX: 0000000000000106
[ 4671.098789] RAX: ffffffffffffffda RBX: ffffffffffffff9c RCX: 00000000004039ce
[ 4671.099454] RDX: 000000c000383f18 RSI: 000000c00014b8b0 RDI: ffffffffffffff9c
[ 4671.100072] RBP: 000000c0000efd18 R08: 0000000000000000 R09: 0000000000000000
[ 4671.100678] R10: 0000000000000000 R11: 0000000000000202 R12: 000000c00014b8b0
[ 4671.101276] R13: 0000000000000000 R14: 000000c0000061a0 R15: ffffffffffffffff
[ 4671.101924] Modules linked in:
[ 4671.102421] ---[ end trace 44a2c8a4c972ea29 ]---
[ 4671.103961] RIP: 0010:kmem_cache_alloc+0xd4/0x3c0
[ 4671.104552] Code: 65 4c 03 05 06 be d6 7e 49 83 78 10 00 4d 8b 20 0f 84 a3 02 00 00 4d 85 e4 0f 84 9a 02 00 00 8b 45 28 48 8d 4a 01 48 8b 7d 00 <49> 8b 1c 04 4c 89 e0 65 48 0f c7 0f 0f 94 c0 84 c0 74 ba 8b 45 28
[ 4671.106325] RSP: 0018:ffffc900052bb9a8 EFLAGS: 00010282
[ 4671.106808] RAX: 0000000000020000 RBX: 0000000000040000 RCX: 000000000011a13c
[ 4671.107557] RDX: 000000000011a13b RSI: 0000000000000c40 RDI: 0000607e08c049b0
[ 4671.108260] RBP: ffff8881f70fa900 R08: ffffe8ffffc049b0 R09: 0000000000040000
[ 4671.109032] R10: 0000000000000000 R11: 0000000000000000 R12: ff00007900000007
[ 4671.109624] R13: 0000000000000000 R14: 0000000000000c40 R15: 000000000000006e
[ 4671.110246] FS:  00007f3c262a1700(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
[ 4671.110863] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 4671.111367] CR2: 0000000000a636c0 CR3: 00000001871fe002 CR4: 00000000003706b0
[ 4671.111993] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 4671.112598] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 4671.113195] Kernel panic - not syncing: Fatal exception
[ 4671.138227] Kernel Offset: disabled

Guest message:
[370893.148917] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[370893.149564] Call Trace:
[370893.150380]  p9_fcall_init.isra.0+0x54/0x70
[370893.150888]  p9_client_prepare_req.part.0+0xb1/0x240
[370893.151337]  p9_client_rpc+0xa4/0x4f0
[370893.151799]  ? __check_object_size+0x136/0x150
[370893.152408]  p9_client_getattr_dotl+0x53/0x100
[370893.153571]  v9fs_vfs_getattr_dotl+0x43/0x90
[370893.154684]  vfs_statx+0x89/0x110
[370893.155177]  __do_sys_newfstatat+0x31/0x70
[370893.155512]  do_syscall_64+0x33/0x80
[370893.155815]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[370893.157020] RIP: 0033:0x40438e
[370893.157386] Code: 48 89 6c 24 38 48 8d 6c 24 38 e8 0d 00 00 00 48 8b 6c 24 38 48 83 c4 40 c3 cc cc cc 49 89 f2 48 89 fa 48 89 ce 48 89 df 0f 05 <48> 3d 01 f0 ff ff 76 15 48 f7 d8 48 89 c1 48 c7 c0 ff ff ff ff 48
[370893.158812] RSP: 002b:000000c0047a46d0 EFLAGS: 00000206 ORIG_RAX: 0000000000000106
[370893.159433] RAX: ffffffffffffffda RBX: ffffffffffffff9c RCX: 000000000040438e
[370893.160049] RDX: 000000c00171c038 RSI: 000000c00fa7a6c0 RDI: ffffffffffffff9c
[370893.160660] RBP: 000000c0047a4710 R08: 0000000000000000 R09: 0000000000000000
[370893.161253] R10: 0000000000000000 R11: 0000000000000206 R12: 000000c00fa7a6c0
[370893.161934] R13: 0000000000000000 R14: 000000c004803d40 R15: ffffffffffffffff
[370893.162636] Modules linked in:
[370893.163559] CR2: 00000000f5a22800
[370893.164384] ---[ end trace 21b9b566c4413102 ]---
[370893.167394] RIP: 0010:kmem_cache_alloc+0xd4/0x3c0
[370893.167871] Code: 65 4c 03 05 06 be d6 7e 49 83 78 10 00 4d 8b 20 0f 84 a3 02 00 00 4d 85 e4 0f 84 9a 02 00 00 8b 45 28 48 8d 4a 01 48 8b 7d 00 <49> 8b 1c 04 4c 89 e0 65 48 0f c7 0f 0f 94 c0 84 c0 74 ba 8b 45 28
[370893.169343] RSP: 0018:ffffc9000c777c88 EFLAGS: 00010206
[370893.169748] RAX: 0000000000020000 RBX: 0000000000040000 RCX: 00000000007ae4be
[370893.170350] RDX: 00000000007ae4bd RSI: 0000000000000c40 RDI: 0000607e08c03ec0
[370893.170933] RBP: ffff8881009c1840 R08: ffffe8ffffd03ec0 R09: 0000000000040000
[370893.171521] R10: ffffc9000c777e50 R11: ffff888144978b68 R12: 00000000f5a02800
[370893.172172] R13: 0000000000000000 R14: 0000000000000c40 R15: 0000000000000018
[370893.172919] FS:  00007fe4eedec700(0000) GS:ffff8881f7100000(0000) knlGS:0000000000000000
[370893.173618] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[370893.174194] CR2: 00000000f5a22800 CR3: 000000011c6ce005 CR4: 00000000003706a0
[370893.174852] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[370893.175495] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[370893.176116] Kernel panic - not syncing: Fatal exception
[370898.984554] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370904.481289] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370909.560882] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370914.570516] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370919.580974] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370924.588844] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370929.602438] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370934.624688] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370939.632801] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370944.642702] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370949.965821] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370957.052343] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370964.461223] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370971.967654] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370976.997484] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370982.036429] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370987.045742] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370992.052565] hv_vmbus: Waiting for VMBus UNLOAD to complete
[370997.059486] hv_vmbus: Waiting for VMBus UNLOAD to complete
[371002.133688] hv_vmbus: Waiting for VMBus UNLOAD to complete
[371002.144254] hv_vmbus: Continuing even though VMBus UNLOAD did not complete
[371002.144933] Kernel Offset: disabled

[OneBlue]

Thanks for reporting this @the-ress. Can you try with the store version of WSL since the kernel is more recent ?

[microsoft-github-policy-service]

This issue has been automatically closed since it has not had any activity for the past year. If you're still experiencing this issue please re-file this as a new issue or feature request.

Thank you!