Multithreaded Compute Segfaults in CI on GL/Linux

[cwfitzgerald]

Randomly, but consistently within the run, multithreaded compute segfaults in CI. This doesn't happen when I run it locally against llvmpipe. This doesn't happen when running it in CI on windows against llvmpipe.

I suspect this might be an issue with EGL, but I have no idea how to reproduce it.

ci-log.txt

[jimblandy]

Running as:

$ LD_PRELOAD=/usr/lib64/libc_malloc_debug.so.0 MALLOC_CHECK_=1 jb with-vulkan --lavapipe cargo nextest run -p wgpu-test --test wgpu-test map_offset

I get the following interesting message:

free(): invalid pointer

This seems to be here:

#1  DestroyThreadState (threadState=0x7ffff2715b30) at /usr/src/debug/libglvnd-1.6.0-2.fc38.x86_64/src/EGL/libeglcurrent.c:141

Edit: jb with-vulkan CMD is a personal utility of mine that runs CMD with environment variables set that point it at my local Mesa build. I don't think it should be necessary, so you can just omit those two words from the command.

[jimblandy]

Note that this issue affects many wgpu tests, not just the compute:

     Summary [   3.389s] 76 tests run: 52 passed, 24 failed, 0 skipped
     SIGABRT [   1.689s] wgpu-test::wgpu-test [Executed Failure: ALWAYS] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::device::cross_device_bind_group_usage
     SIGABRT [   1.682s] wgpu-test::wgpu-test [Executed Failure: ALWAYS] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::pipeline::pipeline_default_layout_bad_module
     SIGABRT [   1.845s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::bind_group_layout_dedup::bind_group_layout_deduplication
     SIGABRT [   1.894s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::buffer::map_offset
     SIGABRT [   1.118s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::clear_texture::clear_texture_depth
     SIGABRT [   1.271s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::clear_texture::clear_texture_uncompressed
     SIGABRT [   1.686s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::device::device_destroy_then_more
     SIGABRT [   1.064s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::device::request_device_error_message_native
     SIGABRT [   1.690s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::encoder::drop_encoder_after_error
     SIGABRT [   1.727s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::instance::initialize
     SIGABRT [   1.605s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::nv12_texture::nv12_texture_bad_format_view_plane
     SIGABRT [   1.840s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::regression::issue_3349::multi_stage_data_binding
     SIGABRT [   1.879s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::regression::issue_3457::pass_reset_vertex_buffer
     SIGABRT [   1.830s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::regression::issue_4024::queue_submitted_callback_ordering
     SIGABRT [   1.659s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::resource_descriptor_accessor::buffer_size_and_usage
     SIGABRT [   1.778s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::resource_error::bad_buffer
     SIGABRT [   1.865s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::scissor_tests::scissor_test_empty_rect_with_offset
     SIGABRT [   1.878s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::shader_primitive_index::draw
     SIGABRT [   1.827s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::shader_primitive_index::draw_indexed
     SIGABRT [   0.584s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::write_texture::write_texture_subset_2d
     SIGABRT [   0.538s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::write_texture::write_texture_subset_3d
     SIGABRT [   0.526s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::zero_init_texture_after_discard::discarding_color_target_resets_texture_init_state_check_visible_on_copy_after_submit
     SIGABRT [   0.412s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::zero_init_texture_after_discard::discarding_color_target_resets_texture_init_state_check_visible_on_copy_in_same_encoder
     SIGABRT [   0.556s] wgpu-test::wgpu-test [Executed] [Vulkan/AMD Radeon Pro WX 3200 Series (RADV POLARIS12)/0] wgpu_test::zero_init_texture_after_discard::discarding_depth_target_resets_texture_init_state_check_visible_on_copy_in_same_encoder
error: test run failed

[jimblandy]

Anyway, that's probably entirely different from the original issue, since it's all Vulkan. Filed separate issue #5084.

[cwfitzgerald]

It's not impossible these are the same problem, vulkan is still fully initialized on the GL tests