Skip to content

cmd/cgo/internal/test: seg fault on linux-arm-aws builder #61514

Description

@cherrymui

The dashboard shows cmd/cgo/internal/test seg faults on the linux-arm-aws builder since https://golang.org/cl/508135 . Specifically, it is cmd/cgo/internal/test:static failing. The failure is quite consistent, every commit on the same test. Also the same failure on trybot https://go-review.googlesource.com/c/go/+/320910/3#message-34862db7fe6eb712e5699ce7ab0a7f53aed5a2e5

However, I tried to run all.bash or go tool dist test cmd/cgo/internal/test:static on the linux-arm-aws gomote and it doesn't fail. I double checked that the environment looks the same for gomote and the builder.

It is strange as CL 508135 shouldn't change anything semantically (even the order of sorted items). It is double strange that the failure is not reproducible locally.

Filing an issue to investigate.

Activity

  1. eliben commented on Jul 21, 2023

    @eliben
    Member

    Thanks for filing the issue, @cherrymui -- this is very odd, indeed.

    Could the test be failing sporadically after all (and we get unlucky), maybe running it locally with a high count can hit a failure?

  2. ianlancetaylor commented on Jul 21, 2023

    @ianlancetaylor
    Contributor

    Anything is possible, but the build dashboard shows the test failing consistently since that CL and never before that CL.

  3. cherrymui commented on Jul 21, 2023

    @cherrymui
    MemberAuthor

    I tried running go tool dist test cmd/cgo/internal/test:static in a loop for 100 times and it doesn't fail. I'm now trying to do some experiments with trybots in CL 511978

  4. added
    arch-armIssues solely affecting the 32-bit arm architecture.
    NeedsInvestigationSomeone must examine and confirm this is a valid issue and not a duplicate of an existing one.
    on Jul 21, 2023
  5. added this to the Go1.22 milestone on Jul 21, 2023
  6. cherrymui commented on Jul 24, 2023

    @cherrymui
    MemberAuthor

    Did some experiments on CL 511978. Essentially if I change any function(s) to use old code, like https://go-review.googlesource.com/c/go/+/511978/8/src/sort/sort_impl_go121.go , or https://go-review.googlesource.com/c/go/+/511978/9/src/sort/sort_impl_go121.go , trybot passes. It fails if all functions using new implementation. (They all pass on gomote.)

    On the other hand, on the build dashboard it passes again since CL https://go.dev/cl/511837 .

    Maybe there is something weird on the builder for that time, or how the test are run on the builder/trybot (bad caching?).

    Anyway, closing for now. We can reopen if it occurs again.

  7. locked and limited conversation to collaborators on Jul 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    FrozenDueToAgeNeedsInvestigationSomeone must examine and confirm this is a valid issue and not a duplicate of an existing one.arch-armIssues solely affecting the 32-bit arm architecture.compiler/runtimeIssues related to the Go compiler and/or runtime.

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions