Skip to content

x/telemetry/internal/upload: TestRun_Concurrent failures #67737

Open
Open
x/telemetry/internal/upload: TestRun_Concurrent failures#67737
Assignees
findleyr
Labels
NeedsInvestigationSomeone must examine and confirm this is a valid issue and not a duplicate of an existing one.telemetryx/telemetry issues
Milestone
Go1.28

Description

@gopherbot
gopherbot
opened on May 30, 2024
#!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"

Issue created automatically to collect these failures.

Example (log):

=== RUN   TestRun_Concurrent
    run_test.go:66: 17:16:43.368589 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 17:16:43.368622 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 17:16:43.368646 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 17:16:43.369582 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 17:16:43.369752 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 17:16:43.369861 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 17:16:43.369616 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 17:16:43.370231 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-09.v1.count
    run_test.go:66: 17:16:43.370245 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-09.v1.count
...
    run_test.go:66: 17:16:43.388046 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count
    run_test.go:66: 17:16:43.388069 reports.go:64: Failed to create report for 2024-05-23: local report /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/local.2024-05-23.json already exists
    run_test.go:66: 17:16:43.388083 run.go:157: Uploading 0 reports
    run_test.go:66: 17:16:43.387658 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count
    run_test.go:66: 17:16:43.388107 reports.go:64: Failed to create report for 2024-05-23: local report /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/local.2024-05-23.json already exists
    run_test.go:66: 17:16:43.388133 run.go:157: Uploading 1 reports
    run_test.go:66: 17:16:43.389401 upload.go:111: Uploaded 2024-05-23.json to "http://127.0.0.1:51325/2024-05-23"
    run_test.go:66: 17:16:43.389493 upload.go:111: Uploaded 2024-05-16.json to "http://127.0.0.1:51325/2024-05-16"
    run_test.go:593: uploaded 13 total observations, want 14
--- FAIL: TestRun_Concurrent (0.46s)

— watchflakes

Activity

  1. gopherbot
    added
    NeedsInvestigationSomeone must examine and confirm this is a valid issue and not a duplicate of an existing one.
    on May 30, 2024
  2. gopherbot
    added this to Test Flakeson May 30, 2024

  3. gopherbot commented on May 30, 2024

    @gopherbot
    gopherbot
    on May 30, 2024
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2024-05-22 23:36 x_telemetry-go1.21-darwin-amd64_13 telemetry@39ace7a4 release-branch.go1.21@9488a444 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 17:16:43.368589 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 17:16:43.368622 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 17:16:43.368646 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 17:16:43.369582 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 17:16:43.369752 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 17:16:43.369861 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 17:16:43.369616 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 17:16:43.370231 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-09.v1.count
    run_test.go:66: 17:16:43.370245 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-09.v1.count
...
    run_test.go:66: 17:16:43.388046 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count
    run_test.go:66: 17:16:43.388069 reports.go:64: Failed to create report for 2024-05-23: local report /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/local.2024-05-23.json already exists
    run_test.go:66: 17:16:43.388083 run.go:157: Uploading 0 reports
    run_test.go:66: 17:16:43.387658 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count
    run_test.go:66: 17:16:43.388107 reports.go:64: Failed to create report for 2024-05-23: local report /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2569094852/001/local/local.2024-05-23.json already exists
    run_test.go:66: 17:16:43.388133 run.go:157: Uploading 1 reports
    run_test.go:66: 17:16:43.389401 upload.go:111: Uploaded 2024-05-23.json to "http://127.0.0.1:51325/2024-05-23"
    run_test.go:66: 17:16:43.389493 upload.go:111: Uploaded 2024-05-16.json to "http://127.0.0.1:51325/2024-05-16"
    run_test.go:593: uploaded 13 total observations, want 14
--- FAIL: TestRun_Concurrent (0.46s)
    2024-05-22 23:36 x_telemetry-go1.22-darwin-amd64_11 telemetry@39ace7a4 release-branch.go1.22@74565750 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 18:17:30.218262 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:17:30.218366 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:17:30.218650 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 18:17:30.218810 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 18:17:30.218918 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-09.v1.count
    run_test.go:66: 18:17:30.218911 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:17:30.219034 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:17:30.219058 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 18:17:30.219069 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-09.v1.count
...
    run_test.go:66: 18:17:30.226116 reports.go:64: Failed to create report for 2024-05-23: local report /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2249583122/001/local/local.2024-05-23.json already exists
    run_test.go:66: 18:17:30.226158 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2249583122/001/local/upload.test-devel-darwin-amd64-2024-05-20.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2249583122/001/local/upload.test-devel-darwin-amd64-2024-05-20.v1.count
    run_test.go:66: 18:17:30.226175 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2249583122/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2249583122/001/local/upload.test-devel-darwin-amd64-2024-05-21.v1.count
    run_test.go:66: 18:17:30.226184 reports.go:64: Failed to create report for 2024-05-23: local report /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2249583122/001/local/local.2024-05-23.json already exists
    run_test.go:66: 18:17:30.226191 run.go:157: Uploading 0 reports
    run_test.go:66: 18:17:30.226164 run.go:157: Uploading 0 reports
    run_test.go:66: 18:17:30.226540 upload.go:111: Uploaded 2024-05-23.json to "http://127.0.0.1:58936/2024-05-23"
    run_test.go:66: 18:17:30.226624 upload.go:111: Uploaded 2024-05-16.json to "http://127.0.0.1:58936/2024-05-16"
    run_test.go:593: uploaded 13 total observations, want 14
--- FAIL: TestRun_Concurrent (0.20s)
    2024-05-22 23:36 x_telemetry-go1.22-darwin-amd64_14 telemetry@39ace7a4 release-branch.go1.22@74565750 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 18:58:02.893007 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:58:02.895442 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 18:58:02.896315 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:58:02.897332 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-09.v1.count
    run_test.go:66: 18:58:02.897724 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
    run_test.go:66: 18:58:02.904669 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-10.v1.count
    run_test.go:66: 18:58:02.908755 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:58:02.908466 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-09.v1.count
    run_test.go:66: 18:58:02.909854 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-05-08.v1.count
...
    run_test.go:66: 18:58:02.982806 findwork.go:97: Already uploaded: 2024-05-23.json
    run_test.go:66: 18:58:02.983172 reports.go:34: Last week: 2024-05-23, today: 2024-05-30
    run_test.go:66: 18:58:02.983244 run.go:157: Uploading 0 reports
    run_test.go:66: 18:58:02.994336 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:58:02.994948 findwork.go:97: Already uploaded: 2024-05-16.json
    run_test.go:66: 18:58:02.995046 findwork.go:97: Already uploaded: 2024-05-23.json
    run_test.go:66: 18:58:02.995576 reports.go:34: Last week: 2024-05-23, today: 2024-05-30
    run_test.go:66: 18:58:02.995652 run.go:157: Uploading 0 reports
    run_test.go:593: uploaded 13 total observations, want 14
--- FAIL: TestRun_Concurrent (0.98s)
    2024-05-22 23:36 x_telemetry-go1.22-windows-amd64 telemetry@39ace7a4 release-branch.go1.22@74565750 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 18:25:34.050596 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:25:34.050596 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:25:34.050596 findwork.go:50: Collecting count file upload.test-devel-windows-amd64-2024-05-08.v1.count
    run_test.go:66: 18:25:34.050596 findwork.go:50: Collecting count file upload.test-devel-windows-amd64-2024-05-08.v1.count
    run_test.go:66: 18:25:34.050596 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:25:34.051487 findwork.go:50: Collecting count file upload.test-devel-windows-amd64-2024-05-09.v1.count
    run_test.go:66: 18:25:34.051487 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
    run_test.go:66: 18:25:34.051487 findwork.go:50: Collecting count file upload.test-devel-windows-amd64-2024-05-08.v1.count
    run_test.go:66: 18:25:34.051487 findwork.go:35: Finding work: mode on, asof 2023-05-31 00:00:00 +0000 UTC
...
    run_test.go:66: 18:25:34.061359 reports.go:113: remove C:\b\s\w\ir\x\t\TestRun_Concurrent2928643688\001\local\upload.test-devel-windows-amd64-2024-05-18.v1.count: The system cannot find the file specified. failed to remove C:\b\s\w\ir\x\t\TestRun_Concurrent2928643688\001\local\upload.test-devel-windows-amd64-2024-05-18.v1.count
    run_test.go:66: 18:25:34.061359 reports.go:113: remove C:\b\s\w\ir\x\t\TestRun_Concurrent2928643688\001\local\upload.test-devel-windows-amd64-2024-05-19.v1.count: The system cannot find the file specified. failed to remove C:\b\s\w\ir\x\t\TestRun_Concurrent2928643688\001\local\upload.test-devel-windows-amd64-2024-05-19.v1.count
    run_test.go:66: 18:25:34.061359 reports.go:113: remove C:\b\s\w\ir\x\t\TestRun_Concurrent2928643688\001\local\upload.test-devel-windows-amd64-2024-05-20.v1.count: The system cannot find the file specified. failed to remove C:\b\s\w\ir\x\t\TestRun_Concurrent2928643688\001\local\upload.test-devel-windows-amd64-2024-05-20.v1.count
    run_test.go:66: 18:25:34.062229 reports.go:113: remove C:\b\s\w\ir\x\t\TestRun_Concurrent2928643688\001\local\upload.test-devel-windows-amd64-2024-05-21.v1.count: The system cannot find the file specified. failed to remove C:\b\s\w\ir\x\t\TestRun_Concurrent2928643688\001\local\upload.test-devel-windows-amd64-2024-05-21.v1.count
    run_test.go:66: 18:25:34.062229 reports.go:64: Failed to create report for 2024-05-23: local report C:\b\s\w\ir\x\t\TestRun_Concurrent2928643688\001\local\local.2024-05-23.json already exists
    run_test.go:66: 18:25:34.062229 run.go:157: Uploading 1 reports
    run_test.go:66: 18:25:34.063844 upload.go:111: Uploaded 2024-05-16.json to "http://127.0.0.1:49870/2024-05-16"
    run_test.go:66: 18:25:34.063844 upload.go:111: Uploaded 2024-05-23.json to "http://127.0.0.1:49870/2024-05-23"
    run_test.go:593: uploaded 13 total observations, want 14
--- FAIL: TestRun_Concurrent (0.30s)

    — watchflakes

  4. gopherbot
    added
    telemetryx/telemetry issues
    on May 30, 2024
  5. gopherbot
    added this to the Unreleased milestone on May 30, 2024

  6. gopherbot commented on Jun 4, 2024

    @gopherbot
    gopherbot
    on Jun 4, 2024
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2024-06-03 22:45 x_telemetry-gotip-linux-arm telemetry@f2b69109 go@535f81e7 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 15:37:57.528458 findwork.go:35: Finding work: mode on, asof 2023-06-05 00:00:00 +0000 UTC
    run_test.go:66: 15:37:57.528573 findwork.go:50: Collecting count file upload.test-devel-linux-arm-2024-05-14.v1.count
    run_test.go:66: 15:37:57.528621 findwork.go:50: Collecting count file upload.test-devel-linux-arm-2024-05-15.v1.count
    run_test.go:66: 15:37:57.528463 findwork.go:35: Finding work: mode on, asof 2023-06-05 00:00:00 +0000 UTC
    run_test.go:66: 15:37:57.528753 findwork.go:50: Collecting count file upload.test-devel-linux-arm-2024-05-14.v1.count
    run_test.go:66: 15:37:57.528814 findwork.go:50: Collecting count file upload.test-devel-linux-arm-2024-05-15.v1.count
    run_test.go:66: 15:37:57.528863 findwork.go:50: Collecting count file upload.test-devel-linux-arm-2024-05-16.v1.count
    run_test.go:66: 15:37:57.528913 findwork.go:50: Collecting count file upload.test-devel-linux-arm-2024-05-17.v1.count
    run_test.go:66: 15:37:57.528961 findwork.go:50: Collecting count file upload.test-devel-linux-arm-2024-05-18.v1.count
...
    run_test.go:66: 15:37:57.531860 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/upload.test-devel-linux-arm-2024-05-24.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/upload.test-devel-linux-arm-2024-05-24.v1.count
    run_test.go:66: 15:37:57.531877 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/upload.test-devel-linux-arm-2024-05-25.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/upload.test-devel-linux-arm-2024-05-25.v1.count
    run_test.go:66: 15:37:57.531896 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/upload.test-devel-linux-arm-2024-05-26.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/upload.test-devel-linux-arm-2024-05-26.v1.count
    run_test.go:66: 15:37:57.531913 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/upload.test-devel-linux-arm-2024-05-27.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/upload.test-devel-linux-arm-2024-05-27.v1.count
    run_test.go:66: 15:37:57.531931 reports.go:64: Failed to create report for 2024-05-29: local report /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/local.2024-05-29.json already exists
    run_test.go:66: 15:37:57.531944 run.go:157: Uploading 0 reports
    run_test.go:66: 15:37:57.531905 upload.go:111: Uploaded 2024-05-22.json to "http://127.0.0.1:39247/2024-05-22"
    run_test.go:66: 15:37:57.531994 upload.go:54: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/2024-05-29.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3059370928/001/local/2024-05-29.json
    run_test.go:593: uploaded 21 total observations, want 14
--- FAIL: TestRun_Concurrent (0.07s)

    — watchflakes

  7. gopherbot commented on Jun 24, 2024

    @gopherbot
    gopherbot
    on Jun 24, 2024
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2024-06-21 19:41 x_telemetry-gotip-darwin-amd64_11 telemetry@a740542b go@e8ee1dc4 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 17:56:25.996832 findwork.go:35: Finding work: mode on, asof 2023-06-24 00:00:00 +0000 UTC
    run_test.go:66: 17:56:25.997280 findwork.go:35: Finding work: mode on, asof 2023-06-24 00:00:00 +0000 UTC
    run_test.go:66: 17:56:25.997360 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-01.v1.count
    run_test.go:66: 17:56:25.997388 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-01.v1.count
    run_test.go:66: 17:56:25.997675 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-02.v1.count
    run_test.go:66: 17:56:25.997719 findwork.go:35: Finding work: mode on, asof 2023-06-24 00:00:00 +0000 UTC
    run_test.go:66: 17:56:25.997793 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-01.v1.count
    run_test.go:66: 17:56:25.997819 findwork.go:35: Finding work: mode on, asof 2023-06-24 00:00:00 +0000 UTC
    run_test.go:66: 17:56:25.997837 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-02.v1.count
...
    run_test.go:66: 17:56:26.004049 findwork.go:35: Finding work: mode on, asof 2023-06-24 00:00:00 +0000 UTC
    run_test.go:66: 17:56:26.004074 findwork.go:71: Uploadable: 2024-06-09.json
    run_test.go:66: 17:56:26.004125 findwork.go:71: Uploadable: 2024-06-16.json
    run_test.go:66: 17:56:26.004188 reports.go:34: Last week: , today: 2024-06-23
    run_test.go:66: 17:56:26.004197 run.go:157: Uploading 2 reports
    run_test.go:66: 17:56:26.004518 upload.go:80: Failed to acquire lock /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2517570491/001/upload/2024-06-09.json.lock: open /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2517570491/001/upload/2024-06-09.json.lock: file exists
    run_test.go:66: 17:56:26.004645 upload.go:111: Uploaded 2024-06-09.json to "http://127.0.0.1:50119/2024-06-09"
    run_test.go:66: 17:56:26.004818 upload.go:111: Uploaded 2024-06-16.json to "http://127.0.0.1:50119/2024-06-16"
    run_test.go:593: uploaded 13 total observations, want 14
--- FAIL: TestRun_Concurrent (0.18s)
    2024-06-21 19:41 x_telemetry-gotip-darwin-arm64_11 telemetry@a740542b go@e8ee1dc4 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 17:56:43.716603 findwork.go:35: Finding work: mode on, asof 2023-06-24 00:00:00 +0000 UTC
    run_test.go:66: 17:56:43.716686 findwork.go:50: Collecting count file upload.test-devel-darwin-arm64-2024-06-01.v1.count
    run_test.go:66: 17:56:43.716715 findwork.go:35: Finding work: mode on, asof 2023-06-24 00:00:00 +0000 UTC
    run_test.go:66: 17:56:43.716726 findwork.go:50: Collecting count file upload.test-devel-darwin-arm64-2024-06-02.v1.count
    run_test.go:66: 17:56:43.716758 findwork.go:50: Collecting count file upload.test-devel-darwin-arm64-2024-06-01.v1.count
    run_test.go:66: 17:56:43.716761 findwork.go:50: Collecting count file upload.test-devel-darwin-arm64-2024-06-03.v1.count
    run_test.go:66: 17:56:43.716788 findwork.go:50: Collecting count file upload.test-devel-darwin-arm64-2024-06-02.v1.count
    run_test.go:66: 17:56:43.716821 findwork.go:50: Collecting count file upload.test-devel-darwin-arm64-2024-06-04.v1.count
    run_test.go:66: 17:56:43.716826 findwork.go:35: Finding work: mode on, asof 2023-06-24 00:00:00 +0000 UTC
...
    run_test.go:66: 17:56:43.719520 reports.go:113: remove /opt/s/w/ir/x/t/TestRun_Concurrent4277224640/001/local/upload.test-devel-darwin-arm64-2024-06-11.v1.count: no such file or directory failed to remove /opt/s/w/ir/x/t/TestRun_Concurrent4277224640/001/local/upload.test-devel-darwin-arm64-2024-06-11.v1.count
    run_test.go:66: 17:56:43.719527 reports.go:113: remove /opt/s/w/ir/x/t/TestRun_Concurrent4277224640/001/local/upload.test-devel-darwin-arm64-2024-06-12.v1.count: no such file or directory failed to remove /opt/s/w/ir/x/t/TestRun_Concurrent4277224640/001/local/upload.test-devel-darwin-arm64-2024-06-12.v1.count
    run_test.go:66: 17:56:43.719537 reports.go:113: remove /opt/s/w/ir/x/t/TestRun_Concurrent4277224640/001/local/upload.test-devel-darwin-arm64-2024-06-13.v1.count: no such file or directory failed to remove /opt/s/w/ir/x/t/TestRun_Concurrent4277224640/001/local/upload.test-devel-darwin-arm64-2024-06-13.v1.count
    run_test.go:66: 17:56:43.719545 reports.go:113: remove /opt/s/w/ir/x/t/TestRun_Concurrent4277224640/001/local/upload.test-devel-darwin-arm64-2024-06-14.v1.count: no such file or directory failed to remove /opt/s/w/ir/x/t/TestRun_Concurrent4277224640/001/local/upload.test-devel-darwin-arm64-2024-06-14.v1.count
    run_test.go:66: 17:56:43.719549 reports.go:64: Failed to create report for 2024-06-16: local report /opt/s/w/ir/x/t/TestRun_Concurrent4277224640/001/local/local.2024-06-16.json already exists
    run_test.go:66: 17:56:43.719553 run.go:157: Uploading 0 reports
    run_test.go:66: 17:56:43.719748 upload.go:111: Uploaded 2024-06-09.json to "http://127.0.0.1:50679/2024-06-09"
    run_test.go:66: 17:56:43.719831 upload.go:111: Uploaded 2024-06-16.json to "http://127.0.0.1:50679/2024-06-16"
    run_test.go:593: uploaded 13 total observations, want 14
--- FAIL: TestRun_Concurrent (0.07s)

    — watchflakes

  8. gopherbot commented on Jun 26, 2024

    @gopherbot
    gopherbot
    on Jun 26, 2024
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2024-06-24 21:43 x_telemetry-go1.21-darwin-amd64-nocgo telemetry@210d439e release-branch.go1.21@dfb00670 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 19:13:28.334433 findwork.go:35: Finding work: mode on, asof 2023-06-26 00:00:00 +0000 UTC
    run_test.go:66: 19:13:28.334727 findwork.go:35: Finding work: mode on, asof 2023-06-26 00:00:00 +0000 UTC
    run_test.go:66: 19:13:28.334868 findwork.go:35: Finding work: mode on, asof 2023-06-26 00:00:00 +0000 UTC
    run_test.go:66: 19:13:28.335085 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-03.v1.count
    run_test.go:66: 19:13:28.335225 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-03.v1.count
    run_test.go:66: 19:13:28.335280 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-03.v1.count
    run_test.go:66: 19:13:28.335449 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-04.v1.count
    run_test.go:66: 19:13:28.335464 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-04.v1.count
    run_test.go:66: 19:13:28.335556 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-04.v1.count
...
    run_test.go:66: 19:13:28.346808 upload.go:80: Failed to acquire lock /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2987023683/001/upload/2024-06-11.json.lock: open /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2987023683/001/upload/2024-06-11.json.lock: file exists
    run_test.go:66: 19:13:28.347559 upload.go:111: Uploaded 2024-06-11.json to "http://127.0.0.1:49287/2024-06-11"
    run_test.go:66: 19:13:28.347867 upload.go:111: Uploaded 2024-06-18.json to "http://127.0.0.1:49287/2024-06-18"
    run_test.go:66: 19:13:28.359325 findwork.go:35: Finding work: mode on, asof 2023-06-26 00:00:00 +0000 UTC
    run_test.go:66: 19:13:28.359426 findwork.go:97: Already uploaded: 2024-06-11.json
    run_test.go:66: 19:13:28.359443 findwork.go:97: Already uploaded: 2024-06-18.json
    run_test.go:66: 19:13:28.359506 reports.go:34: Last week: 2024-06-18, today: 2024-06-25
    run_test.go:66: 19:13:28.359519 run.go:157: Uploading 0 reports
    run_test.go:593: uploaded 13 total observations, want 14
--- FAIL: TestRun_Concurrent (0.40s)
    2024-06-24 21:43 x_telemetry-go1.21-darwin-amd64_14 telemetry@210d439e release-branch.go1.21@dfb00670 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 19:11:04.892926 findwork.go:35: Finding work: mode on, asof 2023-06-26 00:00:00 +0000 UTC
    run_test.go:66: 19:11:04.893910 findwork.go:35: Finding work: mode on, asof 2023-06-26 00:00:00 +0000 UTC
    run_test.go:66: 19:11:04.894110 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-03.v1.count
    run_test.go:66: 19:11:04.894714 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-03.v1.count
    run_test.go:66: 19:11:04.894845 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-04.v1.count
    run_test.go:66: 19:11:04.895121 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-04.v1.count
    run_test.go:66: 19:11:04.895161 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-05.v1.count
    run_test.go:66: 19:11:04.895300 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-05.v1.count
    run_test.go:66: 19:11:04.895521 findwork.go:50: Collecting count file upload.test-devel-darwin-amd64-2024-06-06.v1.count
...
    run_test.go:66: 19:11:04.908140 reports.go:64: Failed to create report for 2024-06-11: local report /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/local.2024-06-11.json already exists
    run_test.go:66: 19:11:04.908298 upload.go:111: Uploaded 2024-06-18.json to "http://127.0.0.1:52771/2024-06-18"
    run_test.go:66: 19:11:04.908367 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/upload.test-devel-darwin-amd64-2024-06-11.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/upload.test-devel-darwin-amd64-2024-06-11.v1.count
    run_test.go:66: 19:11:04.908401 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/upload.test-devel-darwin-amd64-2024-06-12.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/upload.test-devel-darwin-amd64-2024-06-12.v1.count
    run_test.go:66: 19:11:04.908509 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/upload.test-devel-darwin-amd64-2024-06-13.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/upload.test-devel-darwin-amd64-2024-06-13.v1.count
    run_test.go:66: 19:11:04.908541 reports.go:113: remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/upload.test-devel-darwin-amd64-2024-06-14.v1.count: no such file or directory failed to remove /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/upload.test-devel-darwin-amd64-2024-06-14.v1.count
    run_test.go:66: 19:11:04.908554 reports.go:64: Failed to create report for 2024-06-18: local report /Users/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2257027360/001/local/local.2024-06-18.json already exists
    run_test.go:66: 19:11:04.908567 run.go:157: Uploading 0 reports
    run_test.go:593: uploaded 13 total observations, want 14
--- FAIL: TestRun_Concurrent (0.40s)

    — watchflakes

  9. findleyr
    self-assigned this
    on Jul 2, 2024

  10. findleyr commented on Jul 2, 2024

    @findleyr
    findleyr
    on Jul 2, 2024
    Contributor

    Looks like a real race. I will take a look.

  11. findleyr commented on Jul 2, 2024

    @findleyr
    findleyr
    on Jul 2, 2024
    Contributor

    Not a race: looks like a timezone / day boundary bug 🤦.

  12. gopherbot commented on Jul 2, 2024

    @gopherbot
    gopherbot
    on Jul 2, 2024
    ContributorAuthor

    Change https://go.dev/cl/596316 mentions this issue: internal/upload: use UTC time in TestRun_Concurrent

  13. gopherbot
    closed this as completedin 5dc3c48on Jul 3, 2024
  14. github-project-automation
    moved this to Done in Test Flakeson Jul 3, 2024

  15. gopherbot commented on Jul 3, 2024

    @gopherbot
    gopherbot
    on Jul 3, 2024
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2024-07-01 17:54 x_telemetry-go1.21-windows-arm64 telemetry@4e29c787 release-branch.go1.21@12e9b968 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:66: 21:03:41.860501 findwork.go:35: Finding work: mode on, asof 2023-07-03 00:00:00 +0000 UTC
    run_test.go:66: 21:03:41.861858 findwork.go:50: Collecting count file upload.test-devel-windows-arm64-2024-06-11.v1.count
    run_test.go:66: 21:03:41.861858 findwork.go:50: Collecting count file upload.test-devel-windows-arm64-2024-06-12.v1.count
    run_test.go:66: 21:03:41.861858 findwork.go:50: Collecting count file upload.test-devel-windows-arm64-2024-06-13.v1.count
    run_test.go:66: 21:03:41.861858 findwork.go:50: Collecting count file upload.test-devel-windows-arm64-2024-06-14.v1.count
    run_test.go:66: 21:03:41.861858 findwork.go:50: Collecting count file upload.test-devel-windows-arm64-2024-06-15.v1.count
    run_test.go:66: 21:03:41.861858 findwork.go:50: Collecting count file upload.test-devel-windows-arm64-2024-06-16.v1.count
    run_test.go:66: 21:03:41.861858 findwork.go:50: Collecting count file upload.test-devel-windows-arm64-2024-06-17.v1.count
    run_test.go:66: 21:03:41.862877 findwork.go:50: Collecting count file upload.test-devel-windows-arm64-2024-06-18.v1.count
...
    run_test.go:66: 21:03:41.870249 upload.go:80: Failed to acquire lock C:\Users\swarming\.swarming\w\ir\x\t\TestRun_Concurrent2162911338\001\upload\2024-06-19.json.lock: open C:\Users\swarming\.swarming\w\ir\x\t\TestRun_Concurrent2162911338\001\upload\2024-06-19.json.lock: The file exists.
    run_test.go:66: 21:03:41.870781 upload.go:80: Failed to acquire lock C:\Users\swarming\.swarming\w\ir\x\t\TestRun_Concurrent2162911338\001\upload\2024-06-12.json.lock: open C:\Users\swarming\.swarming\w\ir\x\t\TestRun_Concurrent2162911338\001\upload\2024-06-12.json.lock: The file exists.
    run_test.go:66: 21:03:41.869954 upload.go:80: Failed to acquire lock C:\Users\swarming\.swarming\w\ir\x\t\TestRun_Concurrent2162911338\001\upload\2024-06-12.json.lock: open C:\Users\swarming\.swarming\w\ir\x\t\TestRun_Concurrent2162911338\001\upload\2024-06-12.json.lock: The file exists.
    run_test.go:66: 21:03:41.871311 upload.go:111: Uploaded 2024-06-12.json to "http://127.0.0.1:59857/2024-06-12"
    run_test.go:66: 21:03:41.871859 upload.go:111: Uploaded 2024-06-19.json to "http://127.0.0.1:59857/2024-06-19"
    run_test.go:66: 21:03:41.871859 upload.go:80: Failed to acquire lock C:\Users\swarming\.swarming\w\ir\x\t\TestRun_Concurrent2162911338\001\upload\2024-06-26.json.lock: open C:\Users\swarming\.swarming\w\ir\x\t\TestRun_Concurrent2162911338\001\upload\2024-06-26.json.lock: The file exists.
    run_test.go:66: 21:03:41.872907 upload.go:111: Uploaded 2024-06-26.json to "http://127.0.0.1:59857/2024-06-26"
    run_test.go:66: 21:03:41.872907 upload.go:111: Uploaded 2024-06-19.json to "http://127.0.0.1:59857/2024-06-19"
    run_test.go:593: uploaded 21 total observations, want 14
--- FAIL: TestRun_Concurrent (0.59s)

    — watchflakes

  16. 16 remaining items

  17. gopherbot
    modified the milestones: Go1.24, Go1.25 on Feb 11, 2025

  18. gopherbot commented on May 7, 2025

    @gopherbot
    gopherbot
    on May 7, 2025
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2025-05-07 14:13 x_telemetry-go1.23-linux-ppc64le_power9 telemetry@d42286b9 release-branch.go1.23@f77084d1 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:68: uploader #2: 14:14:17.751159 findwork.go:35: Finding work: mode on asof 2024-05-07 00:00:00 +0000 UTC
    run_test.go:68: uploader #1: 14:14:17.751334 findwork.go:35: Finding work: mode on asof 2024-05-07 00:00:00 +0000 UTC
    run_test.go:68: uploader #2: 14:14:17.751386 findwork.go:50: Collecting count file upload.test-devel-linux-ppc64le-2025-04-16.v1.count
    run_test.go:68: uploader #1: 14:14:17.751443 findwork.go:50: Collecting count file upload.test-devel-linux-ppc64le-2025-04-16.v1.count
    run_test.go:68: uploader #2: 14:14:17.751485 findwork.go:50: Collecting count file upload.test-devel-linux-ppc64le-2025-04-17.v1.count
    run_test.go:68: uploader #1: 14:14:17.751505 findwork.go:50: Collecting count file upload.test-devel-linux-ppc64le-2025-04-17.v1.count
    run_test.go:68: uploader #2: 14:14:17.751553 findwork.go:50: Collecting count file upload.test-devel-linux-ppc64le-2025-04-18.v1.count
    run_test.go:68: uploader #2: 14:14:17.751673 findwork.go:50: Collecting count file upload.test-devel-linux-ppc64le-2025-04-19.v1.count
    run_test.go:68: uploader #1: 14:14:17.751561 findwork.go:50: Collecting count file upload.test-devel-linux-ppc64le-2025-04-18.v1.count
...
    run_test.go:68: uploader #1: 14:14:17.765779 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/upload.test-devel-linux-ppc64le-2025-04-22.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/upload.test-devel-linux-ppc64le-2025-04-22.v1.count
    run_test.go:68: uploader #1: 14:14:17.765975 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/upload.test-devel-linux-ppc64le-2025-04-23.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/upload.test-devel-linux-ppc64le-2025-04-23.v1.count
    run_test.go:68: uploader #1: 14:14:17.766023 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/upload.test-devel-linux-ppc64le-2025-04-24.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/upload.test-devel-linux-ppc64le-2025-04-24.v1.count
    run_test.go:68: uploader #1: 14:14:17.766062 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/upload.test-devel-linux-ppc64le-2025-04-25.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/upload.test-devel-linux-ppc64le-2025-04-25.v1.count
    run_test.go:68: uploader #1: 14:14:17.766077 reports.go:64: Failed to create report for 2025-04-26: local report /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/local.2025-04-26.json already exists
    run_test.go:68: uploader #1: 14:14:17.766090 run.go:172: Uploading 1 reports
    run_test.go:68: uploader #1: 14:14:17.766140 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/2025-05-03.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3884820134/001/local/2025-05-03.json
    run_test.go:605: error unmarshalling uploaded report: unexpected end of JSON input
        contents:
--- FAIL: TestRun_Concurrent (0.18s)

    — watchflakes

  19. gopherbot
    modified the milestones: Go1.25, Go1.26 on Aug 12, 2025

  20. gopherbot commented on Aug 22, 2025

    @gopherbot
    gopherbot
    on Aug 22, 2025
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2025-08-18 16:38 x_telemetry-go1.24-linux-ppc64le_power8 telemetry@19f67fec release-branch.go1.24@fe83d4bc x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:68: uploader #2: 19:56:10.140672 findwork.go:35: Finding work: mode on asof 2024-08-20 00:00:00 +0000 UTC
    run_test.go:68: uploader #2: 19:56:10.140800 findwork.go:50: Collecting count file upload.test@devel-devel-linux-ppc64le-2025-07-30.v1.count
    run_test.go:68: uploader #2: 19:56:10.140921 findwork.go:50: Collecting count file upload.test@devel-devel-linux-ppc64le-2025-07-31.v1.count
    run_test.go:68: uploader #2: 19:56:10.140989 findwork.go:50: Collecting count file upload.test@devel-devel-linux-ppc64le-2025-08-01.v1.count
    run_test.go:68: uploader #2: 19:56:10.141057 findwork.go:50: Collecting count file upload.test@devel-devel-linux-ppc64le-2025-08-02.v1.count
    run_test.go:68: uploader #2: 19:56:10.141128 findwork.go:50: Collecting count file upload.test@devel-devel-linux-ppc64le-2025-08-03.v1.count
    run_test.go:68: uploader #2: 19:56:10.141195 findwork.go:50: Collecting count file upload.test@devel-devel-linux-ppc64le-2025-08-04.v1.count
    run_test.go:68: uploader #2: 19:56:10.141261 findwork.go:50: Collecting count file upload.test@devel-devel-linux-ppc64le-2025-08-05.v1.count
    run_test.go:68: uploader #2: 19:56:10.141327 findwork.go:50: Collecting count file upload.test@devel-devel-linux-ppc64le-2025-08-06.v1.count
...
    run_test.go:68: uploader #0: 19:56:10.148253 upload.go:76: Failed to acquire lock /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2399914879/001/upload/2025-08-07.json.lock: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2399914879/001/upload/2025-08-07.json.lock: file exists
    run_test.go:68: uploader #0: 19:56:10.148318 upload.go:76: Failed to acquire lock /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2399914879/001/upload/2025-08-14.json.lock: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2399914879/001/upload/2025-08-14.json.lock: file exists
    run_test.go:68: uploader #4: 19:56:10.148587 upload.go:115: Uploaded 2025-08-07.json to "http://127.0.0.1:37561/2025-08-07"
    run_test.go:68: uploader #3: 19:56:10.148609 upload.go:115: Uploaded 2025-08-14.json to "http://127.0.0.1:37561/2025-08-14"
    run_test.go:68: uploader #4: 19:56:10.148668 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2399914879/001/local/2025-08-14.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2399914879/001/local/2025-08-14.json
    run_test.go:68: uploader #1: 19:56:10.148712 upload.go:115: Uploaded 2025-07-31.json to "http://127.0.0.1:37561/2025-07-31"
    run_test.go:68: uploader #1: 19:56:10.148760 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2399914879/001/local/2025-08-14.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2399914879/001/local/2025-08-14.json
    run_test.go:605: error unmarshalling uploaded report: unexpected end of JSON input
        contents:
--- FAIL: TestRun_Concurrent (0.08s)

    — watchflakes

  21. gopherbot commented on Oct 8, 2025

    @gopherbot
    gopherbot
    on Oct 8, 2025
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2025-10-08 16:28 x_telemetry-gotip-linux-arm telemetry@ca0c2a90 go@d4830c61 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:68: uploader #3: 20:59:27.429393 findwork.go:35: Finding work: mode on asof 2024-10-08 00:00:00 +0000 UTC
    run_test.go:68: uploader #3: 20:59:27.429735 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2025-09-17.v1.count
    run_test.go:68: uploader #3: 20:59:27.429815 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2025-09-18.v1.count
    run_test.go:68: uploader #1: 20:59:27.429866 findwork.go:35: Finding work: mode on asof 2024-10-08 00:00:00 +0000 UTC
    run_test.go:68: uploader #1: 20:59:27.429981 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2025-09-17.v1.count
    run_test.go:68: uploader #3: 20:59:27.429883 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2025-09-19.v1.count
    run_test.go:68: uploader #1: 20:59:27.430069 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2025-09-18.v1.count
    run_test.go:68: uploader #3: 20:59:27.430113 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2025-09-20.v1.count
    run_test.go:68: uploader #1: 20:59:27.430151 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2025-09-19.v1.count
...
    run_test.go:68: uploader #1: 20:59:27.437314 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/upload.test@devel-devel-linux-arm-2025-09-27.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/upload.test@devel-devel-linux-arm-2025-09-27.v1.count
    run_test.go:68: uploader #1: 20:59:27.437335 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/upload.test@devel-devel-linux-arm-2025-09-28.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/upload.test@devel-devel-linux-arm-2025-09-28.v1.count
    run_test.go:68: uploader #1: 20:59:27.437354 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/upload.test@devel-devel-linux-arm-2025-09-29.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/upload.test@devel-devel-linux-arm-2025-09-29.v1.count
    run_test.go:68: uploader #1: 20:59:27.437373 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/upload.test@devel-devel-linux-arm-2025-09-30.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/upload.test@devel-devel-linux-arm-2025-09-30.v1.count
    run_test.go:68: uploader #1: 20:59:27.437389 reports.go:64: Failed to create report for 2025-10-01: local report /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/local.2025-10-01.json already exists
    run_test.go:68: uploader #1: 20:59:27.437404 run.go:172: Uploading 1 reports
    run_test.go:68: uploader #1: 20:59:27.437437 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/2025-09-24.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1237516716/001/local/2025-09-24.json
    run_test.go:605: error unmarshalling uploaded report: unexpected end of JSON input
        contents:
--- FAIL: TestRun_Concurrent (0.09s)

    — watchflakes

  22. gopherbot commented on Dec 22, 2025

    @gopherbot
    gopherbot
    on Dec 22, 2025
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2025-12-19 17:12 x_telemetry-go1.25-linux-mips64le telemetry@e0dd3dd4 release-branch.go1.25@93f5d1c2 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:68: uploader #2: 21:14:35.171076 findwork.go:35: Finding work: mode on asof 2024-12-22 00:00:00 +0000 UTC
    run_test.go:68: uploader #4: 21:14:35.171076 findwork.go:35: Finding work: mode on asof 2024-12-22 00:00:00 +0000 UTC
    run_test.go:68: uploader #2: 21:14:35.171353 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2025-12-01.v1.count
    run_test.go:68: uploader #4: 21:14:35.171433 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2025-12-01.v1.count
    run_test.go:68: uploader #2: 21:14:35.171482 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2025-12-02.v1.count
    run_test.go:68: uploader #2: 21:14:35.171584 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2025-12-03.v1.count
    run_test.go:68: uploader #4: 21:14:35.171590 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2025-12-02.v1.count
    run_test.go:68: uploader #2: 21:14:35.171688 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2025-12-04.v1.count
    run_test.go:68: uploader #4: 21:14:35.173540 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2025-12-03.v1.count
...
    run_test.go:68: uploader #4: 21:14:35.191236 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/upload.test@devel-devel-linux-mips64le-2025-12-12.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/upload.test@devel-devel-linux-mips64le-2025-12-12.v1.count
    run_test.go:68: uploader #4: 21:14:35.191281 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/upload.test@devel-devel-linux-mips64le-2025-12-13.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/upload.test@devel-devel-linux-mips64le-2025-12-13.v1.count
    run_test.go:68: uploader #4: 21:14:35.191320 reports.go:64: Failed to create report for 2025-12-14: local report /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/local.2025-12-14.json already exists
    run_test.go:68: uploader #4: 21:14:35.191521 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/upload.test@devel-devel-linux-mips64le-2025-12-14.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/upload.test@devel-devel-linux-mips64le-2025-12-14.v1.count
    run_test.go:68: uploader #4: 21:14:35.191578 reports.go:64: Failed to create report for 2025-12-21: local report /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/local.2025-12-21.json already exists
    run_test.go:68: uploader #4: 21:14:35.191613 run.go:172: Uploading 1 reports
    run_test.go:68: uploader #4: 21:14:35.191674 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/2025-12-07.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent1390881164/001/local/2025-12-07.json
    run_test.go:605: error unmarshalling uploaded report: unexpected end of JSON input
        contents:
--- FAIL: TestRun_Concurrent (0.17s)

    — watchflakes

  23. gopherbot
    modified the milestones: Go1.26, Go1.27 on Feb 10, 2026

  24. gopherbot commented on Jun 8, 2026

    @gopherbot
    gopherbot
    on Jun 8, 2026
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2026-06-03 14:54 x_telemetry-go1.26-linux-arm telemetry@488200d4 release-branch.go1.26@a9ce111d x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:68: uploader #3: 14:57:41.351859 findwork.go:35: Finding work: mode on asof 2025-06-03 00:00:00 +0000 UTC
    run_test.go:68: uploader #3: 14:57:41.351989 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-05-13.v1.count
    run_test.go:68: uploader #3: 14:57:41.352061 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-05-14.v1.count
    run_test.go:68: uploader #3: 14:57:41.352129 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-05-15.v1.count
    run_test.go:68: uploader #3: 14:57:41.352204 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-05-16.v1.count
    run_test.go:68: uploader #3: 14:57:41.352286 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-05-17.v1.count
    run_test.go:68: uploader #3: 14:57:41.352356 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-05-18.v1.count
    run_test.go:68: uploader #3: 14:57:41.352421 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-05-19.v1.count
    run_test.go:68: uploader #3: 14:57:41.352486 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-05-20.v1.count
...
    run_test.go:68: uploader #2: 14:57:41.361641 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3236629292/001/local/upload.test@devel-devel-linux-arm-2026-05-25.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3236629292/001/local/upload.test@devel-devel-linux-arm-2026-05-25.v1.count
    run_test.go:68: uploader #2: 14:57:41.361667 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3236629292/001/local/upload.test@devel-devel-linux-arm-2026-05-26.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3236629292/001/local/upload.test@devel-devel-linux-arm-2026-05-26.v1.count
    run_test.go:68: uploader #2: 14:57:41.361681 reports.go:64: Failed to create report for 2026-06-01: local report /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3236629292/001/local/local.2026-06-01.json already exists
    run_test.go:68: uploader #2: 14:57:41.361699 run.go:172: Uploading 2 reports
    run_test.go:68: uploader #2: 14:57:41.361729 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3236629292/001/local/2026-05-18.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3236629292/001/local/2026-05-18.json
    run_test.go:68: uploader #2: 14:57:41.361757 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3236629292/001/local/2026-05-25.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent3236629292/001/local/2026-05-25.json
    run_test.go:68: uploader #4: 14:57:41.361884 upload.go:115: Uploaded 2026-05-25.json to "http://127.0.0.1:34503/2026-05-25"
    run_test.go:605: error unmarshalling uploaded report: unexpected end of JSON input
        contents:
--- FAIL: TestRun_Concurrent (0.13s)

    — watchflakes

  25. gopherbot commented on Aug 14, 2026

    @gopherbot
    gopherbot
    on Aug 14, 2026
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2026-08-11 18:25 x_telemetry-gotip-linux-arm telemetry@a038080d go@2a74f637 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:68: uploader #1: 13:58:27.161754 findwork.go:35: Finding work: mode on asof 2025-08-14 00:00:00 +0000 UTC
    run_test.go:68: uploader #1: 13:58:27.161871 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-07-24.v1.count
    run_test.go:68: uploader #1: 13:58:27.161940 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-07-25.v1.count
    run_test.go:68: uploader #1: 13:58:27.162002 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-07-26.v1.count
    run_test.go:68: uploader #1: 13:58:27.162073 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-07-27.v1.count
    run_test.go:68: uploader #1: 13:58:27.162138 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-07-28.v1.count
    run_test.go:68: uploader #1: 13:58:27.162198 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-07-29.v1.count
    run_test.go:68: uploader #1: 13:58:27.162256 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-07-30.v1.count
    run_test.go:68: uploader #1: 13:58:27.162320 findwork.go:50: Collecting count file upload.test@devel-devel-linux-arm-2026-07-31.v1.count
...
    run_test.go:68: uploader #1: 13:58:27.174690 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent851596348/001/local/2026-08-08.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent851596348/001/local/2026-08-08.json
    run_test.go:68: uploader #2: 13:58:27.174952 upload.go:115: Uploaded 2026-08-08.json to "http://127.0.0.1:37223/2026-08-08"
    run_test.go:68: uploader #0: 13:58:27.175782 upload.go:115: Uploaded 2026-07-25.json to "http://127.0.0.1:37223/2026-07-25"
    run_test.go:68: uploader #3: 13:58:27.176051 upload.go:115: Uploaded 2026-08-01.json to "http://127.0.0.1:37223/2026-08-01"
    run_test.go:68: uploader #0: 13:58:27.176072 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent851596348/001/local/2026-08-01.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent851596348/001/local/2026-08-01.json
    run_test.go:68: uploader #0: 13:58:27.176139 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent851596348/001/local/2026-08-08.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent851596348/001/local/2026-08-08.json
    run_test.go:68: uploader #3: 13:58:27.176247 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent851596348/001/local/2026-08-08.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent851596348/001/local/2026-08-08.json
    run_test.go:605: error unmarshalling uploaded report: unexpected end of JSON input
        contents:
--- FAIL: TestRun_Concurrent (0.15s)

    — watchflakes

  26. gopherbot
    modified the milestones: Go1.27, Go1.28 on Aug 19, 2026

  27. gopherbot commented on Oct 9, 2026

    @gopherbot
    gopherbot
    on Oct 9, 2026
    ContributorAuthor

    Found new dashboard test flakes for:

    #!watchflakes
default <- pkg == "golang.org/x/telemetry/internal/upload" && test == "TestRun_Concurrent"
    2026-09-24 15:27 x_telemetry-go1.26-linux-mips64le telemetry@ed294f94 release-branch.go1.26@51e7ce32 x/telemetry/internal/upload.TestRun_Concurrent (log) 
    === RUN   TestRun_Concurrent
    run_test.go:68: uploader #4: 15:57:52.477110 findwork.go:35: Finding work: mode on asof 2025-10-09 00:00:00 +0000 UTC
    run_test.go:68: uploader #4: 15:57:52.477441 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2026-09-18.v1.count
    run_test.go:68: uploader #4: 15:57:52.477578 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2026-09-19.v1.count
    run_test.go:68: uploader #4: 15:57:52.477685 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2026-09-20.v1.count
    run_test.go:68: uploader #4: 15:57:52.477785 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2026-09-21.v1.count
    run_test.go:68: uploader #4: 15:57:52.477894 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2026-09-22.v1.count
    run_test.go:68: uploader #4: 15:57:52.477995 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2026-09-23.v1.count
    run_test.go:68: uploader #4: 15:57:52.478094 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2026-09-24.v1.count
    run_test.go:68: uploader #4: 15:57:52.478194 findwork.go:50: Collecting count file upload.test@devel-devel-linux-mips64le-2026-09-25.v1.count
...
    run_test.go:68: uploader #4: 15:57:52.495648 reports.go:64: Failed to create report for 2026-10-01: local report /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2467148360/001/local/local.2026-10-01.json already exists
    run_test.go:68: uploader #4: 15:57:52.495875 reports.go:113: remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2467148360/001/local/upload.test@devel-devel-linux-mips64le-2026-10-01.v1.count: no such file or directory failed to remove /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2467148360/001/local/upload.test@devel-devel-linux-mips64le-2026-10-01.v1.count
    run_test.go:68: uploader #4: 15:57:52.495925 reports.go:64: Failed to create report for 2026-10-08: local report /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2467148360/001/local/local.2026-10-08.json already exists
    run_test.go:68: uploader #4: 15:57:52.495960 run.go:172: Uploading 1 reports
    run_test.go:68: uploader #4: 15:57:52.496010 upload.go:56: open /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2467148360/001/local/2026-09-24.json: no such file or directory reading /home/swarming/.swarming/w/ir/x/t/TestRun_Concurrent2467148360/001/local/2026-09-24.json
    run_test.go:68: uploader #1: 15:57:52.493880 run.go:172: Uploading 0 reports
    run_test.go:68: uploader #2: 15:57:52.496205 upload.go:115: Uploaded 2026-10-08.json to "http://127.0.0.1:36457/2026-10-08"
    run_test.go:605: error unmarshalling uploaded report: unexpected end of JSON input
        contents:
--- FAIL: TestRun_Concurrent (0.22s)

    — watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

NeedsInvestigationSomeone must examine and confirm this is a valid issue and not a duplicate of an existing one.telemetryx/telemetry issues

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions