"Refresh tests" button missing when telemetry is disabled

[trevor87]

Environment data

• VS Code version: 1.61.2
• Extension version (available under the Extensions sidebar): v2021.10.1365161279
• OS and version: Ubuntu 20.04
• Python version (& distribution if applicable, e.g. Anaconda): Python 3.8.10
• Type of virtual environment used (N/A | venv | virtualenv | conda | ...): N/A
• Value of the python.languageServer setting: "Default"

Expected behaviour

I should be able to see the "refresh tests" button in the testing section with telemetry disabled. Expected:

Actual behaviour

When I set the settings.json like this:

{
    "telemetry.telemetryLevel":"off",
}

the refresh tests button disappears like so:

Steps to reproduce:

1. Open VSCode with an empty settings.json like so:

{
}

Now check the tests -> the button is there.

2. Modify the settings.json as stated above, save and restart vscode.
   -> The button is now gone

[karrtikr]

Thanks for opening the issue. Actually the feature you mentioned is behind an experiment,

vscode-python/src/client/common/experiments/groups.ts

Lines 33 to 40 in ff6a026

	export enum ShowRunFailedTests {
	experiment = 'pythonRunFailedTestsButtonDisplayed',
	}
	// Experiment to show the run failed tests button
	export enum ShowRefreshTests {
	experiment = 'pythonRefreshTestsButtonDisplayed',
	}

and disabling telemetry effectively opts out users from experiments.

We plan to soon remove the experiment, which means the new behavior will be available to all users regardless of their experiment or telemetry settings.

cc / @karthiknadig Should we do it as part of this issue?

[karthiknadig]

@luabud Can we remove the buttons experiment?

@karrtikr Yes. We can do that as a part of this issue.

[trevor87]

Thanks for clarifying! I was suspecting that it might have something to do with experiments but did not know that telemetry also disables those.

[jzazo]

Hi! I still don't see the button, but I see that the experiment has been closed. How can I get the refresh button back? Do we have to wait till November's release? Thanks.

[karrtikr]

You can use Python: Switch to Insiders commands to install the latest insiders version of the extension. Otherwise the stable release for November should also have this fix.

[jzazo]

I installed the stable November release today, but the refresh button still does not show. Any way to check why it doesn't or enable it? Thanks.

[karrtikr]

It has not been released yet I think, it should be out by end of this week, are you on the latest VSCode version?

[jzazo]

I updated today and it lists 1.63.0 on the About window.

[karrtikr]

Then you should be getting it soon.

[jzazo]

The icon appeared today. Thanks!

[karrtikr]

Great!