Error when dynamically removing command definition in service provider

[DieterHolvoet]

Describe the bug
I have a module having Drush commands that should only be registered if a certain other module is installed. If I try to do this using Drush 11, I get the following error:

In CheckExceptionOnInvalidReferenceBehaviorPass.php line 86:

  The service "drush.command.services" has a dependency on a non-existent service "wmscaffold.commands.wmmodel".

To Reproduce
Add a service provider removing a command definition, eg.

<?php

namespace Drupal\wmscaffold;

use Drupal\Core\DependencyInjection\ContainerBuilder;
use Drupal\Core\DependencyInjection\ServiceModifierInterface;

class WmscaffoldServiceProvider implements ServiceModifierInterface
{
    public function alter(ContainerBuilder $container)
    {
        if (!$container->hasDefinition('plugin.manager.wmmodel.model')) {
            $container->removeDefinition('wmscaffold.commands.wmmodel');
            $container->removeDefinition('wmscaffold.hooks.wmmodel');
        }
    }
}

Expected behavior
Not throw an exception.

Actual behavior
An exception was thrown.

Workaround
/

System Configuration

Q	A
Drush version?	11.x
Drupal version?	9.x
PHP version	8.x
OS?	Mac

Additional information
/