Skip to content

ERROR running playbook on QA2 #321

@martindemko

Description

@martindemko

Playbook failed on nginx:

fatal: [galaxy-qa2.galaxy.cloud.e-infra.cz]: FAILED! => changed=false 
  msg: The new nginx configuration failed to install or validate, so the previous configuration has been restored. Please investigate the errors above for more information.

However, I was only able to find out this error in the log. Anyway, gravity was restarted, and Galaxy is running. Not sure if it's somehow connected.

fatal: [galaxy-qa2.galaxy.cloud.e-infra.cz]: FAILED! => changed=true 
  cmd:
  - /srv/galaxy/venv/bin/galaxyctl
  - -c
  - /srv/galaxy/config/galaxy.yml
  - graceful
  delta: '0:00:01.286209'
  end: '2026-05-13 22:38:39.588545'
  invocation:
    module_args:
      _raw_params: /srv/galaxy/venv/bin/galaxyctl -c /srv/galaxy/config/galaxy.yml graceful
      _uses_shell: false
      argv: null
      chdir: null
      creates: null
      executable: null
      removes: null
      stdin: null
      stdin_add_newline: true
      strip_empty_ends: true
      warn: false
  msg: non-zero return code
  rc: 1
  start: '2026-05-13 22:38:38.302336'
  stderr: |-
    Traceback (most recent call last):
      File "/srv/galaxy/venv/bin/galaxyctl", line 6, in <module>
        sys.exit(galaxyctl())
                 ^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 1485, in __call__
        return self.main(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 1406, in main
        rv = self.invoke(ctx)
             ^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 1873, in invoke
        return _process_result(sub_ctx.command.invoke(sub_ctx))
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 1269, in invoke
        return ctx.invoke(self.callback, **ctx.params)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 824, in invoke
        return callback(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/decorators.py", line 34, in new_func
        return f(get_current_context(), *args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/commands/cmd_graceful.py", line 19, in cli
        pm.graceful(instance_names=instances_services)
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/process_manager/__init__.py", line 75, in decorator
        routed_func(*args, **kwargs)
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/process_manager/systemd.py", line 382, in graceful
        self.__graceful_service(config, service, service_names)
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/process_manager/systemd.py", line 370, in __graceful_service
        service.rolling_restart(restart_callbacks)
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/state.py", line 275, in rolling_restart
        if not service_instance.is_ready(quiet=False):
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/state.py", line 247, in is_ready
        raise NotImplementedError("is_ready not implemented for base Service class")
    NotImplementedError: is_ready not implemented for base Service class
  stderr_lines: <omitted>
  stdout: |-
    Restarted: galaxy-gunicorn.service
    Restarted: galaxy-celery.service
    Restarted: galaxy-celery-beat.service
    Performing rolling restart on service: handler
  stdout_lines: <omitted>

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions