Integrate arq

[lbedner]

Initial integration of arq, plus many, many other things. Way too many things. All PR's need to be much smaller moving forward 😒

[Copilot]

Pull Request Overview

This PR introduces comprehensive integration of the arq async task queue system into Aegis Stack, adding background job processing capabilities to the existing CLI and stack generation system.

• Adds worker component with multiple queue configurations (system, load_test, media)
• Implements extensive CLI test infrastructure with session-scoped stack generation
• Establishes worker health monitoring and load testing framework

Reviewed Changes

Copilot reviewed 81 out of 84 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
tests/cli/test_utils.py	New shared utilities for CLI testing with command runners and validation helpers
tests/cli/test_stack_validation.py	Stack validation tests ensuring generated projects pass quality checks
tests/cli/test_stack_generation.py	Matrix tests for all valid component combinations and project structures
tests/cli/test_error_handling.py	Error handling tests for invalid inputs and edge cases
tests/cli/test_component_dependencies.py	Component dependency resolution validation tests
tests/cli/test_cli_init.py	Updated CLI initialization tests with worker component support
tests/cli/test_cli_basic.py	Basic CLI functionality tests with updated component names
tests/cli/conftest.py	Test configuration with session-scoped stack generation
scripts/gen_docs.py	Documentation generation improvements with virtual file creation
pyproject.toml	Updated dependencies, exclusions, and build configuration
mkdocs.yml	Documentation structure updates with worker component sections
docs/stylesheets/mermaid.css	Removed mermaid CSS (replaced with custom.css)
docs/stylesheets/custom.css	New custom styles for documentation tables and layout
docs/javascripts/mermaid-config.js	Removed mermaid JavaScript configuration
docs/index.md	Updated feature list to include worker component
docs/components/worker/index.md	Comprehensive worker component documentation
docs/components/worker/extras/load-testing.md	Detailed load testing functionality documentation
docs/components/worker/examples.md	Worker usage examples and patterns
docs/components/worker/configuration.md	Worker configuration and scaling guide
docs/components/index.md	Updated component overview with worker integration
docs/components/frontend/extras/dashboard.md	Health dashboard documentation with theme support
docs/components/frontend.md	Simplified frontend component documentation
docs/cli-reference.md	Updated CLI reference with worker component options
aegis/templates/.../test_core.py	Fixed health endpoint test assertions
aegis/templates/.../test_worker_health_registration.py.j2	Worker health registration tests
aegis/templates/.../test_system_service.py	Updated system service tests for new health structure
aegis/templates/.../test_load_test_service.py	Comprehensive load test service unit tests

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}