Overhaul local development workflow

[runleveldev]

Testing this PR

Once merged to main, all the latest references will work, until then it's best to build the required containers locally.

cd images
docker buildx bake --set manager.tags=ghcr.io/mieweb/opensource-server/manager:latest
cd ..
docker compose up -d --wait --build

Then the documentation should be accessible at https://localhost and the manager UI at https://manager.localhost.

Copilot Summary

This pull request introduces a comprehensive overhaul of the development and deployment workflow for the Proxmox-based LXC container hosting platform. The changes add a full Docker Compose-based local development stack that simulates a Proxmox cluster, automates image and dependency management, and clarifies documentation. In addition, there are improvements to cookie handling for authentication, service initialization, and infrastructure Dockerfiles.

Development and Deployment Workflow Overhaul:

• New Docker Compose Stack for Local Development:

  • Adds a new compose.yml at the repository root that orchestrates services for a local Proxmox cluster, manager, documentation, and supporting tasks, automating image pulls, dependency installation, and manager bootstrapping.
  • Removes the old create-a-container/compose.yml in favor of the new unified stack.
  • Provides a new Proxmox VE Docker image (images/proxmox-ve) with supporting configuration, systemd units, and health checks. [1] [2] [3] [4] [5]

• Documentation and Onboarding Improvements:

  • Rewrites the README.md to point users to a structured documentation site, clarify the repository layout, and provide clear getting started instructions for different audiences.

Authentication and Service Initialization:

• Improved Session Cookie Logic:

  • Refactors session cookie generation to comply with RFC 6265, ensuring correct domain scoping for subdomains, IP addresses, and localhost, and making the secure flag track the actual request protocol. [1] [2] [3]

• Systemd and Service Startup Enhancements:

  • Updates job-runner.service to depend on the container-creator initialization and to use a shared environment file for configuration. [1] [2]

Infrastructure and Image Improvements:

• Agent and Proxmox Image Updates:
  • Adds an auth cache directory for NGINX forward authentication and updates the bundled uv version for documentation building in the agent Dockerfile. [1] [2]

---

Development and Deployment Workflow Overhaul

• Added a new root-level compose.yml that sets up a local Proxmox cluster, manager, documentation builder, and supporting services for seamless local development and testing.
• Removed the old create-a-container/compose.yml in favor of the new unified stack.
• Introduced a new Proxmox VE Docker image (images/proxmox-ve) with systemd units, health checks, network configuration, and repo setup for realistic cluster simulation. [1] [2] [3] [4] [5]

Documentation and Onboarding Improvements

• Rewrote README.md to direct users to the documentation site, clarify project structure, and provide clear onboarding for different use cases.

Authentication and Service Initialization

• Improved session cookie logic in server.js to handle domain scoping and secure flag based on protocol, ensuring compatibility with subdomains, IPs, and localhost. [1] [2] [3]
• Updated job-runner.service to depend on initialization and use a shared environment file for configuration. [1] [2]

Infrastructure and Image Improvements

• Added auth cache directory for NGINX forward authentication and updated the documentation build tool version in the agent Dockerfile. [1] [2]