Longhorn controller (Epic)

[jhmarina]

What needs to be done

Develop an endpoint controller component responsible for managing the deployment of s3gw pods in Longhorn. The controller should create and manage both the s3gw endpoint and the s3gw-ui.

Why it needs to be done

The endpoint controller will provide the necessary functionality to create and manage the s3gw endpoint and the s3gw-ui in Longhorn.

Acceptance Criteria

The controller should be capable of creating and managing s3gw pods, including the s3gw endpoint and the s3gw-ui.

Additional information

Longhorn Enhancement Proposal

Tasks

• [Backlog] [LH] Test- and development environment for LH #625
• [Backlog] [LH] Modify the Longhorn chart to configure the s3gw #627
• Longhorn UI support and integration (Epic) #541

Implement the Longhorn Controller

• Implement CRDs and generated Code
• Implement command line options
• Implement the control loop
• Implement deployment mechanism
• https://github.com/aquarist-labs/s3gw/issues/634
• https://github.com/aquarist-labs/s3gw/issues/635
• Implement uninstall hooks
• https://github.com/aquarist-labs/s3gw/issues/544
• Implement integration tests
• Implement gotests/unittests with mock API
• Implement control logic ensuring filesystem is always XFS with reflinks
• Implement update/modification mechanism
• https://github.com/aquarist-labs/s3gw/issues/711
• https://github.com/aquarist-labs/s3gw/issues/712

[jhmarina]

@jecluis will add tasks to this Epic once he evaluates the work that needs to be done.

[asettle]

@m-ildefons will be conducting some preliminary investigations into testing up an environment suitable for developing and testing the controller. Adding Moritz to this ticket temporarily so that he can get this work done.

Ticket to be reassigned to Joao once he returns from vacation. It may work best to add a task to this ticket.

[jecluis]

Spoke with @m-ildefons this morning. He'll continue working on this. I'll take over should the need come up.

[m-ildefons]

For the time being, I'll manage the code here:
https://github.com/m-ildefons/longhorn/tree/wip/object-endpoint
https://github.com/m-ildefons/longhorn-manager/tree/wip/object-endpoint

[m-ildefons]

These are the PRs open, which implement the LH Controller:
Longhorn: longhorn/longhorn#6640
Longhorn Manager: longhorn/longhorn-manager#2136
Longhorn UI: longhorn/longhorn-ui#649
Longhorn Engine: longhorn/longhorn-engine#934
Backupstore: longhorn/backupstore#148
Longhorn Instance Manager: longhorn/longhorn-instance-manager#285
Integration Tests: longhorn/longhorn-tests#1523

[jecluis]

LH integration is no longer part of the plan.