Records Synchronisation

[exalate-issue-sync]

Enable data synchronization across nodes by leveraging storage layer, OCI registries, and replication by labels.

Agent directory records are distributed across agent directory nodes via the OCI distribution spec. Agent directory nodes embeds a zot server which is a standard OCI server which takes care of all OCI functionalities such as OCI distribution but also OCI signature storage and records storage via ORAS OCI registry as storage.

In short a node is an Agent directory node from now on and a record is an agent directory record

1. A node works as a control plane operator over the zot server to perform records distribution.
2. Record distribution is triggered by one server to retrieve records from a remote server.
3. A node will negotiate with a remote node credentials valid for the remote zot server to securely perform records retrieval by digest/CID.
4. OCI distribution spec allows to specify which data to retrieve including a single full mirror of the remote server. We support per CID retrieval and mirror.
5. In terms of API, the node exposes a northbound admin API which can be used to trigger a southbound API towards the zot server to perform the actions described above.