Architecture documentation
This wiki provides a structured overview of the system architecture behind data.norge.no — a national data catalog designed to support the sharing and discovery of public sector data in Norway — as well as adjacent or supporting systems.
The architecture consists of the following subsystems:
- 📝 Registration – For registering and maintaining metadata.
- 🌐 Portal – For searching and browsing metadata.
- 🔄 Harvesting – For ingesting metadata from external sources.
- 📏 Metadata Quality – For validating and enriching metadata.
- 🧑💼 IAM (Identity & Access Management) – For authentication and authorization.
💡 Tip: Click on the images to get a full view of the diagrams. In the full view, every container (deployable unit) is also clickable and will redirect you to the actual repository on GitHub.
Registration is a system for registering and maintaining metadata, intended for organizations that do not have their own systems or data catalog. Employees within these organizations use Registration to create and manage metadata for datasets, data services, general services, and concepts.
The resulting data catalogs are treated like any other external catalog and are harvested through the same harvesting process.
Harvesting is a system for ingesting metadata from data catalogs. These catalogs can either be external, from organizations that maintain their own catalogs, or internal, from catalogs created using the Registration system.
Harvesting supports various resource types, including datasets, data services, general services, events, concepts, and information models. It consumes metadata in RDF format, enriches the content, and transforms it into formats that are better suited for frontend applications and search indexing.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
