Skip to content

restorecommerce/resource-base-interface

Repository files navigation

resource-base-interface

VersionBuild StatusDependenciesCoverage Status

https://github.com/restorecommerce/notification-srv/actions/workflows/build.yaml[image:https://img.shields.io/github/actions/workflow/status/restorecommerce/notification-srv/build.yaml?style=flat-square[Build Status]]

The resource-base-interface describes resource CRUD operations which can be bound to a service. Such operations are described via a gRPC interface with the message structures therefore being defined using Protocol Buffers. This interface can be bound with any protobuf definition as long as it contains the endpoints defined in the resource-base.proto file (note that any resource message structure can be defined).

The exposed gRPC methods are implemented by the ServiceBase object which uses a ResourceAPI instance to perform operations with a database provider. The exposed interface is therefore agnostic to a specific database implementation. However, a valid database provider is required. A set of such providers is implemented in chassis-srv. This interface emits resource-related messages to Apache Kafka which can be enabled or disabled at the ServiceBase's constructor.

Methods for managing and traversing graph databases are supported for the ArangoDB provider

gRPC Interface

This interface describes the following gRPC endpoints for a generic resource of type Resource.

io.restorecommerce.resourcebase.Resource

Field Type Label Description
id string optional identifier for the resource
meta io.restorecommerce.meta.Meta meta optional Meta information common to all Restore Commerce resources
value number optional value for the resource
text string optional textual data for the resource

Create

This operation is used for inserting resources to the database. Requests are performed by providing a list of resources which are returned in the response. A meta should be present, containing relevant resource ownership information. Timestamps for creation and modification are then appended automatically to this property upon a Create request. The resource is stored as a normal collection document by default. If there is a graph configuration specified for the resource then it is stored as a vertex collection along with the edge definitions provided in the configuration.

io.restorecommerce.resourcebase.ResourceList

Field Type Label Description
items [ ] io.restorecommerce.resourcebase.Resource required list of resources
total_count number optional total number of resources

Read

This operation returns resources based on provided filter and options. Requests are performed using io.restorecommerce.resourcebase.ReadRequest and responses are a list of resources.

io.restorecommerce.resourcebase.ReadRequest

Field Type Label Description
offset number optional offset of the resource
limit number optional limit, default value is 1000
filters io.restorecommerce.filter.FilterOp optional nested filters based on field values, multiple filters can be combined with AND and OR operators
sorts [ ]io.restorecommerce.resourcebase.Sort optional sort the resources
fields [ ] io.restorecommerce.resourcebase.FieldFilter optional fields selector, list of fields to be included or excluded, by default we get all the fields
search [ ]string optional word search, not yet implemeneted
locales_limiter [ ]string optional querying based on locales, not yet implemented

io.restorecommerce.filter.FilterOp

Field Type Label Description
filters io.restorecommerce.filter.Filter optional nested filters
operator enum optional operator and, or or

io.restorecommerce.graph.Filter

Field Type Label Description
field string required filter based on field
operation enum optional operator eq, lt, lte, gt, gte, isEmpty, ilike, in, neq, default value is eq
value string required filter based on value
type enum optional value type STRING, NUMBER, BOOLEAN, DATE or ARRAY, default value is STRING
filters [ ] io.restorecommerce.filter.FilterOp required nested filters

io.restorecommerce.resourcebase.Sort

Field Type Label Description
field string optional field to be sorted upon
SortOrder enum optional sorting order, UNSORTED, ASCENDING or DESCENDING

io.restorecommerce.resourcebase.FieldFilter

Field Type Label Description
name string optional field name
include bool optional include or exclude field

Update

This operation is used for updating resources in the database. Requests are performed by providing a list of resources and all updated items are returned within the response. Note that the only required properties on each resource are its id and the properties which are meant to be modified. It is possible to specify in the configuration multiple edge definitions for one vertex. These edges are automatically updated when vertex documents are updated.

Upsert

This operation is used for updating resources in the database or creating them if they do not exist. Requests are performed by providing a resource list, which is returned in the response.

Delete

This operation is used for deleting resources in the database. Requests are performed using io.restorecommerce.resourcebase.DeleteRequest and responses are google.protobuf.Empty messages. If a graph vertex is deleted, all connected edges are also deleted.

io.restorecommerce.resourcebase.DeleteRequest

Field Type Label Description
collection string optional Name of the target collection
ids [ ]string optional List of resource identifiers to be deleted; if empty or not provided, the whole collection is truncated

Traversal

This operation is used for traversing graph resource in the database. Requests are performed using io.restorecommerce.graph.TraversalRequest and respone is io.restorecommerce.graph.TraversalResponse message.

io.restorecommerce.graph.TraversalRequest

Field Type Label Description
vertices [ ]io.restorecommerce.graph.Vertices optional list of vertices for traversal
collection io.restorecommerce.graph.Collection optional collection data for traversal
opts io.restorecommerce.graph.Options optional List of options for graph traversal
path bool optional if set to true only the traversed paths are returned
subject io.restorecommerce.auth.Subject required Subject details
filters io.restorecommerce.graph.Filters optional filters

io.restorecommerce.graph.Vertices

Field Type Label Description
collection_name string required collection name
start_vertex_ids [ ] string required list of start vertex ids

io.restorecommerce.graph.Collection

Field Type Label Description
collection_name string required collection name
limit [ ] number optional limit
sorts [ ] io.restorecommerce.resourcebase.Sort optional sorting based on fields

io.restorecommerce.graph.Filters

Field Type Label Description
entity string optional entity name
edge string optional edge name
filters io.restorecommerce.graph.Filter optional Filter
operator enum optional operator, and or or, default is and

io.restorecommerce.graph.Options

Field Type Label Description
include_vertexs [ ] string optional list of vertex's to be included in traversal
exclude_vertexs [ ] string optional list of vertex's to be excluded in traversal
include_edges [ ] string optional list of edge's to be included in traversal
exclude_edges [ ] string optional list of edge's to be excluded in traversal
direction enum optional direction of traversal, OUTBOUND or INBOUND, default is OUTBOUND

io.restorecommerce.graph.TraversalResponse

Field Type Label Description
paths google.protobuf.Any required buffered data, contains the list of visited paths
data google.protobuf.Any required buffered data, contains all the data from the visited vertices
operation_status io.restorecommerce.status.OperationStatus required operation status

Kafka Events

A kafka Topic can be provided when instantiating a ServiceBase. If enableEvents is set to true, a list of events is then emitted to Kafka by this microservice for each document of each CRUD request :

  • Created
  • Read
  • Modified
  • Deleted

The events emitted to Kafka can be used for restoring the system in case of failure by implementing a command-interface in the used microservice. For usage details please see command-interface tests.

Fields Configuration

It is possible to pass a fields configuration object to ResourceAPI in order to enable some special field handlers.

Field Generators

The strategies property can be used to specify fields within each resource which should be generated automatically. Such autogeneration feature currently includes UUIDs, timestamps and sequential counters. The latter one is particularly useful for fields such as a customer or an item number, which can have a type of sequential logic. In these cases, a Redis database is used to generate and read these values efficiently.

Buffer Fields

Buffer-encoded fields can be decoded before being stored in the database. It is possible to specify within the bufferFields property what fields of each resource should be specially handled this way. The values are also encoded into a buffer again when read from the database.

Required Fields

It is possible to specify which fields are required for each document of each resource on the requiredFields config. An InvalidArgument error is thrown if one of these fields is missing when attempting to store a document.

Development

Tests

See tests. To execute the tests a set of backing services are needed. Refer to System repository to start the backing-services before running the tests.

  • To run tests
npm run test

Usage

  • Install dependencies
npm install
  • Build
# compile the code
npm run build