Skip to content

iVis-at-Bilkent/sybvals

Repository files navigation

SyBValS

Systems Biology Validation Service (SyBValS) is a web service to validate maps in SBGNML format and to produce graphical images of the map with an option to highlight errors. After validating maps, if desired, SyBValS will resolve these errors when possible, reproducing the image after any fixes and returning the corrected SBGN file.

Here is an example map with errors after the user applies Validate:

A screenshot from the sample deployment of SyBValS for validation

Notice how each error is color-coded both in its text description and in the image, respectively.

Here is the same map after the user applied Resolve Errors:

A screenshot from the sample deployment of SyBValS for validation

All problems have now been fixed.

The main capabilities of SyBValS include:

  • validate and create an image of a map in SBGNML format, and
  • resolve the errors in a map in SBGNML format, recreate an image of the validated map and produce corrected version of the input SBGN file.

Backed by these capabilities, SyBValS can be used to validate, resolve, and generate images of SBGN models (e.g., for including in web pages or scientific articles).

SyBValS is distributed under the MIT License. Here is a sample server deployment along with a simple client-side demo:

Setup of a service

In order to deploy and run a local instance of the service, please follow the steps below:

Installation

git clone https://github.com/iVis-at-Bilkent/sybvals.git
cd sybvals
npm install   // this may take a while

Starting server

The default port is 3400, you can change it by setting 'PORT' environment variable.

npm run start

Note #1: We recommend the use of Node.js version 20.x and npm version 10.x. We used Node.js v20.14.0 and npm v10.7.0 during development.

Note #2: This service uses Puppeteer to generate the output. Please refer to the Puppeteer documentation to ensure that your machine is configured properly to run Chrome headlessly.

Docker

Alternatively, you can use Dockerfile provided in the root directory. Please note that Dockerfile currently works in Linux and Windows environments and does not work in macOS because of Puppeteer related issues. To run the Dockerfile (below commands may require sudo in Linux environment):

First, cd into the folder where Dockerfile is located.

Then, build a Docker image with name sybvals (this may take a while).

docker build -t sybvals .

Lastly, run the image from port 3000. If you want to use another port, please change the first port number in below command.

docker run -p 3400:3400 sybvals

Supported format and validation rules

SyBValS supports SBGNML as the input format. The notation used for this format:

SBGNML Stylesheet


Validation Rules

SyBValS uses the validation rules defined in libSBGN. Below table lists the following for each validation problem:

  • error code,
  • associated message,
  • action to be taken by SyBValS to highlight the problem and
  • action to be taken by SyBValS to fix the problem
Validation Rule Table
Error Code Associated Message Highlight Action Fix Action
pd10101 Arc with class consumption must have source reference to glyph of EPN classes Highlight consumption arc that does not comply with the rule Swap the source and target of the arc if they seem to be reversed.
pd10102 Arc with class consumption must have target reference to port on glyph with PN classes Highlight consumption arc that does not comply with the rule Connect the target to the process if the target is a process.
pd10103 The 'source and sink' glyph can be connected to at most one consumption arc Highlight ‘source and sink’ glyph that does not comply with the rule Split the source and sink glyph for each consumption arc.
pd10104 The 'dissociation' glyph can only be connected to one consumption glyph Highlight multiple consumption glyphs connected to the dissociation List all such consumption glyphs and ask to identify the correct one and remove the others
pd10105 Arc with class production must have source reference to port on glyph with PN classes Highlight production arcs that do not comply with the rule Swap the source and target of the arc if that looks like fixing the problem
pd10106 Arc with class production must have target reference to glyph of EPN classes Highlight production arcs that do not comply with the rule Swap the source and target of the arc if that looks like fixing the problem
pd10107 The 'source and sink' glyph can be connected to at most one production glyph Highlight 'source and sink' glyphs that do not comply with the rule as well as the connected arcs Split the source and sink glyph for each production arc
pd10108 The association glyph can only be connected to one production glyph Highlight the association glyph connected to multiple production glyphs List all such production glyphs and ask to identify the correct one and remove the others
pd10109 Modulation arc must have source reference to glyph of EPN classes or a logical operator Highlight modulation arcs that do not comply with the rule List nearby EPNs and logical operators and ask to choose the right source
pd10110 Modulation arc must have target reference to PN classes Highlight modulation arcs that do not comply with the rule List nearby PNs and ask to choose the right target
pd10111 and', 'or', and 'not' glyphs must be the source for exactly one arc Highlight multiple outgoing arcs List all targets of such arcs and ask which to keep and remove the others
pd10112 If there are compartments defined, top-level glyphs must have a compartmentRef Highlight any such glyph(s) not having a compartmentRef List top-level compartments and ask to see if they would like to place such glyph(s) inside one of listed compartments
pd10124 Arc with class logic arc must have source reference to glyph of EPN classes, or logic gates Highlight logic arcs that do not comply with the rule List nearby glyphs that are valid sources for the problematic logic arc and ask to choose the right one, and connect the logic arc to it instead
pd10125 Arc with class logic arc must have target reference to a logical operator Highlight logic arcs that do not comply with the rule List nearby logical operators that are valid targets for the problematic logic arc and ask to choose the right one, and connect the logic arc to it instead
pd10126 The 'not' glyph can only be the target of one logic arc glyph Highlight multiple incoming arcs List all logic arcs connected to the problematic ‘not’ glyph, and ask to choose the right one to keep and remove the others
pd10127 Arc with class equivalence arc must have source reference to glyph of EPN classes Highlight equivalence arcs that do not comply with the rule -
pd10128 Arc with class equivalence arc must have target reference to glyph of classes 'tag', 'submap' or 'terminal' Highlight equivalence arcs that do not comply with the rule -
pd10129 All state variables associated with a Stateful Entity Pool Node should be unique and not duplicated within that node Highlight duplicate state variables -
pd10131 EPNs should not be orphaned (i.e. they must be associated with at least one arc) Highlight orphaned EPNs -
pd10132 All process nodes (with the exception of phenotype) must have an LHS and RHS Highlight processes without LHS/RHS -
pd10133 All EPNs on the LHS of a process must be unique Highlight EPNs with the same name/ID (not just cloned EPNs but also same EPNs in different compartments) -
pd10134 If more than one set of stoichiometries can be applied to the flux arcs of the process then the stoichiometry of the flux arcs must be displayed - -
pd10135 If the stoichiometry is undefined or unknown this should be indicated by the use of a question mark ("?") - -
pd10140 This 'glyph class' is not allowed in Process Description Highlight the corresponding glyphs (from AF or ER) -
pd10141 All process nodes should have at least one input and at least one output pointing to the arcs Highlight processes with missing arcs -
pd10142 Logic arc must be connected to either 'OR', 'AND' or 'NOT' Highlight logic arcs that are not connected to either 'OR', 'AND' or 'NOT' -

Usage

Sending request to the local deployment via curl to validate map:

curl -X POST -H "Content-Type: text/plain" --data "request_body" http://localhost:3400/validation

and via Fetch API

let settings = {
  method: 'POST',
  headers: {
    Accept: 'application/json',
    'Content-Type': 'text/plain'
  },
  body: request_body
};

let result = await fetch("http://localhost:3400/validation", settings)
  .then(response => response.json())
  .then(res => {
    return res;
  })
  .catch(e => {
    return e;
  });

where validation is indicating validation is applied to map in SBGNML.

request_body needs to be formed in the following way:

file_content + JSON.stringfy(options)

where options is an object consisting of imageOptions. Example:

options = {
  imageOptions: {
    format: 'png',              // output format
    background: 'transparent',  // background color
    color: 'greyscale'          // node color
    width: 1280,                // desired width
    height: 720,                // desired height
    autoSize: true,             // automatically size image with no padding
    highlightWidth: 10          // underlay padding used to highlight errors
  }
}

Note: While sending the requests via curl, any " in the request_body should be replaced with \" and all newline characters should be removed.

Image options support three output formats: png, jpg and svg. background attribute should be a hex color code or transparent. color attribute should be one of the following predefined color schemes: bluescale, greyscale, red_blue, green_brown, purple_brown, purple_green, grey_red, and black_white. If autoSize attribute is true, then width and height values are ignored.

After the request is sent, the server will validate the map in SBGNML format and return the error information in JSON format and image information (in base64uri encoding for png and jpg formats and in xml for the svg format). Error information will contain error number, error pattern, textual explanation of the error, id of the graph element involved in the error and highlight color of the error in the corresponding image.

If an error occurs during validation, the response of the server will consist of an error message.

For instance, a sample SBGNML file can be validated and a corresponding PNG image can be generated by making a query to the sample deployment of SyBValS web service via curl in the following way:

curl -X POST -H "Content-Type: text/plain" --data "<?xml version='1.0' encoding='UTF-8' standalone='yes'?> <sbgn xmlns='http://sbgn.org/libsbgn/0.2'> <map language='hybrid any'> <glyph id='glyph1' class='simple chemical'> <label text='DHA-P'/> <bbox x='30' y='20' w='60' h='60'/> </glyph> <glyph id='glyph2' class='simple chemical'> <label text='GA-3P'/> <bbox x='30' y='220' w='60' h='60'/> </glyph> <glyph id='pn1' class='process'> <bbox x='50' y='140' w='20' h='20'/> <port id='pn1.1' x='60' y='130'/> <port id='pn1.2' x='60' y='170'/> </glyph> <arc id='a2' class='consumption' source='pn1.2' target='glyph2'> <start x='60' y='170.625'/> <end x='60' y='219.375'/> </arc> <arc id='a1' class='production' source='pn1.1' target='glyph1'> <start x='60' y='129.375'/> <end x='60' y='83.75'/> </arc> </map> </sbgn>{\"imageOptions\":{\"format\":\"png\",\"background\":\"transparent\", \"width\": 1280, \"height\": 1280, \"color\":\"bluescale\", \"highlightWidth\": 10}}" http://sybvals.cs.bilkent.edu.tr/validation

and the corresponding response with error and image information will be as follows:

{"errors":[{"text":"Arc with class consumption must have source reference to glyph of EPN classes\n","pattern":"pd10101","role":"a2","color" : "#1e90ff"."errorNo":1}..."image":"data:image/png;base64,iVBORw0KGgoAAAA..."

The same query can be done via Fetch API in the following way:

let settings = {
  method: 'POST',
  headers: {
    Accept: 'application/json',
    'Content-Type': 'text/plain'
  },
  body: <?xml version='1.0' encoding='UTF-8' standalone='yes'?>
        <sbgn xmlns="http://sbgn.org/libsbgn/0.2">
          <map language="PD">
            <glyph id="glyph1" class="simple chemical">
              <label text="DHA-P"/>
              <bbox x="30" y="20" w="60" h="60"/>
            </glyph>
            <glyph id="glyph2" class="simple chemical">
              <label text="GA-3P"/>
              <bbox x="30" y="220" w="60" h="60"/>
            </glyph>
            <glyph id="pn1" class="process">
              <bbox x="50" y="140" w="20" h="20"/>
              <port id="pn1.1" x="60" y="130"/>
              <port id="pn1.2" x="60" y="170"/>
            </glyph>
            <arc id="a2" class="consumption" source="pn1.2" target="glyph2">
              <start x="60" y="170.625"/>
              <end x="60" y="219.375"/>
            </arc>
            <arc id="a1" class="production" source="pn1.1" target="glyph1">
              <start x="60" y="129.375"/>
              <end x="60" y="83.75"/>
            </arc>
          </map>
        </sbgn>{imageOptions":{"format":"png","background":"transparent","width":1280,"height":720,"color":"bluescale","highlightWidth":10}} // file_content + JSON.stringfy(options)
};

let result = await fetch("http://sybvals.cs.bilkent.edu.tr/validation, settings)
  .then(response => response.json())
  .then(res => {
    return res;
  })
  .catch(e => {
    return e;
  });

let errorInfo = result["errors"];                     // [{"text": "Arc with class consumption must have source reference to glyph of EPN classes",...}]
let imageInfo = result["imageErrorsHighlighted"];     // data:image/png;base64,iVBORw0KGgoAAAANSUhE... (in `base64uri` for `png` and `jpg` and in `xml` for `svg`)

Sending request to the sample deployment via curl to resolve errors after validation of map:

curl -X POST -H "Content-Type: text/plain" --data "<?xml version='1.0' encoding='UTF-8' standalone='yes'?> <sbgn xmlns='http://sbgn.org/libsbgn/0.2'> <map language='hybrid any'> <glyph id='glyph1' class='simple chemical'> <label text='DHA-P'/> <bbox x='30' y='20' w='60' h='60'/> </glyph> <glyph id='glyph2' class='simple chemical'> <label text='GA-3P'/> <bbox x='30' y='220' w='60' h='60'/> </glyph> <glyph id='pn1' class='process'> <bbox x='50' y='140' w='20' h='20'/> <port id='pn1.1' x='60' y='130'/> <port id='pn1.2' x='60' y='170'/> </glyph> <arc id='a2' class='consumption' source='pn1.2' target='glyph2'> <start x='60' y='170.625'/> <end x='60' y='219.375'/> </arc> <arc id='a1' class='production' source='pn1.1' target='glyph1'> <start x='60' y='129.375'/> <end x='60' y='83.75'/> </arc> </map> </sbgn>{\"imageOptions\":{\"format\":\"png\",\"background\":\"transparent\", \"width\": 1280, \"height\": 1280, \"color\":\"bluescale\", \"highlightWidth\": 10}}" http://sybvals.cs.bilkent.edu.tr/fixError

The same query can be done via Fetch API in the following way:

let settings = {
  method: 'POST',
  headers: {
    Accept: 'application/json',
    'Content-Type': 'text/plain'
  },
  body: <?xml version='1.0' encoding='UTF-8' standalone='yes'?>
        <sbgn xmlns="http://sbgn.org/libsbgn/0.2">
          <map language="PD">
            <glyph id="glyph1" class="simple chemical">
              <label text="DHA-P"/>
              <bbox x="30" y="20" w="60" h="60"/>
            </glyph>
            <glyph id="glyph2" class="simple chemical">
              <label text="GA-3P"/>
              <bbox x="30" y="220" w="60" h="60"/>
            </glyph>
            <glyph id="pn1" class="process">
              <bbox x="50" y="140" w="20" h="20"/>
              <port id="pn1.1" x="60" y="130"/>
              <port id="pn1.2" x="60" y="170"/>
            </glyph>
            <arc id="a2" class="consumption" source="pn1.2" target="glyph2">
              <start x="60" y="170.625"/>
              <end x="60" y="219.375"/>
            </arc>
            <arc id="a1" class="production" source="pn1.1" target="glyph1">
              <start x="60" y="129.375"/>
              <end x="60" y="83.75"/>
            </arc>
          </map>
        </sbgn>{imageOptions":{"format":"png","background":"transparent","color":"bluescale","autoSize":"true","highlightWidth":10}} // file_content + JSON.stringfy(options)
};

let result = await fetch("http://sybvals.cs.bilkent.edu.tr/fixError, settings)
  .then(response => response.json())
  .then(res => {
    return res;
  })
  .catch(e => {
    return e;
  });

let errorInfo = result["errors"];    // [{"text": "Arc with class consumption must have source reference to glyph of EPN classes",...}]
let imageInfo = result["image"];     // data:image/png;base64,iVBORw0KGgoAAAANSUhE... (in `base64uri` for `png` and `jpg` and in `xml` for `svg`)

Please note that fixError option is used instead of validation to indicate that error resolving is applied to the map.

Credits

SyBValS uses the Express framework for handling HTTP requests. Actual operations are performed using Cytoscape.js and its extensions (see the package.json file for a complete listing). Among these extensions, Cytosnap is particularly needed for creating a headless Chrome instance, on which graph creation, rendering, layout and image creation of the input graphs are performed.

Icons in the client demo are made by Freepik and Flaticon licensed with Creative Commons BY 3.0.

Third-party libraries used in web service: sbgnviz.js, cytoscape-sbgn-stylesheet, cytosnap, express, cors, jQuery, jsdom, nodemon, jest, super-test, xml2js, SaxonJS. Saxonjs is used with Public License.

Third-party libraries used in demo client: Semantic UI, underscore.js, backbone.js, FileSaver.js

Team

Yusuf Ziya Özgül, Hasan Balci and Ugur Dogrusoz of i-Vis at Bilkent University

Releases

No releases published

Packages

No packages published

Languages