Skip to content

dehays/DataHarmonizer

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

NMDC DataHarmonizer Demo

DataHarmonizer is a browser-based, spreadsheet-like data entry and validation tool. It is developed by the Centre for Infectious Disease and One Health and Simon Fraser University's Hsiao lab.

NMDC is considereing its use for collection metadata about BioSamples.

Technical details:

DataHarmonizer interfaces are defined by tab-delited tempate files. The NMDC team and CIDGOH are collaboratively developing tools that can convert any LinkML schema into a DataHarmonizer template.

Usage

Watch Rhiannon Cameron and Damion Dooley describe this application on YouTube at the Canadian Research Software Conference (CRSC2021).

Chrome Firefox Edge
49+ 34+ 12+

alt text

Select Template

The default template loaded is the "soil" template. To change the spreadsheet template, select the white text box to the right of Template, it always contains the name of template currently active, or navigated to File followed by Change Template. An in-app window will appear that allows you to select from the available templates in the drop-down menu. After selecting the desired template, click Open to activate the template.

change template

A second way to access templates directly, rather than by the hard-coded menu system, is to specify the DataHarmonizer template subfolder via a "template" URL parameter. This enables development and use of customized templates, or new ones, that DH doesn't have programmed in menu.

For example, http://genepio.org/DataHarmonizer/main.html?template=gisaid accesses the /template/gsiaid/ subfolder's template directly.

See more on the Wiki DataHarmonizer templates page.

Usage

You can edit the cells manually, or upload xlsx, xls, tsv and csv files via File > Open. You can also save the spreadsheet's contents to your local hard-drive in the aforementioned formats, or File > Export your data as an .xls document formatted for submission a specified portal, database, or repository.

saving and exporting files

Click the Validate button to validate your spreadsheet's values against a standardized vocabulary. You can then browse through the errors using the Next Error button. Missing value are indicated in dark red, while incorrect values are light red.

validating cells and checking next error

Double click any column headers for information on the template's vocabulary.

double click headers for more info

You can quickly navigate to a column by selecting Settings > Jump to.... An in-app window will appear, select the desired column header from the drop-down list or begin typing it's name to narrow down the list options. Selecting the column header from the drop down list will immediately relocate you to that column on the spreadsheet.

jump to column

You can also automatically fill a column with a specified value, but only in rows with corresponding values in the first sample ID column. To use this feature select Settings > Fill column.... Select the desired column header from the drop-down list or begin typing it's name to narrow down the list options, then specify the value to fill with and click Ok to apply.

fill column, in rows with corresponding sample IDs, with specified value

For more information on available application features, select the Help button followed by Getting Started from within the DataHarmonizer application.

Additional Information

For more information about the DataHarmonizer, it's templates, and how to use them, check out the DataHarmonizer Wiki.

Support

Open a GH issue specifically for the NMDC DataHarmonizer.

Roadmap

This project is currently in the beta phase, with new features being added occasionally.

Acknowledgement

  • Handsontable was used to build the grid. DataHarmonizer is configured to reference the "non-commercial-and-evaluation" handsontable license "for purposes not intended toward monetary compensation such as, but not limited to, teaching, academic research, evaluation, testing and experimentation"; if this application is used for commercial purposes, this should be revised as per https://handsontable.com/docs/license-key/
  • SheetJS was used to open and save local files. The community edition was used under the Apache 2.0 license.

License

DataHarmonizer javascript, python and other code not mentioned in the Acknowledgement above is covered by the MIT license.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • JavaScript 68.7%
  • HTML 30.2%
  • Other 1.1%