Translator Testing Model

This is a preliminary schema repo for defining test cases in Translator that can be reused in different test suites. e.g. a test case in plain language might be something like "what drugs may treat MS? I expect fingolimod to return in the top 10 results in less than 5 mins."

Capturing these details in metadata that is parsable and usable by test runners is the objective of this schema. We also want to harmonize our language and nomenclature for the metadata we need (which of these data are required and which are optional for each kind of test case, etc.) so that downstream testing code can utilize a common framework for understanding.

Website

https://TranslatorSRI.github.io/TranslatorTestingModel

Repository Structure

• examples/ - example data
• project/ - project files (do not edit these)
• src/ - source files (edit these)
  • translator testing model specification
    • schema -- LinkML schema (edit this)
    • datamodel -- generated Python datamodels
      • Pydantic - this is a version 2 model.
      • Python Dataclasses
• tests/ - Python tests

Developer Documentation

The project uses [Poetry](https://python-poetry.org/) to manage its dependencies. Install Poetry then:

• poetry shell: start up a poetry shell virtual environment
• poetry install: to install required dependencies

Then use the make command to generate project artifacts:

• make gen-project: regenerates core project artifacts
• make all: make everything
• make deploy: deploys site

Credits

This project was made with linkml-project-cookiecutter.