Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validation scheme #306

Merged
merged 10 commits into from
May 12, 2020
Merged
Show file tree
Hide file tree
Changes from 7 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@ Here is a template for new release sections
## [Unreleased]

### Added
- Validation scheme (#306)
ursulaelmir marked this conversation as resolved.
Show resolved Hide resolved
- Pull request template (#198)
- Issue template (#212)
- File `troubleshooting.rst` to readthedocs
Expand Down
19 changes: 19 additions & 0 deletions docs/Overview.rst
Original file line number Diff line number Diff line change
Expand Up @@ -7,3 +7,22 @@ H2020 Project E-Land

License
-------

MVS Validation Plan
-------

The adopted validation plan is part of the MVS’ entire development process and is based on three main validation types: conceptual model validation, model verification and operational validity. Following some in-depth research, a validation approach is chosen for the MVS, through which the most appropriate validation techniques are applied to the MVS so that it gains the necessary credibility.

Conceptual model validation consists of looking into the underlying theories and assumptions. Therefore, the conceptual validation scheme includes a comprehensive review of the generated equations by the oemof python library and the components’ models. Next step is to try and adapt them to one pilot project with specific constraints. Tracing and examining the flowchart is also considered as part of this validation type. The aim is to assess the reasonability of the model behavior through pre-requisite knowledge.
ursulaelmir marked this conversation as resolved.
Show resolved Hide resolved

Model verification is related to computer programming and looks into whether the code is a correct representation of the conceptual model. To accomplish that, integration tests for each module will be written to assert that the output is as expected. The simulation will also be run several times for the same input data to double check the results.
ursulaelmir marked this conversation as resolved.
Show resolved Hide resolved

Operational validity determines if the model’s output is within the required accuracy. In order to achieve that, several validation techniques are used, namely:
ursulaelmir marked this conversation as resolved.
Show resolved Hide resolved

* Benchmark testing, through which scenarios are created with different constraints and component combinations, and the output is calculated and compared to the expected one;

* Extreme scenarios (e.g., drastic meteorological conditions), created to make sure the simulation is through, then evaluate the output behavior by the use of graphs and qualitative analysis;

* Replication of one pilot project, with a validated optimization model with different component representation to compare and assess the results; and

* Sensitivity analysis, through which input-output transformations are studied to show the impact of changing the values of some input parameters.