Skip to content
BPMN 2.0 Test Cases (Models, Diagrams, Serializations) created by the BPMN Model Interchange Working Group (BPMN MIWG) at the OMG
Shell
Branch: master
Clone or download

Latest commit

Latest commit 6d64594 Mar 25, 2020

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
ADONIS NP 8.0 merge submission from ADONIS NP 8.0 Oct 22, 2019
ARIS Architect 10.0.10
ARIS Architect 9.8.3 Adding ARIS 9.8.3 Mar 11, 2016
Activiti Designer 5.14.1
Aeneis 5.7.89.2400 Renamed folder to match official test suite Nov 22, 2015
BIC Cloud Design 6.2.0 new submission BIC cloud design Mar 25, 2020
BPMN View 1.0.7 BPMN View results 2019 Sep 21, 2019
BPMN+ Composer V.10.4 Itesoft: BPMN+ Composer V.10.4 Submission (Part 2 with Roundtrip case) Jul 30, 2019
BPMN-Modeler for Confluence Enterprise 3.5.1 Test results: BPMN-Modeler for Confluence Enterprise 3.5.1 by viadee … Mar 6, 2020
Bizagi Modeler 2.8.0.8 Removed results of C.1.0 old reference. New tests for C.1.0 are requi… Mar 11, 2015
Bonita BPM 7.2.3 Added roundtrip bpmn files to Bonita folder (were misplaced in refere… Jan 27, 2017
Camunda Eclipse Plugin 3.0.0 Consolidate Camunda test results Apr 5, 2019
Cardanit (prev. BeePMN) 2.21 Cardanit tests submission (#818) Sep 10, 2019
Eclipse BPMN2 Modeler 1.0.1
Enterprise Architect 12.0.1207 Removed results of C.1.0 old reference. New tests for C.1.0 are requi… Mar 11, 2015
Enterprise Explorer 1.0.0 Enterprise Explorer results 2019 Sep 21, 2019
GenMyModel 0.47 Add tests for GenMyModel v0.47 Jul 1, 2015
IBM BlueWorks Live April 2014 Fix folder name to match JSON Oct 15, 2014
IBM Process Designer 8.0.1 flatten directory structure as discussed Apr 23, 2014
KnowProcess 3.0.0-beta-1 fix dir name and update demo participation Dec 31, 2018
MID Innovator 12.3.1.20212 MID Innovator 12.3.1.20212 Feb 17, 2016
MID bpanda 2019.05.0.8393 Add files via upload Jun 14, 2019
ModelFoundry 1.1.1 ModelFoundry 1.1.1 results contribution (on behalf of sam@modelfoundr… Mar 9, 2016
Modelio 3.5 New run of import tests Dec 16, 2015
OMNITRACKER BPMN 11.5 Update of OMNITRACKER BPMN 11.5 Files Mar 19, 2020
OMNITRACKER BPMN OMNITRACKER BPMN 11.5 Mar 11, 2020
Oracle BPM Studio 12.1.3 Results provided by thomas.kauth@oracle.com Oct 15, 2014
Reference Added Reference C.6.0 based on the 2019 Amsterdam MIWG demo Sep 10, 2019
Signavio Process Editor 10.0.0 Signavio Process Editor 10.0.0 test-results Jun 14, 2016
Trisotech BPMN Modeler 6.2.0 Trisotech Submission for C.6.0 Sep 10, 2019
Trisotech BPMN Visio Add in 5.0.1 2015 submission from Trisotech BPMN Modeler 5.0.10 and Trisotech BPMN… Aug 11, 2015
Visual Paradigm 11.1 Add test results for Visual Paradigm 11.1 Jan 23, 2015
W4 BPMN+ Composer V.9.4 W4 test files submissions Jul 12, 2016
Work in Progress A.2.1 is now an official test case. Resolve #187 Jan 20, 2016
Yaoqiang BPMN Editor 4.0 Added Yaoqiang A.2.1 results Jan 27, 2016
actiBPM 3.E-8 Removed results of C.1.0 old reference. New tests for C.1.0 are requi… Mar 11, 2015
bpmn.io (Cawemo, Camunda Modeler) 1.12.0 Consolidate Camunda test results Apr 5, 2019
iGrafx FlowCharter 2013 15.1.1.1580 Added ADONNIS 6 and iGrafx 15 updates May 14, 2014
iGrafx Process 2013 for Six Sigma 15.0.4.1565 flatten directory structure as discussed Apr 23, 2014
ibo Prometheus 3.9.0.0 Trim PNGs using `mogrify -trim +repage *.png` Oct 8, 2015
itp-commerce Process Modeler for Microsoft Visio 6 re-tested C.1.0 Mar 11, 2015
.gitignore Added 1st test submission by Esteco BeePMN Feb 10, 2016
BPMN 2.0 Attribute Coverage Matrix.xlsx Initial Version of Attribute Coverage Map May 28, 2013
LICENSE.txt Added LICENSE.txt Mar 13, 2013
README.md Add files via upload Nov 14, 2017
RTF Proposal Template.dotx Added template for RTF proposals. Dec 19, 2013
pom.xml
publish.sh separate version of tools from test-suite, added publication script, … Nov 5, 2014
test-case-structure.json Removed the numberOfDiagrams attribute of C.6.0 as this was causing a… Sep 12, 2019
tools-tested-by-miwg.json add GBTech to tools json Mar 25, 2020
yaoqiang.sh Oracle (preliminary) and Yaoqiang 2.2.0 results Jun 26, 2013

README.md

Quick links: How to test a tool? -> Test Results

Table of Contents generated with DocToc

BPMN Model Interchange Test Suite

BPMN 2.0 Test Cases (Models, Diagrams, Serializations) created by the BPMN Model Interchange Working Group (BPMN MIWG) at the OMG. For more information see: http://www.omgwiki.org/bpmn-miwg

Call for Participation

If BPMN interchange is important to you:

  • Test your favorite BPMN tool! Users can also submit test results. You don't need to be the author of a tool to test it.
  • Join the Group! Everybody can join. There is no need to be an OMG member. Get in touch with the people behind the standards.
  • Make yourself heard with your vendor.
  • Spread the word and share the test results with your peers.

Test results of BPMN 2.0 tools that participated in the tests

How to test a BPMN tool using this test suite?

Everybody is welcome to test BPMN tools and submit results to the working group, not just tools vendors but also end users that have access to a tool.

Here is how you do it:

1. Download Test Cases

First download the latest version of the BPMN Model Interchange Test Suite and unpack it. TheCe is a directory called Reference, which contains the files needed for testing. Next to that, there will be multiple folders with test results of other tools.

2. Test Import, Export and/or Roundtrip of BPMN Models.

There are different test procedures that can be performed with the provided reference models depending on the capabilities of the tool. You will find explanations of these procedures below.

3. Submit Your Test Results to BPMN MIWG

PacCage all result files in a zip file and send it via email to MIWG@trisotech.com. Please use the following template for your email:

Vendor: 
Tool name: 
Version: 
Website: 
Tool supports BPMN 2.0: 
Tool has BPMN XML import: 
Tool has BPMN XML export: 
Tool supports BPMN XML roundtrip: 
License: 
Notes: 

Alternatively, you may also fork the repository on GitHub, upload the files using your Web browser and submit test results through a pull request. If you do so, make sure to update the JSON file with the list of tools.

Usually one day after your submission our automated tools should have generated a report that shows findings in your submitted files:

Note: By submitting test results you agree that they will be published under a Creative Commons Attribution 3.0 Unported License.

Detailed Description of Test Procedures

Available Features Possible Tests
import only import, cross
export only export
import & export import, export, roundtrip, cross

1. BPMN MIWG Import Test Procedure

If the tool under test supports the import of BPMN XML files, you can test that feature using the following procedure:

  1. Import the BPMN XML file (*.bpmn) provided with a reference model into the tool, e.g. A.1.0.bpmn.
  2. Save the graphical representation of the model as imported to a file named <test id>-import.<diagramNumber>.png, e.g. A.1.0-import.1.png. You can either do that through an export feature of the tool or by taking a screenshot of the canvas. It needs to be saved in PNG format. The <diagramNumber> should be counted in the order in which the diagrams appear inside reference XML file.
  3. Compare the result with the image provided with the reference model, e.g. A.1.0.png.
  4. Report any findings by creating new issues on GitHub – one for each finding. Here is a template for your issue reports:
Tool name: 
Tool version: 
Test case id: 
Test procedure: import
Description: 

Repeat these steps for all reference models and submit your result files to BPMN MIWG.

2. BPMN MIWG Export Test Procedure

If the tool under test supports the export of BPMN XML files, you can test that feature using the following procedure:

  1. Draw the model as shown in the image provided with a reference model into the tool, e.g. A.1.0.png.
  2. Save the graphical representation of the model as drawn to a file named <test id>-export.png, e.g. A.1.0-export.png. You can either do that through an export feature of the tool or by taking a screenshot of the canvas. It needs to be saved in PNG format.
  3. Export the model into a BPMN XML file (*.bpmn) named <test id>-export.bpmn, e.g. A.1.0-export.bpmn.
  4. Compare the result with the BPMN XML file (*.bpmn) provided with the reference model, e.g. A.1.0.bpmn.
  5. Report any findings by creating new issues on GitHub – one for each finding. Here is a template for your issue reports:
Tool name: 
Tool version: 
Test case id: 
Test procedure: export
Description: 

Repeat these steps for all reference models and submit your test results to BPMN MIWG.

3. BPMN MIWG Roundtrip Test Procedure (BPMN Import and Export combined)

If the tool under test supports the import and export of BPMN XML files, you can test a roundtrip using the following procedure:

  1. Import the BPMN XML file (*.bpmn) provided with a reference model into the tool, e.g. A.1.0.bpmn.
  2. If not already done during an import test, save the graphical representation of the model as it is imported to a file named <test id>-import.<diagramNumber>.png, e.g. A.1.0-import.1.png. You can either do that through an export feature of the tool or by taking a screenshot of the canvas. It needs to be saved in PNG format. The <diagramNumber> should be counted in the order in which the diagrams appear inside reference XML file.
  3. Export the model into a BPMN XML file (*.bpmn) named <test id>-roundtrip.bpmn, e.g. A.1.0-roundtrip.bpmn.
  4. Compare the result with the BPMN XML file (*.bpmn) provided with the reference model, e.g. A.1.0.bpmn.
  5. Report any findings by creating new issues on GitHub – one for each finding. Here is a template for your issue reports:
Tool name: 
Tool version: 
Test case id: 
Test procedure: roundtrip
Description: 

Repeat these steps for all reference models and submit your test results to BPMN MIWG.

4. Optional: BPMN MIWG Cross Test Procedure (BPMN Roundtrip with results of other tools)

If the tool under test supports at least the import of BPMN XML files, you may optionally do a cross test with the roundtrip and export test results submitted by other tools:

  1. Import the BPMN XML files (*.bpmn) exported from other tools as their test results into the tool, e.g. A.1.0-roundtrip.bpmn or A.1.0-export.bpmn from the folder of the other tool, e.g. camunda Modeler 2.4.0.
  2. Save the graphical representation of the model as imported to a file named <name of imported file>-import.<diagramNumber>.png, e.g. A.1.0-roundtrip-import.1.png or A.1.0-export-import.1.png. You can either do that through an export feature of the tool or by taking a screenshot of the canvas. It needs to be saved in PNG format. The <diagramNumber> should be counted in the order in which the diagrams appear inside reference XML file. Store the result file in a folder with the name and version of the other tool that exported the file, e.g. camunda Modeler 2.4.0.
  3. Export the model into a BPMN XML file (*.bpmn) named <name of imported file>-roundtrip.bpmn, e.g. A.1.0-roundtrip-roundtrip.bpmn or A.1.0-export-roundtrip.bpmn. Store the result file in a folder with the name and version of the other tool that exported the file, e.g. camunda Modeler 2.4.0.
  4. Compare the result with the BPMN XML file (*.bpmn) provided with the reference model, e.g. A.1.0.bpmn, and/or the imported file, e.g. A.1.0-roundtrip.bpmn or A.1.0-export.bpmn.
  5. Report any findings by creating new issues on GitHub – one for each finding. Here is a template for your issue reports:
Tool name: 
Tool version: 
Name of imported file: 
Tool name of imported file: 
Tool version of imported file: 
Test procedure: cross
Description: 

Repeat these steps for all roundtrip and export test results of all tools and submit your test results to BPMN MIWG.

5. BPMN Import and Export not supported

If the tool does neither support import nor export of BPMN XML files you can not perform the tests described above. However, if the tool supports other model interchange formats, we are still interested to record this information:

  1. Create a new issue on GitHub with a text like:
Tool name: 
Tool version: 
Description:
   The BPMN XML format is not supported.
   Model Interchange is only possible in the `XPDL` format.

Repository Structure

The top level is either a vendor or the submitted reference. The second level holds the individual test case files in the form <identifier>-<test type>.filetype.

The vendor who provided the reference model for a test case will be identified in the file test-case-structure.json.

  • README.md (this file)
  • test-case-structure.json <-- list of test cases
  • tools-tested-by-miwg.json <-- list of tested tools
  • Reference <-- reference files for testing
    • A.1.0.png
    • A.1.0.bpmn <-- look in spreadsheet test-case-structure.json to find vendor who provided this reference
    • ...
  • Trisotech BPMN Web Modeler 4.1.8 <-- test results
    • A.1.0-import.1.png
    • A.1.0-export.png
    • A.1.0-export.bpmn
    • A.1.0-roundtrip.bpmn
    • ...
    • camunda Modeler 2.4.0 <-- cross test results
      • A.1.0-roundtrip-import.1.png
      • A.1.0-roundtrip-roundtrip.bpmn
      • ...
    • MID Innovator 11.5.1.30223 <-- cross test results
      • A.1.0-export-import.1.png
      • A.1.0-export-roundtrip.bpmn
      • ...
    • ...
  • camunda Modeler 2.4.0 <-- test results
    • A.1.0-import.1.png
    • A.1.0-roundtrip.bpmn
    • ...
    • Trisotech BPMN Web Modeler 4.1.8 <-- cross test results
      • A.1.0-export-import.1.png
      • A.1.0-export-roundtrip.bpmn
      • A.1.0-roundtrip-import.1.png
      • A.1.0-roundtrip-roundtrip.bpmn
      • ...
    • ...
  • MID Innovator 11.5.1.30223 <-- test results
    • A.1.0-import.1.png
    • A.1.0-export.bpmn
    • ...

Verified Reference Models

A.1.0

A.2.0

A.2.1

A.3.0

A.4.0

A.4.1

B.1.0

B.2.0

C.1.0

C.1.1

C.2.0

C.3.0

Creative Commons Licence
This work is licensed under a Creative Commons Attribution 3.0 Unported License.

You can’t perform that action at this time.