Testing experience from oneM2M - Issue 517 from w3c/wot

[egekorkan]

Coming from w3c/wot#517 on Jul 2, 2018

Tests

• Interoperability testing
• Conformance testing
• Field testing

Test structure

Configuration --> Scenario --> Test Case

Configurations

• Device to device
• Device to cloud
• Device via Gateway to cloud
• ...

Scenarios

• Discovery
• ~Pairing
• ...

Test Cases

One per primitive within scenario

Coverage

Specification might be to heavy to generate full coverage with test cases

Look at real products and sort them into "profiles"

Define test cases within profiles

Notes

• Tests can help developers before starting their own implementations
• Split specification into "features" from an architectural view to help structuring testing
• TTCN-3 helps
• Test cases also validate standard specification itself