TESTS: update examples.json to enable testing

[jamesbeyond]

Description

Update examples.json with log compare option to enable example tests.
The built test_spce.json should be upload to S3.

This is targeted at mbed 5.13

Pull request type

[ ] Fix
[ ] Refactor
[ ] Target update
[ ] Functionality change
[ ] Docs update
[x] Test update
[ ] Breaking change

Reviewers

@OPpuolitaival

[ciarmcom]

@jamesbeyond, thank you for your changes.
@OPpuolitaival @ARMmbed/mbed-os-tools @ARMmbed/mbed-os-maintainers please review.

[0Grit]

Any more insight into how this might be used with custom targets?
Usecases etc.

[mark-edgeworth]

Looks ok to me from a tools PoV.

[0xc0170]

Any more insight into how this might be used with custom targets?
Usecases etc.

@jamesbeyond Can you also add description to docs (we have there CI page) - what we are testing in the examples. This should cover how this is used. We have already something when tools were updated to include this (htrun/greentea or similar) ?

@loverdeg-ep What are you after exactly - what we should not miss documenting? This is considered being used in internal CI setup, I would like to understand the use cases you are thinking about.

[40Grit]

@0xc0170

We have our own internal CI/test setup based on gitlab and gitlab runners.

We like to keep tabs on what the team is doing internally so we can come up beside you.

I'm wondering what specifically this enables.

[jamesbeyond]

Any more insight into how this might be used with custom targets?
Usecases etc.

This is mean for testing mbed-os-examples, and will be required to use with https://github.com/ARMmbed/mbed-os-example-blinky/tree/master/tests
This is not tie to any type of target

[jamesbeyond]

Sure, @0xc0170 I am adding docs to the CI page and adding them together to the CI tasks

[0xc0170]

Sure, @0xc0170 I am adding docs to the CI page and adding them together to the CI tasks

Please have docs ready this week at least as PR to reference here.

I started CI job

[0xc0170]

Waiting for documentation reference

[0xc0170]

Note, 2 days to get in to 5.13

[40Grit]

@0xc0170 Please don't hold this up over documentation.

Creating an issue to capture that this will need documentation is fine with me.

[mbed-ci]

Test run: SUCCESS

Summary: 11 of 11 test jobs passed
Build number : 1
Build artifacts

[0xc0170]

Talking offline to address documentation update