New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Socket test plan #7803

Merged
merged 2 commits into from Sep 10, 2018

Conversation

Projects
None yet
7 participants
@SeppoTakalo
Contributor

SeppoTakalo commented Aug 16, 2018

Description

I'm submitting a test plan for Mbed OS sockets, so that we have
reference that describes wanted behaviour, required test environment,
and priorities of test cases.

This serves as a both documentation and specification. It needs to live
with source code, as opposed to Handbook, because it will be extended, modified
and fixed for faster cycle than what should be done for the Handbook.

Part of this document (How to run -section) will be submitted to Handbook
with links to this documentation.

Pull request type

[ ] Fix
[ ] Refactor
[ ] Target update
[X] Feature
[ ] Breaking change
@SeppoTakalo

This comment has been minimized.

Contributor

SeppoTakalo commented Aug 16, 2018

@AnotherButler Please review sections from start, to "Running tests".
No reason to review the testcases, it might be a bit painful, and is not meant to be read, only referred as a specification.

@SeppoTakalo

This comment has been minimized.

Contributor

SeppoTakalo commented Aug 16, 2018

@kjbracey-arm please review.

@SeppoTakalo SeppoTakalo force-pushed the SeppoTakalo:socket-test-plan branch from 82fdfe1 to 2f06008 Aug 16, 2018

Add Socket test plan
I'm submitting a test plan for Mbed OS sockets, so that we have
reference that describes wanted behaviour, required test environment,
and priorities of test cases.

This servers as a both documentation and specification. It needs to live
with source code, as opposed to Handbook, because it will be extend, modified
and fixed for faster cycle than what should be done for Handbook.

Part of this document (How to run -section) will be submitted to Handbook
with links to this.

@SeppoTakalo SeppoTakalo force-pushed the SeppoTakalo:socket-test-plan branch from 2f06008 to 0bb791e Aug 16, 2018

@cmonr cmonr added the needs: review label Aug 16, 2018

@cmonr cmonr requested review from AnotherButler and kjbracey-arm Aug 16, 2018

@0xc0170 0xc0170 requested a review from ARMmbed/mbed-os-test Aug 22, 2018

@0xc0170

This comment has been minimized.

Member

0xc0170 commented Aug 22, 2018

Adding @ARMmbed/mbed-os-test (as this is a test plan, I believe our first one here? )

@0xc0170 0xc0170 requested a review from bulislaw Aug 22, 2018

@cmonr cmonr added the risk: G label Aug 23, 2018

@cmonr cmonr requested a review from Aug 25, 2018

@cmonr cmonr removed the risk: G label Aug 25, 2018

Copy edit requested section of README.md
Copy edit for active voice, inclusion of articles and U.S. spelling.
@OPpuolitaival

Looks good

@0xc0170 0xc0170 added needs: CI and removed needs: review labels Aug 30, 2018

@SeppoTakalo

This comment has been minimized.

Contributor

SeppoTakalo commented Aug 31, 2018

@0xc0170 Why does this need CI?
It is just a .md file.

@0xc0170

This comment has been minimized.

Member

0xc0170 commented Aug 31, 2018

Our workflow states PR needs to be green (CI status here as "Required"). We do not currently have subset of tests or what shall be run based on the changes in the PR. We shall discuss this how we can improve this (now that more docs are coming to the repository - test plans, design documents, etc) for 5.11

@cmonr

This comment has been minimized.

Contributor

cmonr commented Sep 7, 2018

Marking for rc2 for now to make sure we don't lose track of it.

@cmonr

This comment has been minimized.

Contributor

cmonr commented Sep 8, 2018

/morph build

@mbed-ci

This comment has been minimized.

mbed-ci commented Sep 8, 2018

Build : SUCCESS

Build number : 3036
Build artifacts/logs : http://mbed-os.s3-website-eu-west-1.amazonaws.com/?prefix=builds/7803/

Triggering tests

/morph test
/morph export-build
/morph mbed2-build

@mbed-ci

This comment has been minimized.

@mbed-ci

This comment has been minimized.

@cmonr cmonr merged commit 920db63 into ARMmbed:master Sep 10, 2018

14 checks passed

ci-morph-build build completed
Details
ci-morph-exporter build completed
Details
ci-morph-mbed2-build build completed
Details
ci-morph-test test completed , RTOS ROM(+0.0%) RAM(+0.0%)
Details
continuous-integration/jenkins/pr-head This commit looks good
Details
continuous-integration/travis-ci/pr The Travis CI build passed
Details
jenkins-ci/cloud_client_smoke_test Test job was successful
Details
travis-ci/astyle Passed, 553 files
Details
travis-ci/docs Local docs testing has passed
Details
travis-ci/events Passed, runtime is 9317 cycles (+167 cycles)
Details
travis-ci/gitattributestest Local gitattributestest testing has passed
Details
travis-ci/licence_check Local licence_check testing has passed
Details
travis-ci/littlefs Passed, code size is 8372B
Details
travis-ci/tools-py2.7 Local tools-py2.7 testing has passed
Details

@0xc0170 0xc0170 removed the needs: CI label Sep 10, 2018

@SeppoTakalo SeppoTakalo deleted the SeppoTakalo:socket-test-plan branch Sep 12, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment