Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

10.0.8RC1 - FINAL smoke test results #31096

Closed
patrickjahns opened this issue Apr 12, 2018 · 10 comments
Closed

10.0.8RC1 - FINAL smoke test results #31096

patrickjahns opened this issue Apr 12, 2018 · 10 comments
Assignees
Milestone

Comments

@patrickjahns
Copy link
Contributor

patrickjahns commented Apr 12, 2018

Smoke test

Previous requirements

Prepare two servers with ssl activated and trusted certificates.

Enable LDAP and external storage apps.

Have a LDAP server ready to be used with owncloud.

Have ready two external storages of your choice SMB, SFTP, Dropbox, Google Drive, FTP, S3, ownCloud, local.

Testing setup

TestID Test Case Expected Result Result Related Comment
1 Enable encryption app and encryption default module Encryption is enabled correctly
2 Populate owncloud server with users and groups Users and groups are correctly created
3 Share a folder remotely using federated sharing with admin user of the other server. folder can be opened in recipient server without problems
4 Set up LDAP, as admin check users. log in with a LDAP user, if possible one with an avatar. Users are loaded. LDAP user logs in without problems. Avatar is shown if it exists.
5 Set up two external storages different, disable encryption in one of them. No errors in this process

Testing functionality

TestID Test Case Expected Result Result Related Comment
1 Share a file using federated sharing from an external unencrypted external storage in server #1 using a LDAP user to the admin user in server #2. Admin user in server #2 can see the file.
2 Open internet explorer or edge and upload a new avatar for a regular user not LDAP Interface can be used, avatar is uploaded, check that personal page has a scroll bar and scrolls fine.
3 Upload several files and folders inside external storages, open some. No problems uploading, files can be downloaded and opened.
4 Delete files inside both external storages. Recover some after from the trashbin. Files are correctly deleted and restored. 🚧
5 Using webdav upload a 100MiB file. No errors in this process
@patrickjahns
Copy link
Contributor Author

@phil-davis @individual-it
Last nights automated smoke tests had errors: https://travis-ci.org/owncloud/core/builds/365222767?utm_source=email&utm_medium=notification

Please check and comment here if these issues persist - or are "false" positives

@jesmrec
Copy link

jesmrec commented Apr 13, 2018

Smoke test iOS [WIP]

Device & iOS version: iPhone 6SPlus v11

Server version: 10.0.8RC1

OAuth2 version: 0.2.2

Login

Test Case Expected Result Result Related Comment
Login with one account (HTTPS) It is possible to access
Login with one account (HTTP) It is possible to access
Login with one account (SHIB Autoprovisioned user) It is possible to access
Login with one account (SHIB SSO user ) It is posible to access

Folder

TestID Test Case Steps Expected Result Result Related Comment
1 Create a new folder 1. Tap on create a new folder The folder is created ✅ OAuth
✅ basic
2 Create a folder with special character 1. Tap on create a new folder
2. Use a name with special characters (e.g $%&¨)
The folder is created with special character ✅ OAuth
✅ basic
3 Rename a folder 1. Create a new folder
2. Rename the folder
Folder is renamed ✅ OAuth
✅ basic
4 Move a folder 1. Create a new folder
2. Move the folder
Folder is moved to the specifield location ✅ OAuth
✅ basic
5 Upload a file into a folder 1. Create a new folder
2. Upload a file
File is uploaded into the folder ✅ OAuth
✅ basic
6 Delete a folder 1. Access to a folder, the folder has deep structure inside
2. Download some files
3. Select delete that folder
2. The files are downloaded
3. The folder is removed
✅ OAuth
✅ basic
7 Copy Folder 1. Long press to copy a folder
2. Select a location to paste
The folder and all its content is copied in the location, and remains too in the original NA
8 Share the folder by link 1. Create a new folder
2. Long press to share the folder by link
The link is generated and works ✅ OAuth
✅ basic
9 Share the folder by link with pass 1. Create a new folder
2. Long press to share the folder by link
3. Enable the password protection and set a password
The link is generated and only works if the correct password is typed ✅ OAuth
✅ basic
10 Unshare the folder by link 1. Unshare the folder of previous test cases The link is no more available ✅ OAuth
✅ basic
11 Share the folder with users or groups 1. Create a new folder
2. Long press to share with users/groups
3. Type one user/group to share with
The user/group can access to the folder ✅ OAuth
✅ basic
12 Unshare the folder with users or groups 1. Unshare the folder in the previous test case The folder is not more available for the sharees ✅ OAuth
✅ basic

File

TestID Test Case Steps Expected Result Result Related Comment
1 Upload a new file 1. Upload a new file The file is uploaded ✅ OAuth
✅ basic
2 Upload a file with special character 1. Upload a new file (e.g f%&¨) The file is uploaded ✅ OAuth
✅ basic
3 Rename a file 1. Create a new file
2. Rename the file
The file is renamed ✅ OAuth
✅ basic
4 Move a file 1. Create a new file
2. Move the file
The file is renamed ✅ OAuth
✅ basic
5 Copy a file 1. Create a new file
2. Copy the file
The file is copied to the selected location NA
6 Delete a file 1. Create a new file
2. Delete the file
The file is deleted ✅ OAuth
✅ basic
7 Share the file by link 1. Create a file
2. Long press to share the file by link
The link is generated and works ✅ OAuth
✅ basic
8 Share the file by link with pass 1. Create a file
2. Long press to share the file by link
3. Set a password
The link is generated and works when the correct pass is typed ✅ OAuth
✅ basic
9 Unshare the file by link 1. Unshare the file of previous test cases The link is no more available ✅ OAuth
✅ basic
10 Share the file with users or groups 1. Create a new file
2. Long press to share with users/groups
3. Type one user/group to share with
The user/group can access to the file ✅ OAuth
✅ OAuth
✅ basic
11 Unshare the file with users or groups 1. Unshare the file in the previous test case The file is not more available for the sharees ✅ OAuth
✅ basic
12 Download a file 1. Tap to download a file The file is downloaded and marked with green tick ✅ OAuth
✅ basic
13 Av Offline file 1. Long press to set as av offline a file The file is downloaded and set as av off with the yellow arrow ✅ OAuth
✅ basic
14 Av Offline file 1. Long press to set as no av offline a file The file has no more the yellow arrow ✅ OAuth
✅ basic

@jesmrec
Copy link

jesmrec commented Apr 13, 2018

Smoke test Android [WIP]

Device & Android version: Nexus 6 V6

Server version: 10.0.8RC1
OAuth2 version: 0.2.2

Login

Test Case Expected Result Result Related Comment
Login with one account (HTTPS) It is possible to access
Login with one account (HTTP) It is possible to access
Login with one account (SHIB Autoprovisioned user) It is possible to access
Login with one account OAuth2 It is possible to access

Folder

TestID Test Case Steps Expected Result Result Related Comment
1 Create a new folder 1. Tap on create a new folder The folder is created ✅ basic
✅ OAuth2
2 Create a folder with special character 1. Tap on create a new folder
2. Use a name with special characters (e.g $%&¨)
The folder is created with special character ✅ basic
✅ OAuth2
3 Rename a folder 1. Create a new folder
2. Rename the folder
Folder is renamed ✅ basic
✅ OAuth2
4 Move a folder 1. Create a new folder
2. Move the folder
Folder is moved to the specifield location ✅ basic
✅ OAuth2
5 Upload a file into a folder 1. Create a new folder
2. Upload a file
File is uploaded into the folder ✅ basic
✅ OAuth2
6 Delete a folder 1. Access to a folder, the folder has deep structure inside
2. Download some files
3. Select delete that folder
2. The files are downloaded
3. The folder is removed
✅ basic
✅ OAuth2
7 Copy Folder 1. Long press to copy a folder
2. Select a location to paste
The folder and all its content is copied in the location, and remains too in the original ✅ basic
✅ OAuth2
8 Share the folder by link 1. Create a new folder
2. Long press to share the folder by link
The link is generated and works ✅ basic
✅ OAuth2
9 Share the folder by link with pass 1. Create a new folder
2. Long press to share the folder by link
3. Enable the password protection and set a password
The link is generated and only works if the correct password is typed ✅ basic
✅ OAuth2
10 Unshare the folder by link 1. Unshare the folder of previous test cases The link is no more available ✅ basic
✅ OAuth2
11 Share the folder with users or groups 1. Create a new folder
2. Long press to share with users/groups
3. Type one user/group to share with
The user/group can access to the folder ✅ basic
✅ OAuth2
12 Unshare the folder with users or groups 1. Unshare the folder in the previous test case The folder is not more available for the sharees ✅ basic
✅ OAuth2
13 Sync a folder 1. Create a folder
2. In web app, upload some files in the folder
3. Long press to sync the folder
The folder is sync with the content on server ✅ basic
✅ OAuth2

File

TestID Test Case Steps Expected Result Result Related Comment
1 Upload a new file 1. Upload a new file The file is uploaded ✅ basic
✅ OAuth2
2 Upload a file with special character 1. Upload a new file (e.g f%&¨) The file is uploaded ✅ basic
✅ basic
✅ OAuth2
3 Rename a file 1. Create a new file
2. Rename the file
The file is renamed ✅ basic
✅ OAuth2
4 Move a file 1. Create a new file
2. Move the file
The file is renamed ✅ basic
✅ OAuth2
5 Copy a file 1. Create a new file
2. Copy the file
The file is copied to the selected location ✅ basic
✅ OAuth2
6 Delete a file 1. Create a new file
2. Delete the file
The file is deleted ✅ basic
✅ OAuth2
7 Share the file by link 1. Create a file
2. Long press to share the file by link
The link is generated and works ✅ basic
✅ OAuth2
8 Share the file by link with pass 1. Create a file
2. Long press to share the file by link
3. Set a password
The link is generated and works when the correct pass is typed ✅ basic
✅ OAuth2
9 Unshare the file by link 1. Unshare the file of previous test cases The link is no more available ✅ basic
✅ OAuth2
10 Share the file with users or groups 1. Create a new file
2. Long press to share with users/groups
3. Type one user/group to share with
The user/group can access to the file ✅ basic
✅ OAuth2
11 Unshare the file with users or groups 1. Unshare the file in the previous test case The file is not more available for the sharees ✅ basic
✅ OAuth2
12 Download a file 1. Tap to download a file The file is downloaded and marked with green arrow ✅ basic
✅ OAuth2
13 Av Offline file 1. Long press to set as Av Offline a file The file is downloaded and set as Av Offline with the yellow arrow ✅ basic
✅ OAuth2
14 Av Offline file 1. Long press to unset an Av Offline a Av Offline file The file has no more the yellow arrow ✅ basic
✅ OAuth2

@phil-davis
Copy link
Contributor

Last nights automated smoke tests had errors: https://travis-ci.org/owncloud/core/builds/365222767?utm_source=email&utm_medium=notification

All good - they all pass after restarts. "the usual" mix of Travis-SauceLabs intermittent hassles and webdriver timeouts on IE11...

@patrickjahns patrickjahns self-assigned this Apr 14, 2018
@patrickjahns patrickjahns changed the title 10.0.8RC1 smoke test results 10.0.8RC1 - FINAL smoke test results Apr 19, 2018
@patrickjahns
Copy link
Contributor Author

patrickjahns commented Apr 19, 2018

Smoke test - FINAL

Previous requirements

Prepare two servers with ssl activated and trusted certificates.

Enable LDAP and external storage apps.

Have a LDAP server ready to be used with owncloud.

Have ready two external storages of your choice SMB, SFTP, Dropbox, Google Drive, FTP, S3, ownCloud, local.

Testing setup

TestID Test Case Expected Result Result Related Comment
1 Enable encryption app and encryption default module Encryption is enabled correctly
2 Populate owncloud server with users and groups Users and groups are correctly created
3 Share a folder remotely using federated sharing with admin user of the other server. folder can be opened in recipient server without problems
4 Set up LDAP, as admin check users. log in with a LDAP user, if possible one with an avatar. Users are loaded. LDAP user logs in without problems. Avatar is shown if it exists.
5 Set up two external storages different, disable encryption in one of them. No errors in this process

Testing functionality

TestID Test Case Expected Result Result Related Comment
1 Share a file using federated sharing from an external unencrypted external storage in server #1 using a LDAP user to the admin user in server #2. Admin user in server #2 can see the file.
2 Open internet explorer or edge and upload a new avatar for a regular user not LDAP Interface can be used, avatar is uploaded, check that personal page has a scroll bar and scrolls fine.
3 Upload several files and folders inside external storages, open some. No problems uploading, files can be downloaded and opened.
4 Delete files inside both external storages. Recover some after from the trashbin. Files are correctly deleted and restored. 🚧
5 Using webdav upload a 100MiB file. No errors in this process

@PVince81
Copy link
Contributor

@patrickjahns
Copy link
Contributor Author

patrickjahns commented Apr 19, 2018

  • "Using webdav upload a 100MiB file." tested via webui, syncclient and macosxfinder

@individual-it
Copy link
Member

individual-it commented Apr 20, 2018

automated UI tests on 10.0.8 final tarball

  1. install 10.0.8 final
  2. copy testing app from git
  3. enable testing app
  4. from inside a git clone of stable10 branch run tests against 10.0.8 final on chrome (we need the git clone because the tests live there and we don't want to copy them into the tarball installation)

suites:

  • webUIFavorites - 6 scenarios (6 passed)
  • webUIFiles - 21 scenarios (21 passed)
  • webUIManageQuota - 15 scenarios (15 passed)
  • webUIManageUsersGroups - 19 scenarios (19 passed)
  • webUIMoveFilesFolders - 11 scenarios (11 passed)
  • webUIPersonalSettings - 5 scenarios (5 passed)
  • webUIRenameFiles - 18 scenarios (18 passed)
  • webUIRenameFolders - 13 scenarios (13 passed)
  • webUIRestrictSharing - 7 scenarios (7 passed)
  • webUISharingExternal - 15 scenarios (15 passed)
  • webUISharingInternalGroups - 6 scenarios (6 passed)
  • webUISharingInternalUsers - 15 scenarios (15 passed)
  • webUITrashbin - 12 scenarios (12 passed)
  • webUIUpload - 18 scenarios (18 passed)

@patrickjahns
Copy link
Contributor Author

Smoke tests completed for final - 🎉

@lock
Copy link

lock bot commented Jul 30, 2019

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked as resolved and limited conversation to collaborators Jul 30, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants