Testplan server 10.12.1

[jnweiger]

Test plan Simplified smoke test

• Template: https://github.com/owncloud/QA/blob/master/Server/Test_Plan_Simplified_Smoke_Test.md

Test Case	Expected Result	Result	Related Comment
Automated Checks
Nightly CI job with UI tests on chrome, firefox, Edge, IE11	All tests pass on the release branch	✔️ :	Note: IE11 tests have intermittent issues with IE webdriver, it is acceptable to restart failed test suites to see that they will pass
Web UI
Login with admin user.	Admin logs in.	✔️ :
Create a text file.	Text editor can open, file is saved.	✔️ :
Modify a text file.	File can be modified, no problems found.	✔️
Rename a file.	File is renamed.	✔️
Upload a file.	File is uploaded, no problems found.	✔️
Overwrite a file by uploading a new version.	File is uploaded and overwritten, no problems found.	✔️
Remove a file.	File is removed correctly, it appears in the trashbin.	✔️
Move a file inside a folder.	There are not problems on the process.	✔️
Create a folder.	Folder is created, no MKCOL problems appear.	✔️
Delete a folder.	Folder is removed.	✔️
Move a folder inside another.	No problems while moving the folder.	✔️
Share a file by private link.	Link is created and can be accessed.	✔️
Share a file by public link.	Link is created and can be accessed.	✔️
Share a file with another user.	It is shared correctly.	✔️
Share a file with a group.	It is shared correctly.	✔️
Share a file with another user in another server.	Federated sharing happens correctly.	✔️
Share a folder with userB giving edit permissions. As userB open the received folder, download files inside, open them. Upload new files. Modify files and delete them.	userB doesn't find any problem while interacting with files.	✔️
Federate share a folder giving edit permissions with userB in serverB, As userB open the received folder, download files inside, open them. Upload new files. Modify files and delete them.	userB doesn't find any problem while interacting with files.	✔️
Mobile view test with galaxy s9 as "Smallest device"	All elements reachable	✔️
Desktop Client
Set up two clients with the same user. Change files, add some, delete some, move some, create folders.	Changes sync properly in both clients without errors.	✔️
Share a file using contextual menu with userB.	Option to share appears in the contextual menu and file is correctly shared.	✔️
Mobile Clients (iOS || Android)
Connect to server, see files, download one.	No problems while downloading.	✔️	Tested with android client on a Moto G9
Upload a file using mobile client.	No problems while uploading.	✔️
Share a file with userB using mobile client.	File is correctly shared.	✔️

[jnweiger]

Changlog testing

• [QA] hardened .htaccess breaks index.php-less setup when ownCloud URL has a subfolder #40696
  • 40686 40697
• Use getHome in ChunkLocationProvider.php #40693
• 507 Insufficient Storage when adding a file or syncing #40695
  • 40709 (enterprse#5654)
• fix permission bits when enforcing rw links #40701
  • 40699
• package vendor/firebase/php-jwt files_texteditor#389
• fix: in case root on CacheJail is an empty string we should not prefi… #40677
• [full-ci] Revert loader logic in ChunkLocationProvider.php #40700
  • run firewall app CI against 10.12.1 RC3
  • run firewall app CI against 10.12.0 (for comparison. We don't expect 100% success anyway...)
• Fix 32bits quota release #40729
  Test several 2GB limits due to the 507 patch: free disk space, total disk space, quota, above and below 2GB
  as per Fix quota for 32 bits. Some vars could be float instead of integer #40727 (comment)
  • WebUI: Create a user with 0B quota; The user can't create a folder.; The user can't upload files.
  • WebUI: Create a user with 1.5GB quota; Upload a 1GB file. The upload works; Upload another 1GB file. Error shows not enough free space.
  • WebUI: Create a user with 2.5GB quota; Upload a 1GB file. The upload works; Upload another 1GB file. The upload works.
    • Upload third 1GB file. Error shows not enough free space.
    • Use files_clipboard to copy the second 1 GB file over the first. the copy takes a while, then the file is fresh, with a new timestamp (clipboard does not do versioning)
    • Use files_clipboard to copy the second 1 GB file into a new folder. -> "An error occurred during the copy."
    • ⛔ Try re-upload the second file with the browser. choose overwrite. The upload succeeds. -> [QA] when re-uploading the same file, the quota limit should not apply #40737
  • Desktop Client: Create a user with 0B quota; The user can't create a folder.; The user can't upload files.
  • Desktop Client: Create a user with 1.5GB quota; Upload a 1GB file. The upload works; Upload another 1GB file. Error shows not enough free space.
  • Desktop Client: Create a user with 2.5GB quota; Upload a 1GB file. The upload works; Upload another 1GB file. The upload works; Upload third 1GB file. Error shows not enough free space.

[jnweiger]

Results of firewall app ci

• make test-php-unit -> OK

• make test-acceptance-core-cli
  TEST_SERVER_FED_URL=https://oc10121rc2-20230405.jw-qa.owncloud.works
  350 scenarios (252 passed, 98 failed)
  2799 steps (2129 passed, 98 failed, 572 skipped)
  114m15.20s (25.62Mb)

• make test-acceptance-core-api
  4672 scenarios (4619 passed, 52 failed, 1 skipped)
  55735 steps (55447 passed, 52 failed, 236 skipped)
  2804m44.06s (26.55Mb)

• make test-acceptance-webui
  runsh: Total 0 scenarios (0 passed, 0 failed)
  runsh: Exit code of main run: 1
  runsh: There were no unexpected failures.
  runsh: There were no unexpected success.
  runsh: The following Behat test runs exited with non-zero status:
  all webUI had behat exit status 1
  make: *** [Makefile:165: test-acceptance-webui] Error 1
  grep SCENARIO.RESULT: screenlog.1.test-acceptance-webgui | sort | uniq -c
  5 SCENARIO RESULT: (fail)
  105 SCENARIO RESULT: (pass)

• make test-acceptance-core-webui
  977 scenarios (789 passed, 188 failed)
  10785 steps (9854 passed, 188 failed, 743 skipped)
  678m38.97s (40.39Mb)

Comparison with 10.12.0

• make test-php-unit -> OK

• make test-acceptance-core-cli
  env HCLOUD_MACHINE_TYPE=cx41 OC10_DNSNAME=oc1012-firewall-acceptance-DATE OC10_VERSION=10.12 OC10_TAR_URL=https://download.owncloud.com/server/testing/owncloud-complete-20230313-qa.tar.bz2 oc10.sh --
  350 scenarios (251 passed, 99 failed)
  2799 steps (2138 passed, 99 failed, 562 skipped)
  125m34.38s (26.00Mb)

• make test-acceptance-core-api
  4672 scenarios (4495 passed, 176 failed, 1 skipped)
  55735 steps (54441 passed, 176 failed, 1118 skipped)
  1662m26.14s (35.36Mb)

• make test-acceptance-webui
  grep SCENARIO.RESULT: screenlog.1.test-acceptance-webgui | sort | uniq -c
  86 SCENARIO RESULT: (fail)
  24 SCENARIO RESULT: (pass)

• make test-acceptance-core-webui
  977 scenarios (929 passed, 48 failed)
  10785 steps (10461 passed, 48 failed, 276 skipped)
  642m11.26s (40.89Mb)
  webUI test rerun failed with exit status: 1
  runsh: Total 977 scenarios (929 passed, 48 failed)

[jnweiger]

QA succeeded with minor defects. See https://github.com/owncloud/enterprise/issues/5712