test(common): Mobile app compatibility tests - Slatejs #7979

MakaraSok · 2023-01-04T09:05:20Z

The basic idea is to load the example page for each Text Editor (in this case, Slatejs), and then test input with latest release version of Keyman apps and a variety of keyboards.

Gather Assets for Testing

Install the following keyboards and have the test page link ready to load on the respective browser.

Keyman app - Latest version (please record the version in the test results)
Khmer Angkor keyboard package
EuroLatin (SIL) keyboard pagekage
Galaxie Hebrew (Positional) keyboard package
IPA (SIL) keyboard package
Slatejs text editor test page: type in the text area to test

We need to test in a variety of Operating Systems and Browsers:

GROUP_IOS_SAFARI: iOS / Safari browser
GROUP_IOS_CHROME: iOS / Chrome browser
GROUP_ANDROID_CHROME: Android / Chrome browser
GROUP_ANDROID_FIREFOX: Android / Firefox

User Testing

Slatejs has an example page: https://www.slatejs.org/examples/richtext. Load it up on the respective OS and browser to test the followings:

TEST_KHMER_ANGKOR: Khmer Angkor
- Ensure longpress on ស and choose ឞ to produce ឞ.
- Type ស ុ ្រ (longpress of រ) ក to produce ស្រុក.
TEST_SIL_EURO_LATIN: SIL Euro Latin
- Longpress on a and choose ǎ to output ǎ
TEST_GALAXIE_HEBREW: Galaxie Hebrew or another good SIL RTL keyboard
- Type b \ = r @ a v ! y t to output בְּרֵאשִׁית. FAILED if the output is different.
TEST_SIL_IPA: sil_ipa
- Ensure the key sequence n > (long press of ] on 123 layer) produces ŋ.

The text was updated successfully, but these errors were encountered:

keymanapp-test-bot · 2023-01-04T09:05:34Z

User Test Results

Test specification and instructions

🟥 GROUP_IOS_SAFARI: iOS / Safari browser
- 🟥 TEST_KHMER_ANGKOR (FAILED): Tested with Keyman 17.0.23-alpha build in iOS 15.0 / iPhone 12 Pro Max Simulator and it is showing wrong output. (notes)
- ✅ TEST_SIL_EURO_LATIN (PASSED): It is showing the correct output. (notes)
- ✅ TEST_GALAXIE_HEBREW (PASSED): Tested with the latest Keyman 17.0.78-alpha build in iOS 16.2 / iPhone 14 Pro Max Simulator and here is my observation: 1. Able to install Galaxie Hebrew (Positional) Keyboard without having any problem in the Keyman app. 2. Opened the test page in Safari browser and I was able to type in the Galaxie Hebrew (Positional) keyboard. It is showing the expected output. Seems to be working fine. (notes)
- ✅ TEST_SIL_IPA (PASSED): It is showing the expected output. (notes)
🟥 GROUP_IOS_CHROME: iOS / Chrome browser
- 🟥 TEST_KHMER_ANGKOR (FAILED): The output is different from what's expected.
- ✅ TEST_SIL_EURO_LATIN (PASSED): The output does match what's expected.
- ✅ TEST_GALAXIE_HEBREW (PASSED): The output does match what's expected.
- ✅ TEST_SIL_IPA (PASSED): The output does match what's expected.
✅ GROUP_ANDROID_CHROME: Android / Chrome browser
4 tests PASSED
- ✅ TEST_KHMER_ANGKOR (PASSED): Tested with the latest Keyman 17.0.23-alpha build in API30 / Android 11 emulator and it showing the expected output. (notes)
- ✅ TEST_SIL_EURO_LATIN (PASSED): It is showing the correct output. (notes)
- ✅ TEST_GALAXIE_HEBREW (PASSED): It is showing the expected output. (notes)
- ✅ TEST_SIL_IPA (PASSED): It is showing the correct output. (notes)
✅ GROUP_ANDROID_FIREFOX: Android / Firefox
4 tests PASSED
- ✅ TEST_KHMER_ANGKOR (PASSED): Tested with Keyman 17.0.23-alpha build and it showing the correct output. (notes)
- ✅ TEST_SIL_EURO_LATIN (PASSED): It is showing the correct output. (notes)
- ✅ TEST_GALAXIE_HEBREW (PASSED): It is showing the expected output. (notes)
- ✅ TEST_SIL_IPA (PASSED): It is showing the correct output. (notes)

Retesting Template

@keymanapp-test-bot retest GROUP_IOS_SAFARI TEST_KHMER_ANGKOR GROUP_IOS_CHROME TEST_KHMER_ANGKOR

bharanidharanj · 2023-01-04T11:44:45Z

Test Results

GROUP_IOS_SAFARI: iOS / Safari browser

TEST_KHMER_ANGKOR (FAILED): Tested with Keyman 17.0.23-alpha build in iOS 15.0 / iPhone 12 Pro Max Simulator and it is showing wrong output.
TEST_SIL_EURO_LATIN (PASSED): It is showing the correct output.
TEST_GALAXIE_HEBREW (FAILED): It is showing the wrong output. (If I type the letter 'b' it is showing the exact letter 'b' on the screen. It would be better to see right steps to produce the right output)
TEST_SIL_IPA (PASSED): It is showing the expected output.

bharanidharanj · 2023-01-04T14:21:33Z

GROUP_ANDROID_CHROME: Android / Chrome browser

TEST_KHMER_ANGKOR (PASSED): Tested with the latest Keyman 17.0.23-alpha build in API30 / Android 11 emulator and it showing the expected output.
TEST_SIL_EURO_LATIN (PASSED): It is showing the correct output.
TEST_GALAXIE_HEBREW (PASSED): It is showing the expected output.
TEST_SIL_IPA (PASSED): It is showing the correct output.

bharanidharanj · 2023-01-05T06:45:32Z

GROUP_ANDROID_FIREFOX: Android / Firefox

TEST_KHMER_ANGKOR (PASSED): Tested with Keyman 17.0.23-alpha build and it showing the correct output.
TEST_SIL_EURO_LATIN (PASSED): It is showing the correct output.
TEST_GALAXIE_HEBREW (PASSED): It is showing the expected output.
TEST_SIL_IPA (PASSED): It is showing the correct output.

bharanidharanj · 2023-01-06T13:25:58Z

Test Results

GROUP_IOS_CHROME: iOS / Chrome browser

TEST_KHMER_ANGKOR (BLOCKED): iOS Simulator does not support Chrome browser. Hence, not able to test it in the Simulator.
TEST_SIL_EURO_LATIN (BLOCKED): iOS Simulator does not support Chrome browser. Hence, not able to test it in the Simulator.
TEST_GALAXIE_HEBREW (BLOCKED): iOS Simulator does not support Chrome browser. Hence, not able to test it in the Simulator.
TEST_SIL_IPA (BLOCKED): iOS Simulator does not support Chrome browser. Hence, not able to test it in the Simulator.

MakaraSok · 2023-03-10T08:49:48Z

Verification Tests:
Keyman for iOS version 16.0.137/8.

GROUP_IOS_SAFARI: iOS / Safari browser - version 15.7.3
- All test cases, but one doesn't give the same result as reported above. TEST_GALAXIE_HEBREW does NOT FAILED on me. Let's retest TEST_GALAXIE_HEBREW.

MakaraSok · 2023-03-10T08:57:07Z

Test Results

GROUP_IOS_CHROME: iOS / Chrome browser version `110.0.5481.114`

TEST_KHMER_ANGKOR (FAILED): The output is different from what's expected.
TEST_SIL_EURO_LATIN (PASSED): The output does match what's expected.
TEST_GALAXIE_HEBREW (PASSED): The output does match what's expected.
TEST_SIL_IPA (PASSED): The output does match what's expected.

MakaraSok · 2023-03-10T08:59:52Z

@keymanapp-test-bot retest GROUP_IOS_SAFARI TEST_GALAXIE_HEBREW

bharanidharanj · 2023-03-13T10:21:14Z

Test Results

GROUP_IOS_SAFARI: iOS / Safari browser

TEST_GALAXIE_HEBREW (BLOCKED): Got an error message while trying to install the attached Galaxie Hebrew (Positional) .kmp file in the simulator. It's blocked to do further testing in Safari browser.

..iOS 16.0 / iPhone 13 Pro Max Simulator

MakaraSok · 2023-03-17T09:08:09Z

@keymanapp-test-bot retest GROUP_IOS_SAFARI TEST_GALAXIE_HEBREW

With the new instructions to test the Hebrew keyboard we've talked about earlier, could you try and retest this.

For your conveniences, here is a direct quote of it:

TEST_GALAXIE_HEBREW: Galaxie Hebrew mentioned above and here is how to type each key.

Type b \ = r @ a v ! y t to output בְּרֵאשִׁית. FAILED if the output is different.

bharanidharanj · 2023-03-28T07:50:08Z

Test Results

GROUP_IOS_SAFARI: iOS / Safari browser

TEST_GALAXIE_HEBREW (PASSED): Tested with the latest Keyman 17.0.78-alpha build in iOS 16.2 / iPhone 14 Pro Max Simulator and here is my observation: 1. Able to install Galaxie Hebrew (Positional) Keyboard without having any problem in the Keyman app. 2. Opened the test page in Safari browser and I was able to type in the Galaxie Hebrew (Positional) keyboard. It is showing the expected output. Seems to be working fine.

MakaraSok · 2023-04-12T09:24:19Z

Verification test
Retest

MakaraSok added common/ test-compatibility labels Jan 4, 2023

keymanapp-test-bot bot added has-user-test user-test-required User tests have not been completed labels Jan 4, 2023

keymanapp-test-bot bot added the user-test-failed label Jan 4, 2023

keymanapp-test-bot bot removed the user-test-required User tests have not been completed label Jan 6, 2023

mcdurdin added this to the A17S5 milestone Jan 24, 2023

mcdurdin modified the milestones: A17S5, A17S6 Feb 4, 2023

bharanidharanj mentioned this issue Feb 17, 2023

bug(iOS): Galaxie Hebrew keyboard is not working in Safari browser #8248

Closed

8 tasks

mcdurdin modified the milestones: A17S6, A17S7 Feb 18, 2023

mcdurdin closed this as completed Feb 20, 2023

tjcouch-sil mentioned this issue Mar 7, 2023

Integrate resource viewer code paranext/paranext-core#60

Closed

MakaraSok reopened this Mar 10, 2023

keymanapp-test-bot bot added the user-test-required User tests have not been completed label Mar 10, 2023

keymanapp-test-bot bot removed the user-test-required User tests have not been completed label Mar 13, 2023

mcdurdin modified the milestones: A17S7, A17S9 Mar 18, 2023

mcdurdin added the test Any acceptance test issue label Mar 21, 2023

mcdurdin modified the milestones: A17S9, Tests Mar 21, 2023

keymanapp-test-bot bot added the user-test-required User tests have not been completed label Mar 28, 2023

keymanapp-test-bot bot removed the user-test-required User tests have not been completed label Mar 28, 2023

MakaraSok closed this as completed Apr 12, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

test(common): Mobile app compatibility tests - Slatejs #7979

test(common): Mobile app compatibility tests - Slatejs #7979

MakaraSok commented Jan 4, 2023

keymanapp-test-bot bot commented Jan 4, 2023 •

edited

bharanidharanj commented Jan 4, 2023

bharanidharanj commented Jan 4, 2023

bharanidharanj commented Jan 5, 2023 •

edited

bharanidharanj commented Jan 6, 2023

MakaraSok commented Mar 10, 2023 •

edited

MakaraSok commented Mar 10, 2023

MakaraSok commented Mar 10, 2023

bharanidharanj commented Mar 13, 2023

MakaraSok commented Mar 17, 2023 •

edited

bharanidharanj commented Mar 28, 2023

MakaraSok commented Apr 12, 2023

test(common): Mobile app compatibility tests - Slatejs #7979

test(common): Mobile app compatibility tests - Slatejs #7979

Comments

MakaraSok commented Jan 4, 2023

Gather Assets for Testing

User Testing

keymanapp-test-bot bot commented Jan 4, 2023 • edited

User Test Results

bharanidharanj commented Jan 4, 2023

Test Results

GROUP_IOS_SAFARI: iOS / Safari browser

bharanidharanj commented Jan 4, 2023

GROUP_ANDROID_CHROME: Android / Chrome browser

bharanidharanj commented Jan 5, 2023 • edited

GROUP_ANDROID_FIREFOX: Android / Firefox

bharanidharanj commented Jan 6, 2023

Test Results

GROUP_IOS_CHROME: iOS / Chrome browser

MakaraSok commented Mar 10, 2023 • edited

MakaraSok commented Mar 10, 2023

Test Results

GROUP_IOS_CHROME: iOS / Chrome browser version 110.0.5481.114

MakaraSok commented Mar 10, 2023

bharanidharanj commented Mar 13, 2023

Test Results

GROUP_IOS_SAFARI: iOS / Safari browser

MakaraSok commented Mar 17, 2023 • edited

bharanidharanj commented Mar 28, 2023

Test Results

GROUP_IOS_SAFARI: iOS / Safari browser

MakaraSok commented Apr 12, 2023

keymanapp-test-bot bot commented Jan 4, 2023 •

edited

bharanidharanj commented Jan 5, 2023 •

edited

MakaraSok commented Mar 10, 2023 •

edited

GROUP_IOS_CHROME: iOS / Chrome browser version `110.0.5481.114`

MakaraSok commented Mar 17, 2023 •

edited