4.5 Release checklist

[compulim]

1. Wait until Bot Framework SDK release 4.5 RC
2. Bump Bot Framework SDK in MockBot
3. Build Web Chat from master locally
4. Automated testing
   1. Run npm test (with Docker) to test Web Chat
5. Manual testing
   1. All MockBot commands
      1. Type help to MockBot, it will list out all commands
      2. Try out each of the command, list out all failed below, if any
      3. Test all of these commands on Internet Explorer 11, as well
   2. Speech scenarios
      1. Happy path
         1. Click microphone button and say something
         2. Expect: bot to speak
         3. Expect: microphone to turn on automatically after bot message is spoken
      2. Turning off microphone
         1. Click microphone button and say something
         2. Expect: while your speech is getting recognized, the microphone button should turn red
         3. Expect: while the microphone button is red, you can click to stop it
         4. Expect: your speech interims should not be sent
      3. Keyboard interrupted speech synthesis and recognition
         1. Click microphone button and say something
         2. While the bot is speaking, type something on the keyboard
         3. Expect: bot stop speaking immediately and microphone will not turn on by itself
      4. Unrecognizable sound (or muted microphone)
         1. Click microphone button and do not say anything
         2. Expect: after a few seconds, the microphone button should be switched off by itself
      5. Test on iOS devices
   3. Connectivity scenarios
      1. Airplane mode
      2. Bad secret or token
   4. PRs that need to be manually tested because lack of automated tests
      1. Should not stop after first spoken text #2016
      2. Fix 1876 a11y #2018
      3. Fix mobile focus UX #2087
      4. Fix timestamp randomly stopped from updating #2090
      5. Remove markdown from spoken text for screen reader #2096
      6. Fix Speech speaking the title, subtitle, and text of cards #2118
6. Test the following with Edge and Narrator:
   1. Adaptive Card
   2. Download attachment
   3. Audio attachment
   4. Video attachment
   5. Image attachment
   6. Typing indicator (via removeIncomingTypingAfterIntervalSaga.js
   7. Text content
      [edit by corinagum]: We also need to check all bot commands on IE before release.

[corinagum]

Updated with PRs needing manual testing

[sgellock]

assigned this to an engineer so it's not floated unassigned. revector to chris or whomever if it's not you William.

[corinagum]

Testing on old SDK bits per compulim's request:

1. [ ] Wait until Bot Framework SDK release 4.5 RC
1. [ ] Bump Bot Framework SDK in MockBot

1. Build Web Chat from master locally
2. Automated testing
   1. Run npm test (with Docker) to test Web Chat
3. Manual testing
   1. All MockBot commands
      1. Type help to MockBot, it will list out all commands
      2. Try out each of the command, list out all failed below, if any
   2. Speech scenarios
      1. Happy path
         1. Click microphone button and say something
         2. Expect: bot to speak
         3. Expect: microphone to turn on automatically after bot message is spoken
      2. Turning off microphone
         1. Click microphone button and say something
         2. Expect: while your speech is getting recognized, the microphone button should turn red
         3. Expect: while the microphone button is red, you can click to stop it
         4. Expect: your speech interims should not be sent
      3. Keyboard interrupted speech synthesis and recognition
         1. Click microphone button and say something
         2. While the bot is speaking, type something on the keyboard
         3. Expect: bot stop speaking immediately and microphone will not turn on by itself
      4. Unrecognizable sound
         1. Click microphone button and do not say anything
         2. Expect: after a few seconds, the microphone button should be switched off by itself
   3. Connectivity scenarios
      1. Airplane mode
      2. Bad secret or token
   4. PRs that need to be manually tested because lack of automated tests
      1. Should not stop after first spoken text #2016
      2. Fix 1876 a11y #2018
      3. Fix mobile focus UX #2087
      4. Fix timestamp randomly stopped from updating #2090
      5. Remove markdown from spoken text for screen reader #2096
      6. Fix Speech speaking the title, subtitle, and text of cards #2118

[compulim]

This is done. 😉