Cloud Based WW Verification

[leino11121]

Dear Alexa Team,

Briefly summarize your issue:

In AVS_functional_self-test_checklist_v1_8, cloud based WW Verification, according to what we know, command" wait, Alexa, what time is it?" Device can be waked up locally, but should not respond as the cloud based WW Verification recognized this is an invalid command. So it is cloud part to notice this is an invalid one.
I have read the issue #615 #471. But it doesn't help to resolve the issue.

This is my test sequence:

1. put the ECHO and my device together
2. say: "wait, Alexa, what time is it?"
3. both devices is wakeuped, and then ECHO has no response, but my device begins to speak.
4. Check the voice in website: "https://alexa.amazon.com/spa/index.html#settings/dialogs"
   • ECHO: Text not available. Click to play recording
   • my device: Alexa, what time is it.
5. This is the Recognize event :

{
  "context": [
    {
      "header": {
        "namespace": "Alexa.PlaybackStateReporter",
        "name": "playbackState"
      },
      "payload": {
        "state": "IDLE",
        "supportedOperations": [],
        "shuffle": "NOT_SHUFFLED",
        "repeat": "NOT_REPEATED",
        "favorite": "NOT_RATED",
        "positionMilliseconds": 0,
        "uncertaintyInMilliseconds": 0,
        "players": []
      }
    },
    {
      "header": {
        "namespace": "ExternalMediaPlayer",
        "name": "ExternalMediaPlayerState"
      },
      "payload": {
        "playerInFocus": "",
        "players": []
      }
    },
    {
      "header": {
        "namespace": "Speaker",
        "name": "VolumeState"
      },
      "payload": {
        "volume": 21,
        "muted": false
      }
    },
    {
      "header": {
        "namespace": "Alerts",
        "name": "AlertsState"
      },
      "payload": {
        "allAlerts": [
          {
            "token": "amzn1.as-ct.v1.Domain:Application:NotificationsV4#DNID#06813107-bd30-3244-8633-1dfc65cce0a6",
            "type": "ALARM",
            "scheduledTime": "2018-06-18T17:00:00+0000"
          }
        ],
        "activeAlerts": []
      }
    },
    {
      "header": {
        "namespace": "Notifications",
        "name": "IndicatorState"
      },
      "payload": {
        "isEnabled": false,
        "isVisualIndicatorPersisted": false
      }
    },
    {
      "header": {
        "namespace": "AudioPlayer",
        "name": "PlaybackState"
      },
      "payload": {
        "token": "",
        "offsetInMilliseconds": 0,
        "playerActivity": "IDLE"
      }
    },
    {
      "header": {
        "namespace": "SpeechSynthesizer",
        "name": "SpeechState"
      },
      "payload": {
        "token": "",
        "offsetInMilliseconds": 0,
        "playerActivity": "FINISHED"
      }
    },
    {
      "header": {
        "namespace": "SpeechRecognizer",
        "name": "RecognizerState"
      },
      "payload": {
        "wakeword": "alexa"
      }
    }
  ],
  "event": {
    "header": {
      "namespace": "SpeechRecognizer",
      "name": "Recognize",
      "messageId": "74b1fa95-2998-4fa8-8a68-879f5344ba10",
      "dialogRequestId": "77c90c4e-056b-4b13-88fb-0a1a32f4b476"
    },
    "payload": {
      "profile": "FAR_FIELD",
      "format": "AUDIO_L16_RATE_16000_CHANNELS_1",
      "initiator": {
        "type": "WAKEWORD",
        "payload": {
          "wakeWordIndices": {
            "startIndexInSamples": 8000,
            "endIndexInSamples": 17120
          }
        }
      }
    }
  }
}

Tell us about your environment:

What version of the AVS Device SDK are you using?

  <1.7.0>

Tell us what hardware you're using:

• Desktop / Laptop
• Raspberry Pi
• Other - tell us more: arm

Tell us about your OS (Type & version):

• Linux
• MacOS
• Raspbian Stretch
• Raspbian Jessy
• Other - tell us more:

Thanks
Leon

[priyagsenthil]

Hi Leon,

When we tested the utterance "Wait, Alexa what time is it"? Echo Dot also responded with the correct time. This I would assume is expected behavior. There is no requirement that an utterance has to begin with Alexa. But when the Alexa wake word is detected the audio bytes following the wake word are processed to provide the desired input. Could you clarify where you see that this utterance should not be processed.
Also what does the below mean

Check the voice in website: "https://alexa.amazon.com/spa/index.html#settings/dialogs"
ECHO: Text not available. Click to play recording -> where do you see this.

Thanks
Priya

[leino11121]

Hi Priya,

Here is the Alexa's document.
https://developer.amazon.com/docs/alexa-voice-service/streaming-requirements-for-cloud-based-wake-word-verification.html

• Cloud-based wake word verification improves wake word accuracy for Alexa-enabled products by reducing false wakes caused by utterances that sound similar to the wake word. For example, here are a few words that may cause a false wake for "Alexa": "Alex", "election", "Alexis". cloud-based wake word verification also detects media mentions of the wake word. For example, the mention of "Alexa" in an Amazon commercial.

Not 100%, but the probability about 70% on ECHO.

[priyagsenthil]

Hi lieoni,

As per the document the false wake is for "Alexa": "Alex", "election", "Alexis". In this case the real wake word "Alexa" was uttered. So it seems right that it was detected.

Thanks

[leino11121]

Hi Priya,

Cloud-based wake word verification improves wake word accuracy for Alexa-enabled products by reducing false wakes caused by utterances that sound similar to the wake word. For example, here are a few words that may cause a false wake for "Alexa": "Alex", "election", "Alexis". cloud-based wake word verification also detects media mentions of the wake word. For example, the mention of "Alexa" in an Amazon commercial.

I think the test cast is just like the mention of "Alexa" in an Amazon commercial

Thanks.
Leon

[zeusshuang]

Hi @priyagsenthil ,

I also have such question. I have a CBV test audio from Amazon team, and I tried it on my device, the cloud is actually no response like my picture.
but while I asked by myself, wait, Alexa, what time is it. It will respond to me, so the speed must less than 1/4 seconds.

By this test, it seems "wait, Alexa, what time is it" is a false trigger case. (defined in AVS functional self test checklist, 3.5)

I have a question related to this case, if I asked, "Alexa, Wikipedia Amazon Alexa" , should it introduce the "Amazon" , or "Amazon Alexa" ? I mean will the final "Alexa" will be erase by WW verification ?

[leino11121]

@zeusshuang

加我微信？
leino11121

[zeusshuang]

Hi @leino11121 ,
I have no wechat, but you can mail to me: zeusshuang@gmail.com