Skip to content

Latest commit

 

History

History
98 lines (85 loc) · 3.01 KB

README.md

File metadata and controls

98 lines (85 loc) · 3.01 KB
Raw

com.webos.service.ai

Summary

Ai service for webOS OSE.

Description

This service provides ai features such as speech/face/gesture recognition.

API summary

webOS OSE provides methods only for speech recognition yet.

  1. Start the service
$ luna-send -n 1 -f luna://com.webos.service.ai.voice/start '{"mode":"continuous", "keywordDetect":true}'
  {
      "returnValue": true
  }

Parameters

  • mode: continuous | single (Continuous menas the service will restart automatically. Single means you have to start service every time.)
  • keywordDetect: true | false (For using keyword activation such as 'Ok,Google'. if you want to press button to talk, set this value to false)
  1. Stop
$ luna-send -n 1 -f luna://com.webos.service.ai.voice/stop '{}'
  {
      "returnValue": true
  }
  1. getState
$ luna-send -i -f luna://com.webos.service.ai.voice/getState '{"subscribe":true}'
  {
      "returnValue": true
      "state": "idle"
  }

Life cycle of the service is state machine.

  • idle : before start.
  • waitActivation: wait for keyword activation.
  • recording : connect NLP server and uploading audio for speech recognition.
  • thinking : wait for results of speech recognition.
  • answering : answering to requests via speaker.
          [start]                        [keyword detected]
  idle -------------------------> waitActivation ----> recording --> thinking --> answering
   ^    | (keywordDetect: true)                           ^                          |
   |    |                                                 |                          |
   |    ---------------------------------------------------                          |
   |    ^                         (keywordDetect: false)                             |
   |    |                                                                            |
   |    | (mode: continuous)                                                         |
   -----------------------------------------------------------------------------------
   (mode: single)
  1. getResponse
$ luna-send -i -f luna://com.webos.service.ai.voice/getResponse '{"subscribe":true}'

  The default keyword is "snowboy", So just say "snowboy! what's the weather?"
  You can change the keyword model, refer the [snowboy.kitt.ai](https://snowboy.kitt.ai/)
  Download custom keyword model and move it to /etc/googleAssistant/ on your device
  Modify KEYWORD_DETECT_MODEL in /var/systemd/system/env/ai.env

  {
      "provider": "googleassistant",
      "response": {
          "keywordDetected": 1
      }
  }
  {
      "provider": "googleassistant",
      "response": {
          "partial": "what's the"
      }
  }
  {
      "provider": "googleassistant",
      "response": {
          "partial": "what's the weather"
      }
  }
  {
      "provider": "googleassistant",
      "response": {
          "displayText": "Cloudy with a chance of clouds! Currently in Seoul it's 79 and cloudy. The forecast today is 77 and cloudy. ( More on weather.com )"
      }
  }