Custom Assistant Intents

[OzGav]

Note that this discussion will be updated (including the attached files) as HA core updates occur.

HA supports the commands of NEXT, PAUSE, UNPAUSE and VOLUME when targeted at a specific player. If you use the OpenAI feature of the HA integration then you can add PLAY to that list. For the remaining service calls (including targetting areas) you can use custom sentences. Note that targetting an area which has multiple players may result in unpredictable behaviour.

Firstly add this file to \\YOUR_HA_IP\config\custom_sentences\en
media.zip

Of course you can change this file to reflect your language and change the en in the file path accordingly. Please share any translations below.

Next you need to add to your configuration.yaml file the following. Note I have the unique characters ma_ in my entity_id which is used to select the correct player when targetting an area. If you don't want to add those characters you can either use a different set of characters and adjust the templates accordingly or remove all of the area based intents and not use that functionality.

intent_script:
  SetVolumeArea:
    action:
      service: "media_player.volume_set"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
        volume_level: "{{ volume / 100.0 }}"
    speech:
      text: "Volume set to {{ volume }} percent"

  PlayerPauseArea:
    action:
      service: "media_player.media_pause"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
    speech:
      text: "Paused"
          
  PlayerResumeArea:
    action:
      service: "media_player.media_play"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
    speech:
      text: "Resumed"
      
  NextTrackArea:
    action:
      service: "media_player.media_next_track"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
    speech:
      text: "Skipping to Next"

  MutePlayer:
    action:
      service: "media_player.volume_mute"
      data:
        entity_id: "{{ media_player }}"
        is_volume_muted: "{{ mute_or_unmute }}"
    speech:
      text: |
        {% if mute_or_unmute == "true" %}
          Muted
        {% else %}
          Unmuted
        {% endif %}

  MutePlayerArea:
    action:
      service: "media_player.volume_mute"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
        is_volume_muted: "{{ mute_or_unmute }}"
    speech:
      text: |
        {% if mute_or_unmute == "true" %}
          Muted
        {% else %}
          Unmuted
        {% endif %}

  ShuffleSet:
    action:
      service: "media_player.shuffle_set"
      data:
        entity_id: "{{ media_player }}"
        shuffle: "{{ shuffle_mode }}"
    speech:
      text: "Queue shuffle mode set"

  ShuffleSetArea:
    action:
      service: "media_player.shuffle_set"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
        shuffle: "{{ shuffle_mode }}"
    speech:
      text: "Queue shuffle mode set"

  RepeatSet:
    action:
      service: "media_player.repeat_set"
      data:
        entity_id: "{{ media_player }}"
        repeat: "{{ repeat_mode }}"
    speech:
      text: "Queue repeat mode set"

  RepeatSetArea:
    action:
      service: "media_player.repeat_set"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
        repeat: "{{ repeat_mode }}"
    speech:
      text: "Queue repeat mode set"

  ClearQueueArea:
    action:
      service: "media_player.clear_playlist"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
    speech:
      text: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities('study')) | select('search', 'ma_') |map(attribute='attributes.friendly_name') | join }} Queue cleared"

  ClearQueue:
    action:
      service: "media_player.clear_playlist"
      data:
        entity_id: "{{ media_player }}"
    speech:
      text: "Queue cleared"

  PlayerStop:
    action:
      service: "media_player.media_stop"
      data:
        entity_id: "{{ media_player }}"
    speech:
      text: "Stopped"

  PlayerStopArea:
    action:
      service: "media_player.media_stop"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
    speech:
      text: "Stopped"

  PreviousTrack:
    action:
      service: "media_player.media_previous_track"
      data:
        entity_id: "{{ media_player }}"
    speech:
      text: "Playing previous"

  PreviousTrackArea:
    action:
      service: "media_player.media_previous_track"
      data:
        entity_id: "{{ expand(states.media_player) | selectattr('entity_id', 'in', area_entities(area)) | select('search', 'ma_') |map(attribute='entity_id') | join }}"
    speech:
      text: "Playing previous"

  SelectSource:
    action:
      service: "media_player.select_source"
      data:
        entity_id: "{{ media_player }}"
        source: "{{ desired_source }}"
    speech:
      text: "{{ media_player }} source set to {{ desired_source }}"
      
  PlayerJoin:
    action:
      service: "media_player.join"
      target:
        entity_id: "{{ media_player_group }}"
      data:
        group_members: "{{ media_player }}"
    speech:
      text: "{{ states.media_player | selectattr('entity_id','eq',media_player) | map(attribute='attributes.friendly_name') | list | join }}  joined to {{ states.media_player | selectattr('entity_id','eq',media_player_group) | map(attribute='attributes.friendly_name') | list | join }} "

  PlayerUnjoin:
    action:
      service: "media_player.unjoin"
      target:
        entity_id: "{{ media_player }}"
    speech:
      text: "{{ states.media_player | selectattr('entity_id','eq',media_player) | map(attribute='attributes.friendly_name') | list | join }} removed from group"

[eric10k93]

so I tried adding everything as described here... if I use the assist debugging under "developer tools" I'm able to type in my sentences and see they are parsed and matched... BUT when I try to actually pass the exact same sentence to Assist, it gives me the error "Unexpected error during intent recognition" ... it seems to do this for any of the custom sentences... any thoughts? do you have this file working currently as described here?

[OzGav]

@eric10k93 You will get that if you try and target an area and there is more than one media player in that area. If that isn’t the problem look at the bottom of the Integration installation page of the docs for troubleshooting tips particularly increasing the logging so you can see what is failing . Don’t forget you can also see more information by going to Voice Assistants in the HA settings and selecting the one you are using and then debug in the top right.

edit: I am away from home so can’t try the area commands but I just tried shuffle set, repeat set and clear queue to a specific player and it worked perfectly