Recorder Purge Entities not working as expected

[kaizersoje]

The problem

I tried the recorder.purge_entities service to remove certain entities from the recorder. I first used the entity_globs option. However, I noticed the Call Service button is disabled when I use this option.

I then used the entity_id option to set each entity one by one and then was able to select the Call Service button.

After clicking the button, I logged into the SQLite Web addon and can still see those entities are present in the DB.

What version of Home Assistant Core has the issue?

core-2021.12.10

What was the last working version of Home Assistant Core?

No response

What type of installation are you running?

Home Assistant OS

Integration causing the issue

recorder

Link to integration documentation on our website

https://www.home-assistant.io/integrations/recorder/

Example YAML snippet

service: recorder.purge_entities
data:
  entity_globs: sensor.*_50765cb7d9ea4e2199a4fa879613a492

service: recorder.purge_entities
data: {}
target:
  entity_id: sensor.jphone_info

Anything in the logs that might be useful for us?

No response

Additional information

No response

[probot-home-assistant]

recorder documentation
recorder source
_{^{(message by IssueLinks)}}

[probot-home-assistant]

Hey there @home-assistant/core, mind taking a look at this issue as it has been labeled with an integration (recorder) you are listed as a code owner for? Thanks!
_{^{(message by CodeOwnersMention)}}

[emontnemery]

This should work, can you enable debug logging for recorder and check what happens if you try purging again?

logger:
  default: info
  logs:
    homeassistant.components.recorder: debug
    homeassistant.components.recorder.purge: debug

[kaizersoje]

I ran the code below around 11.30AM

service: recorder.purge_entities
data: {}
target:
  entity_id: sensor.jphone_info

2022-02-01 11:27:36 DEBUG (Recorder) [homeassistant.components.recorder.purge] Purging entity data for ['sensor.jphone_info']
2022-02-01 11:27:36 DEBUG (Recorder) [homeassistant.components.recorder.purge] Selected 998 state_ids to remove that should be filtered
2022-02-01 11:27:36 DEBUG (Recorder) [homeassistant.components.recorder.purge] Updated 998 states to remove old_state_id
2022-02-01 11:27:36 DEBUG (Recorder) [homeassistant.components.recorder.purge] Deleted 998 states
2022-02-01 11:27:38 DEBUG (Recorder) [homeassistant.components.recorder.purge] Deleted 998 events
2022-02-01 11:27:38 DEBUG (Recorder) [homeassistant.components.recorder.purge] Purging entity data hasn't fully completed yet

2 hours later

2022-02-01 13:35:28 DEBUG (Recorder) [homeassistant.components.recorder.purge] Purging entity data for ['sensor.jphone_info']
2022-02-01 13:35:28 DEBUG (Recorder) [homeassistant.components.recorder.purge] Selected 998 state_ids to remove that should be filtered
2022-02-01 13:35:28 DEBUG (Recorder) [homeassistant.components.recorder.purge] Updated 998 states to remove old_state_id
2022-02-01 13:35:28 DEBUG (Recorder) [homeassistant.components.recorder.purge] Deleted 998 states
2022-02-01 13:35:31 DEBUG (Recorder) [homeassistant.components.recorder.purge] Deleted 998 events
2022-02-01 13:35:31 DEBUG (Recorder) [homeassistant.components.recorder.purge] Purging entity data hasn't fully completed yet

I can see the data for that entity_id is still present in the DB.

[emontnemery]

@kaizersoje Do you mean you only saw this message once at 11:27?

2022-02-01 11:27:36 DEBUG (Recorder) [homeassistant.components.recorder.purge] Purging entity data for ['sensor.jphone_info']
2022-02-01 11:27:36 DEBUG (Recorder) [homeassistant.components.recorder.purge] Selected 998 state_ids to remove that should be filtered
2022-02-01 11:27:36 DEBUG (Recorder) [homeassistant.components.recorder.purge] Updated 998 states to remove old_state_id
2022-02-01 11:27:36 DEBUG (Recorder) [homeassistant.components.recorder.purge] Deleted 998 states
2022-02-01 11:27:38 DEBUG (Recorder) [homeassistant.components.recorder.purge] Deleted 998 events
2022-02-01 11:27:38 DEBUG (Recorder) [homeassistant.components.recorder.purge] Purging entity data hasn't fully completed yet

What happened two hours later, was the message repeated by itself, or did you run the service again?

It would be helpful if you attached the log, you can zip it, then drag-and-drop the zip file to a comment 👍