Question: Serious Warning - or only information? label is CAT or cow #95

ozett · 2021-09-10T19:03:06Z

i got log infos like: `` label not a person, cow found```

regardless of the label. is the image processed?

jakowenko · 2021-09-10T20:26:32Z

No, those images are not being processed. There is a Frigate label check that happens first to make sure the label is a person.

I can remove these though, or maybe hide them under another log level type. I'm working on adding verbose logs. So maybe this should be hidden by default.

jakowenko · 2021-09-11T06:08:33Z

I moved these warnings to a new log level type that I just added support for. See more here.

By default these won't show now unless the logger is set to verbose.

ozett · 2021-09-11T06:59:09Z

i would like to see this configurable.
maybe you let the user overwrite the category? or add more object-types for face-red?

if i can use other object-categories to feed into face-detect helps for me to catch som typical false-positives.
(i do this on my custom-python also for false-positives. the object-category is not always correct)

jakowenko · 2021-09-11T07:01:10Z

It supports various categories, but I need to add code to log for each of those various ones and depending on what level is set you'll either see them or not. This is just adding support for more of that in the future.

What idea did you have to overwrite the categories? Can you post a sample config of what you had in mind?

ozett · 2021-09-11T07:04:21Z

behind my cat-category sometimes is a human face.
i would like to feed that image to the fac-rec, regardless is was tagged as cat.
than the face-rec will sort it out.

the way it now works is, that the categroy will sort (false-false-positive) images tagged with cat out. but sometimes they contain faces. i would let the face-rec do this work on not fully rely on obj-detection by categro. or at least let the user choose in the config to do such thing.

jakowenko · 2021-09-11T07:08:41Z

Ah I see what you mean. So maybe something like this in the config? Then the user can define what labels they want to process images for?

frigate:
   labels:
     - person
     - cat
     - dog

ozett · 2021-09-11T07:26:38Z

looks good.
syntax like in frigate..

# NOTE: Try to Find FACES in images with other object-labels. Use Labels for FACE-REC:
frigate:
   labels:     
     - person
     - cat
     - dog

sould be made clear (somehow), that this is opens up the first narrow object-selction in frigate with a second-selection "opener" to a second-level face-analysis (to find faces in therefore false-positive-categories)

jakowenko · 2021-09-11T07:29:26Z

I'll try to work this in the beta build tomorrow. It's 3:30am here. I'm off to bed for the night 😴

ozett · 2021-09-11T07:38:24Z

alrigth. in europe now daytime started ... ✋

jakowenko · 2021-09-11T08:06:29Z

I snuck this in before going to bed. Let me know if this works. Beta build should be done in a few min.

frigate:
  url: http://localhost:5000
  labels:
    - person
    - cat

Logs will now show something like this too.

ozett · 2021-09-11T08:37:17Z

MQTT subscrition does not reflect this. i wait for more logging...

jakowenko · 2021-09-11T14:34:10Z

What do you mean the MQTT subscription is not reflecting it? If the processed image with a cat doesn't return a match or unknown person then nothing will be published to.

Set your logs to this and see if anything shows up for those labels. In my testing the label check is working. Everything after that is what was previously happening with the processing of that image.

logs:
  level: verbose

ozett · 2021-09-11T14:38:18Z

i assume your getting snapshot from the topic: /+/person/snapshot
but thats only person.

the cats from every cam would be: /+/cat/snapshot

my proof:

ozett · 2021-09-11T15:13:23Z

face on bicycle - worth checking... 😄

# [0.11.0](v0.10.2...v0.11.0) (2021-09-21) ### Bug Fixes * add auth middleware to filters route ([d25c1fd](d25c1fd)) * add auth token to saveURLs function ([#70](#70)) ([167758f](167758f)) * add support for multiple training uploads ([#77](#77)) ([142b3f7](142b3f7)) * better error handling when training fails to prevent stuck loading bar ([07dfd25](07dfd25)) * better handling of new filters ([3fffa6e](3fffa6e)) * button alignment on train toolbar ([c9b38ce](c9b38ce)) * catch errors from recognize/test ([51629d3](51629d3)) * catch get-orientation errors ([d1ca17d](d1ca17d)) * catch if paginated page has no results and return to page 1 ([713be92](713be92)) * catch invalid config on save before writing file ([#94](#94)) ([e4503e8](e4503e8)) * catch when time format is null ([#98](#98)) ([ed872dd](ed872dd)) * check for first number in status to determine if file is trained or untrained ([125f96e](125f96e)) * clean /tmp files after processing and remove all on restarts [#76](#76) ([a5c761f](a5c761f)) * clean mqtt /tmp files after processing [#76](#76) ([b6478ce](b6478ce)) * clear disabled array ([dd84f85](dd84f85)) * define default value for error ([5f27099](5f27099)) * don't reprocess if no detectors configured ([157e7c7](157e7c7)) * loop through compreface plugin results on ui ([83cea24](83cea24)) * **mqtt:** don't publish message if client isn't connected ([5901ebe](5901ebe)) * pass auth token on /cameras route to recognize endpoint ([2e940bf](2e940bf)) * pass upcoming filename to start function to use in response ([32f0bae](32f0bae)) * prevent pagination changes if api is loading ([c767aae](c767aae)) * sanpshot mask check ([56f3ea6](56f3ea6)) * update respond middleware to use res.customStatusCode instead of native res.statusCode ([caf6a89](caf6a89)) * use HTTPSuccess for test controller response ([9bcf8fa](9bcf8fa)) ### Features * ability to adjust thumbnail quality/size and page limit ([e5207fa](e5207fa)) * ability to include base64 encoded string in API results and MQTT messages ([#52](#52)) ([233d56a](233d56a)) * ability to increase auth token expiration ([#78](#78), [#80](#80)) ([d68d39e](d68d39e)) * ability to mask images before processing [#79](#79) ([decb245](decb245)) * ability to reprocess images from the matches page ([#84](#84)) ([809d5f3](809d5f3)) * ability to resize source images with query string ([c2ea600](c2ea600)) * add a delay expressed in seconds between each detection loop ([#83](#83)) ([23dc29e](23dc29e)) * add createdAt, updatedAt to detector detail and tooltip ([#100](#100)) ([03c83f5](03c83f5)) * allow customizing frigate labels ([#95](#95)) ([5eb100a](5eb100a)) * apple-touch-startup-image and theme color ([d8106bb](d8106bb)) * configure detector timeouts ([f654dec](f654dec)) * copy yaml config with defaults ([052ab4b](052ab4b)) * enable or disable frigate mqtt topic snapshot processing ([#83](#83)) ([3bf2bea](3bf2bea)) * filter training results when dropdown is used ([#89](#89)) ([81232aa](81232aa)) * include reasons why image was a miss on matches page ([#90](#90)) ([f5e220b](f5e220b)) * include version on config page with ability to copy ([029bfea](029bfea)) * log level support ([#84](#84)) ([5f91b83](5f91b83)) * pagination and filtering on all matches + refactoring ([af30071](af30071)) * publish errors to mqtt topic ([#52](#52)) ([01a2d6c](01a2d6c)) * redact secrets and keys from logs ([0f3ef02](0f3ef02)) * sockets for live reloading ([50fef76](50fef76)) * support for compreface mask plugin ([#85](#85)) ([7951524](7951524)) * support for multiple frigate urls and topics ([4ead9f7](4ead9f7)) * **train:** pagination ([f749437](f749437))

ozett · 2021-09-21T07:32:37Z

i am on "v1.0.0-d25c1fd:beta" and guess that face-rec is still limited to "person" categories because DT still only listens to the fixed MQTT-topic "person".

or am i wrong with that? does DT grab the configured other labels from the "event"-topic and grabs them than over http as "snapshot"? https://github.com/jakowenko/double-take/tree/beta#frigate-1

# [0.11.0](v0.10.2...v0.11.0) (2021-09-21) ### Bug Fixes * add auth middleware to filters route ([d25c1fd](d25c1fd)) * add auth token to saveURLs function ([#70](#70)) ([167758f](167758f)) * add support for multiple training uploads ([#77](#77)) ([142b3f7](142b3f7)) * better error handling when training fails to prevent stuck loading bar ([07dfd25](07dfd25)) * better handling of new filters ([3fffa6e](3fffa6e)) * button alignment on train toolbar ([c9b38ce](c9b38ce)) * catch errors from recognize/test ([51629d3](51629d3)) * catch get-orientation errors ([d1ca17d](d1ca17d)) * catch if paginated page has no results and return to page 1 ([713be92](713be92)) * catch invalid config on save before writing file ([#94](#94)) ([e4503e8](e4503e8)) * catch when time format is null ([#98](#98)) ([ed872dd](ed872dd)) * check for first number in status to determine if file is trained or untrained ([125f96e](125f96e)) * clean /tmp files after processing and remove all on restarts [#76](#76) ([a5c761f](a5c761f)) * clean mqtt /tmp files after processing [#76](#76) ([b6478ce](b6478ce)) * clear disabled array ([dd84f85](dd84f85)) * define default value for error ([5f27099](5f27099)) * don't reprocess if no detectors configured ([157e7c7](157e7c7)) * loop through compreface plugin results on ui ([83cea24](83cea24)) * **mqtt:** don't publish message if client isn't connected ([5901ebe](5901ebe)) * pass auth token on /cameras route to recognize endpoint ([2e940bf](2e940bf)) * pass upcoming filename to start function to use in response ([32f0bae](32f0bae)) * prevent pagination changes if api is loading ([c767aae](c767aae)) * sanpshot mask check ([56f3ea6](56f3ea6)) * update respond middleware to use res.customStatusCode instead of native res.statusCode ([caf6a89](caf6a89)) * use HTTPSuccess for test controller response ([9bcf8fa](9bcf8fa)) ### Features * ability to adjust thumbnail quality/size and page limit ([e5207fa](e5207fa)) * ability to include base64 encoded string in API results and MQTT messages ([#52](#52)) ([233d56a](233d56a)) * ability to increase auth token expiration ([#78](#78), [#80](#80)) ([d68d39e](d68d39e)) * ability to mask images before processing [#79](#79) ([decb245](decb245)) * ability to reprocess images from the matches page ([#84](#84)) ([809d5f3](809d5f3)) * ability to resize source images with query string ([c2ea600](c2ea600)) * add a delay expressed in seconds between each detection loop ([#83](#83)) ([23dc29e](23dc29e)) * add createdAt, updatedAt to detector detail and tooltip ([#100](#100)) ([03c83f5](03c83f5)) * allow customizing frigate labels ([#95](#95)) ([5eb100a](5eb100a)) * apple-touch-startup-image and theme color ([d8106bb](d8106bb)) * configure detector timeouts ([f654dec](f654dec)) * copy yaml config with defaults ([052ab4b](052ab4b)) * enable or disable frigate mqtt topic snapshot processing ([#83](#83)) ([3bf2bea](3bf2bea)) * filter training results when dropdown is used ([#89](#89)) ([81232aa](81232aa)) * include reasons why image was a miss on matches page ([#90](#90)) ([f5e220b](f5e220b)) * include version on config page with ability to copy ([029bfea](029bfea)) * log level support ([#84](#84)) ([5f91b83](5f91b83)) * pagination and filtering on all matches + refactoring ([af30071](af30071)) * publish errors to mqtt topic ([#52](#52)) ([01a2d6c](01a2d6c)) * redact secrets and keys from logs ([0f3ef02](0f3ef02)) * sockets for live reloading ([50fef76](50fef76)) * support for compreface mask plugin ([#85](#85)) ([7951524](7951524)) * support for multiple frigate urls and topics ([4ead9f7](4ead9f7)) * **train:** pagination ([f749437](f749437))

# [1.0.0](v0.10.2...v1.0.0) (2021-09-21) ### Bug Fixes * add auth middleware to filters route ([d25c1fd](d25c1fd)) * add auth token to saveURLs function ([#70](#70)) ([167758f](167758f)) * add support for multiple training uploads ([#77](#77)) ([142b3f7](142b3f7)) * better error handling when training fails to prevent stuck loading bar ([07dfd25](07dfd25)) * better handling of new filters ([3fffa6e](3fffa6e)) * button alignment on train toolbar ([c9b38ce](c9b38ce)) * catch errors from recognize/test ([51629d3](51629d3)) * catch get-orientation errors ([d1ca17d](d1ca17d)) * catch if paginated page has no results and return to page 1 ([713be92](713be92)) * catch invalid config on save before writing file ([#94](#94)) ([e4503e8](e4503e8)) * catch when time format is null ([#98](#98)) ([ed872dd](ed872dd)) * check for first number in status to determine if file is trained or untrained ([125f96e](125f96e)) * clean /tmp files after processing and remove all on restarts [#76](#76) ([a5c761f](a5c761f)) * clean mqtt /tmp files after processing [#76](#76) ([b6478ce](b6478ce)) * clear disabled array ([dd84f85](dd84f85)) * define default value for error ([5f27099](5f27099)) * don't reprocess if no detectors configured ([157e7c7](157e7c7)) * loop through compreface plugin results on ui ([83cea24](83cea24)) * **mqtt:** don't publish message if client isn't connected ([5901ebe](5901ebe)) * pass auth token on /cameras route to recognize endpoint ([2e940bf](2e940bf)) * pass upcoming filename to start function to use in response ([32f0bae](32f0bae)) * prevent pagination changes if api is loading ([c767aae](c767aae)) * sanpshot mask check ([56f3ea6](56f3ea6)) * update respond middleware to use res.customStatusCode instead of native res.statusCode ([caf6a89](caf6a89)) * use HTTPSuccess for test controller response ([9bcf8fa](9bcf8fa)) ### chore * release ([3dddd40](3dddd40)) ### Features * ability to adjust thumbnail quality/size and page limit ([e5207fa](e5207fa)) * ability to include base64 encoded string in API results and MQTT messages ([#52](#52)) ([233d56a](233d56a)) * ability to increase auth token expiration ([#78](#78), [#80](#80)) ([d68d39e](d68d39e)) * ability to mask images before processing [#79](#79) ([decb245](decb245)) * ability to reprocess images from the matches page ([#84](#84)) ([809d5f3](809d5f3)) * ability to resize source images with query string ([c2ea600](c2ea600)) * add a delay expressed in seconds between each detection loop ([#83](#83)) ([23dc29e](23dc29e)) * add createdAt, updatedAt to detector detail and tooltip ([#100](#100)) ([03c83f5](03c83f5)) * allow customizing frigate labels ([#95](#95)) ([5eb100a](5eb100a)) * apple-touch-startup-image and theme color ([d8106bb](d8106bb)) * configure detector timeouts ([f654dec](f654dec)) * copy yaml config with defaults ([052ab4b](052ab4b)) * enable or disable frigate mqtt topic snapshot processing ([#83](#83)) ([3bf2bea](3bf2bea)) * filter training results when dropdown is used ([#89](#89)) ([81232aa](81232aa)) * include reasons why image was a miss on matches page ([#90](#90)) ([f5e220b](f5e220b)) * include version on config page with ability to copy ([029bfea](029bfea)) * log level support ([#84](#84)) ([5f91b83](5f91b83)) * pagination and filtering on all matches + refactoring ([af30071](af30071)) * publish errors to mqtt topic ([#52](#52)) ([01a2d6c](01a2d6c)) * redact secrets and keys from logs ([0f3ef02](0f3ef02)) * sockets for live reloading ([50fef76](50fef76)) * support for compreface mask plugin ([#85](#85)) ([7951524](7951524)) * support for multiple frigate urls and topics ([4ead9f7](4ead9f7)) * **train:** pagination ([f749437](f749437)) ### BREAKING CHANGES * v1.0.0

# [1.0.0](v0.10.2...v1.0.0) (2021-09-21) ### Bug Fixes * add auth middleware to filters route ([d25c1fd](d25c1fd)) * add auth token to saveURLs function ([#70](#70)) ([167758f](167758f)) * add support for multiple training uploads ([#77](#77)) ([142b3f7](142b3f7)) * better error handling when training fails to prevent stuck loading bar ([07dfd25](07dfd25)) * better handling of new filters ([3fffa6e](3fffa6e)) * button alignment on train toolbar ([c9b38ce](c9b38ce)) * catch errors from recognize/test ([51629d3](51629d3)) * catch get-orientation errors ([d1ca17d](d1ca17d)) * catch if paginated page has no results and return to page 1 ([713be92](713be92)) * catch invalid config on save before writing file ([#94](#94)) ([e4503e8](e4503e8)) * catch when time format is null ([#98](#98)) ([ed872dd](ed872dd)) * check for first number in status to determine if file is trained or untrained ([125f96e](125f96e)) * clean /tmp files after processing and remove all on restarts [#76](#76) ([a5c761f](a5c761f)) * clean mqtt /tmp files after processing [#76](#76) ([b6478ce](b6478ce)) * clear disabled array ([dd84f85](dd84f85)) * define default value for error ([5f27099](5f27099)) * don't reprocess if no detectors configured ([157e7c7](157e7c7)) * loop through compreface plugin results on ui ([83cea24](83cea24)) * **mqtt:** don't publish message if client isn't connected ([5901ebe](5901ebe)) * pass auth token on /cameras route to recognize endpoint ([2e940bf](2e940bf)) * pass upcoming filename to start function to use in response ([32f0bae](32f0bae)) * prevent pagination changes if api is loading ([c767aae](c767aae)) * sanpshot mask check ([56f3ea6](56f3ea6)) * update respond middleware to use res.customStatusCode instead of native res.statusCode ([caf6a89](caf6a89)) * use HTTPSuccess for test controller response ([9bcf8fa](9bcf8fa)) ### chore * release ([824db79](824db79)) ### Features * ability to adjust thumbnail quality/size and page limit ([e5207fa](e5207fa)) * ability to include base64 encoded string in API results and MQTT messages ([#52](#52)) ([233d56a](233d56a)) * ability to increase auth token expiration ([#78](#78), [#80](#80)) ([d68d39e](d68d39e)) * ability to mask images before processing [#79](#79) ([decb245](decb245)) * ability to reprocess images from the matches page ([#84](#84)) ([809d5f3](809d5f3)) * ability to resize source images with query string ([c2ea600](c2ea600)) * add a delay expressed in seconds between each detection loop ([#83](#83)) ([23dc29e](23dc29e)) * add createdAt, updatedAt to detector detail and tooltip ([#100](#100)) ([03c83f5](03c83f5)) * allow customizing frigate labels ([#95](#95)) ([5eb100a](5eb100a)) * apple-touch-startup-image and theme color ([d8106bb](d8106bb)) * configure detector timeouts ([f654dec](f654dec)) * copy yaml config with defaults ([052ab4b](052ab4b)) * enable or disable frigate mqtt topic snapshot processing ([#83](#83)) ([3bf2bea](3bf2bea)) * filter training results when dropdown is used ([#89](#89)) ([81232aa](81232aa)) * include reasons why image was a miss on matches page ([#90](#90)) ([f5e220b](f5e220b)) * include version on config page with ability to copy ([029bfea](029bfea)) * log level support ([#84](#84)) ([5f91b83](5f91b83)) * pagination and filtering on all matches + refactoring ([af30071](af30071)) * publish errors to mqtt topic ([#52](#52)) ([01a2d6c](01a2d6c)) * redact secrets and keys from logs ([0f3ef02](0f3ef02)) * sockets for live reloading ([50fef76](50fef76)) * support for compreface mask plugin ([#85](#85)) ([7951524](7951524)) * support for multiple frigate urls and topics ([4ead9f7](4ead9f7)) * **train:** pagination ([f749437](f749437)) ### BREAKING CHANGES * v1.0.0

jakowenko · 2021-09-21T18:59:32Z

i am on "v1.0.0-d25c1fd:beta" and guess that face-rec is still limited to "person" categories because DT still only listens to the fixed MQTT-topic "person".

or am i wrong with that? does DT grab the configured other labels from the "event"-topic and grabs them than over http as "snapshot"? https://github.com/jakowenko/double-take/tree/beta#frigate-1

The labels are only used when DT is triggered from frigate/events. It doesn't apply to the other snapshot topics. If you would like support for this can you open a new issue?

I'm trying to clean up some of these legacy ones now that 1.0.0 was released and had changes for this issue.

ozett · 2021-10-17T16:40:06Z

since today on v1.5.0-5eb9971:latest
seems that the labels are now working.

i got now faces from all cameras, where that labels are detected.
before it was only that cameras explicitly listed in the config.

would be good to see on the gui that the image came in with that label,
and to differentiate that from faces comin on from explicit configured cams.

jakowenko added the question Further information is requested label Sep 10, 2021

jakowenko added a commit that referenced this issue Sep 11, 2021

chore: move frigate check logs to verbose level (#95)

65dc78c

jakowenko added a commit that referenced this issue Sep 11, 2021

feat: allow customizing frigate labels (#95)

5eb100a

jakowenko closed this as completed Sep 21, 2021

ozett mentioned this issue Oct 18, 2021

[BUG] Detection Labels have global-scope. Overwrite per Camera ? #132

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Question: Serious Warning - or only information? label is CAT or cow #95

Question: Serious Warning - or only information? label is CAT or cow #95

ozett commented Sep 10, 2021

jakowenko commented Sep 10, 2021

jakowenko commented Sep 11, 2021

ozett commented Sep 11, 2021

jakowenko commented Sep 11, 2021

ozett commented Sep 11, 2021

jakowenko commented Sep 11, 2021 •

edited

Loading

ozett commented Sep 11, 2021

jakowenko commented Sep 11, 2021

ozett commented Sep 11, 2021

jakowenko commented Sep 11, 2021 •

edited

Loading

ozett commented Sep 11, 2021 •

edited

Loading

jakowenko commented Sep 11, 2021 •

edited

Loading

ozett commented Sep 11, 2021

ozett commented Sep 11, 2021

ozett commented Sep 21, 2021 •

edited

Loading

jakowenko commented Sep 21, 2021

ozett commented Oct 17, 2021 •

edited

Loading

Question: Serious Warning - or only information? label is CAT or cow #95

Question: Serious Warning - or only information? label is CAT or cow #95

Comments

ozett commented Sep 10, 2021

jakowenko commented Sep 10, 2021

jakowenko commented Sep 11, 2021

ozett commented Sep 11, 2021

jakowenko commented Sep 11, 2021

ozett commented Sep 11, 2021

jakowenko commented Sep 11, 2021 • edited Loading

ozett commented Sep 11, 2021

jakowenko commented Sep 11, 2021

ozett commented Sep 11, 2021

jakowenko commented Sep 11, 2021 • edited Loading

ozett commented Sep 11, 2021 • edited Loading

jakowenko commented Sep 11, 2021 • edited Loading

ozett commented Sep 11, 2021

ozett commented Sep 11, 2021

ozett commented Sep 21, 2021 • edited Loading

jakowenko commented Sep 21, 2021

ozett commented Oct 17, 2021 • edited Loading

jakowenko commented Sep 11, 2021 •

edited

Loading

jakowenko commented Sep 11, 2021 •

edited

Loading

ozett commented Sep 11, 2021 •

edited

Loading

jakowenko commented Sep 11, 2021 •

edited

Loading

ozett commented Sep 21, 2021 •

edited

Loading

ozett commented Oct 17, 2021 •

edited

Loading