Can we estimate canine breathing rate from canine videos? Or human heart rate from subtle skin color change of human face/hand? Using advanced computer vision techniques (optical flow, object tracking) and robust frequency estimation techniques we get the answer "YES" for both cases.
This repository contains the codes used in the following paper:
The requirements have been tested in python 3.8. So, run this repository with zero code change we suggest using python 3.8 first. Use the below command to install python 3.8 in anaconda first:
conda create -n "hr_br_est_aci_22" python=3.8
conda activate hr_br_est_aci_22
pip install -r requirements.txtIf you ever see a matpotlib image to pop up and you want to close the window, do not use mouse to close it. Press 'Q' on keyboard to quit the image.
In this repository you can control whether you want to display the images by setting verbose argument True or False.
There are three main front-end files in this repository.
main.py reproduces the result presented in the paper. It estimates the breathing rate for three video files and the heart rate for four video files. The original video files are not publicly available for privacy concerns, but the intermediate files (extracted signals) are shared. main.py uses these results from outputs/ directory.
example.ipynb shows step-by-step processes of how to get breathing rate or heart rate from a sample video file. You will need to update the variable of the video file path to the location of the video file stored in your storage.
example-multiple-traces.ipynb reproduces the figure 9 of our paper. This shows how our video-based breathing rate estimation technique can also work under the presence of another strong distracting periodic motion signal.
If you use our code, please cite our paper:
@inproceedings{holder2022contact,
title={Contact-free simultaneous sensing of human heart Rate and canine breathing rate for animal assisted interactions},
author={Holder, Timothy and Rahman, Mushfiqur and Summers, Emily and Roberts, David and Wong, Chau-Wai and Bozkurt, Alper},
booktitle={ACM International Conference on International Conference on Animal-Computer Interaction},
year={2022},
month={December},
address={Newcastle upon Tyne, UK}
}