---
_id: '18403'
abstract:
- lang: eng
  text: Recent studies validated the feasibility of estimating heart rate from human
    faces in RGB video. However, test subjects are often recorded under controlled
    conditions, as illumination variations significantly affect the RGB-based heart
    rate estimation accuracy. Intel newly-announced low-cost RealSense 3D (RGBD) camera
    is becoming ubiquitous in laptops and mobile devices starting this year, opening
    the door to new and more robust computer vision. RealSense cameras produce RGB
    images with extra depth information inferred from a latent near-infrared (NIR)
    channel. In this paper, we experimentally demonstrate, for the first time, that
    heart rate can be reliably estimated from RealSense near-infrared images. This
    enables illumination invariant heart rate estimation, extending the heart rate
    from video feasibility to low-light applications, such as night driving. With
    the (coming) ubiquitous presence of RealSense devices, the proposed method not
    only utilizes its near-infrared channel, designed originally to be hidden from
    consumers; but also exploits the associated depth information for improved robustness
    to head pose.
article_number: '7820970'
article_processing_charge: No
author:
- first_name: Jie
  full_name: Chen, Jie
  last_name: Chen
- first_name: Zhuoqing
  full_name: Chang, Zhuoqing
  last_name: Chang
- first_name: Qiang
  full_name: Qiu, Qiang
  last_name: Qiu
- first_name: Xiaobai
  full_name: Li, Xiaobai
  last_name: Li
- first_name: Guillermo
  full_name: Sapiro, Guillermo
  last_name: Sapiro
- first_name: Alexander
  full_name: Bronstein, Alexander
  id: 58f3726e-7cba-11ef-ad8b-e6e8cb3904e6
  last_name: Bronstein
  orcid: 0000-0001-9699-8730
- first_name: Matti
  full_name: Pietikainen, Matti
  last_name: Pietikainen
citation:
  ama: 'Chen J, Chang Z, Qiu Q, et al. RealSense = real heart rate: Illumination invariant
    heart rate estimation from videos. In: <i>2016 Sixth International Conference
    on Image Processing Theory, Tools and Applications (IPTA)</i>. IEEE; 2017. doi:<a
    href="https://doi.org/10.1109/ipta.2016.7820970">10.1109/ipta.2016.7820970</a>'
  apa: 'Chen, J., Chang, Z., Qiu, Q., Li, X., Sapiro, G., Bronstein, A. M., &#38;
    Pietikainen, M. (2017). RealSense = real heart rate: Illumination invariant heart
    rate estimation from videos. In <i>2016 Sixth International Conference on Image
    Processing Theory, Tools and Applications (IPTA)</i>. Oulu, Finland: IEEE. <a
    href="https://doi.org/10.1109/ipta.2016.7820970">https://doi.org/10.1109/ipta.2016.7820970</a>'
  chicago: 'Chen, Jie, Zhuoqing Chang, Qiang Qiu, Xiaobai Li, Guillermo Sapiro, Alex
    M. Bronstein, and Matti Pietikainen. “RealSense = Real Heart Rate: Illumination
    Invariant Heart Rate Estimation from Videos.” In <i>2016 Sixth International Conference
    on Image Processing Theory, Tools and Applications (IPTA)</i>. IEEE, 2017. <a
    href="https://doi.org/10.1109/ipta.2016.7820970">https://doi.org/10.1109/ipta.2016.7820970</a>.'
  ieee: 'J. Chen <i>et al.</i>, “RealSense = real heart rate: Illumination invariant
    heart rate estimation from videos,” in <i>2016 Sixth International Conference
    on Image Processing Theory, Tools and Applications (IPTA)</i>, Oulu, Finland,
    2017.'
  ista: 'Chen J, Chang Z, Qiu Q, Li X, Sapiro G, Bronstein AM, Pietikainen M. 2017.
    RealSense = real heart rate: Illumination invariant heart rate estimation from
    videos. 2016 Sixth International Conference on Image Processing Theory, Tools
    and Applications (IPTA). 6th International Conference on Image Processing Theory,
    Tools and Applications, 7820970.'
  mla: 'Chen, Jie, et al. “RealSense = Real Heart Rate: Illumination Invariant Heart
    Rate Estimation from Videos.” <i>2016 Sixth International Conference on Image
    Processing Theory, Tools and Applications (IPTA)</i>, 7820970, IEEE, 2017, doi:<a
    href="https://doi.org/10.1109/ipta.2016.7820970">10.1109/ipta.2016.7820970</a>.'
  short: J. Chen, Z. Chang, Q. Qiu, X. Li, G. Sapiro, A.M. Bronstein, M. Pietikainen,
    in:, 2016 Sixth International Conference on Image Processing Theory, Tools and
    Applications (IPTA), IEEE, 2017.
conference:
  end_date: 2016-12-15
  location: Oulu, Finland
  name: 6th International Conference on Image Processing Theory, Tools and Applications
  start_date: 2016-12-12
date_created: 2024-10-15T11:20:54Z
date_published: 2017-01-19T00:00:00Z
date_updated: 2024-12-04T14:32:02Z
day: '19'
doi: 10.1109/ipta.2016.7820970
extern: '1'
fulldoi: https://doi.org/10.1109/ipta.2016.7820970
language:
- iso: eng
month: '01'
oa_version: None
publication: 2016 Sixth International Conference on Image Processing Theory, Tools
  and Applications (IPTA)
publication_identifier:
  eissn:
  - 2154-512X
  isbn:
  - '9781467389112'
publication_status: published
publisher: IEEE
quality_controlled: '1'
scopus_import: '1'
status: public
title: 'RealSense = real heart rate: Illumination invariant heart rate estimation
  from videos'
type: conference
user_id: 3E5EF7F0-F248-11E8-B48F-1D18A9856A87
year: '2017'
...