---
_id: '3189'
abstract:
- lang: eng
  text: This paper presents an algorithm capable of real-time separation of foreground
    from background in monocular video sequences. Automatic segmentation of layers
    from colour/contrast or from motion alone is known to be error-prone. Here motion,
    colour and contrast cues are probabilistically fused together with spatial and
    temporal priors to infer layers accurately and efficiently. Central to our algorithm
    is the fact that pixel velocities are not needed, thus removing the need for optical
    flow estimation, with its tendency to error and computational expense. Instead,
    an efficient motion vs non-motion classifier is trained to operate directly and
    jointly on intensity-change and contrast. Its output is then fused with colour
    information. The prior on segmentation is represented by a second order, temporal,
    Hidden Markov Model, together with a spatial MRF favouring coherence except where
    contrast is high. Finally, accurate layer segmentation and explicit occlusion
    detection are efficiently achieved by binary graph cut. The segmentation accuracy
    of the proposed algorithm is quantitatively evaluated with respect to existing
    ground-truth data and found to be comparable to the accuracy of a state of the
    art stereo segmentation algorithm. Fore-ground/background segmentation is demonstrated
    in the application of live background substitution and shown to generate convincingly
    good quality composite video.
author:
- first_name: Antonio
  full_name: Criminisi, Antonio
  last_name: Criminisi
- first_name: Geoffrey
  full_name: Cross, Geoffrey
  last_name: Cross
- first_name: Andrew
  full_name: Blake, Andrew
  last_name: Blake
- first_name: Vladimir
  full_name: Vladimir Kolmogorov
  id: 3D50B0BA-F248-11E8-B48F-1D18A9856A87
  last_name: Kolmogorov
citation:
  ama: 'Criminisi A, Cross G, Blake A, Kolmogorov V. Bilayer segmentation of live
    video. In: Vol 1. IEEE; 2006:53-60. doi:<a href="https://doi.org/10.1109/CVPR.2006.69">10.1109/CVPR.2006.69</a>'
  apa: 'Criminisi, A., Cross, G., Blake, A., &#38; Kolmogorov, V. (2006). Bilayer
    segmentation of live video (Vol. 1, pp. 53–60). Presented at the CVPR: Computer
    Vision and Pattern Recognition, IEEE. <a href="https://doi.org/10.1109/CVPR.2006.69">https://doi.org/10.1109/CVPR.2006.69</a>'
  chicago: Criminisi, Antonio, Geoffrey Cross, Andrew Blake, and Vladimir Kolmogorov.
    “Bilayer Segmentation of Live Video,” 1:53–60. IEEE, 2006. <a href="https://doi.org/10.1109/CVPR.2006.69">https://doi.org/10.1109/CVPR.2006.69</a>.
  ieee: 'A. Criminisi, G. Cross, A. Blake, and V. Kolmogorov, “Bilayer segmentation
    of live video,” presented at the CVPR: Computer Vision and Pattern Recognition,
    2006, vol. 1, pp. 53–60.'
  ista: 'Criminisi A, Cross G, Blake A, Kolmogorov V. 2006. Bilayer segmentation of
    live video. CVPR: Computer Vision and Pattern Recognition vol. 1, 53–60.'
  mla: Criminisi, Antonio, et al. <i>Bilayer Segmentation of Live Video</i>. Vol.
    1, IEEE, 2006, pp. 53–60, doi:<a href="https://doi.org/10.1109/CVPR.2006.69">10.1109/CVPR.2006.69</a>.
  short: A. Criminisi, G. Cross, A. Blake, V. Kolmogorov, in:, IEEE, 2006, pp. 53–60.
conference:
  name: 'CVPR: Computer Vision and Pattern Recognition'
date_created: 2018-12-11T12:01:54Z
date_published: 2006-07-05T00:00:00Z
date_updated: 2021-01-12T07:41:40Z
day: '05'
doi: 10.1109/CVPR.2006.69
extern: 1
intvolume: '         1'
main_file_link:
- open_access: '0'
  url: http://research.microsoft.com/en-us/um/people/ablake/papers/ablake/criminisi_cvpr06.pdf
month: '07'
page: 53 - 60
publication_status: published
publisher: IEEE
publist_id: '3494'
quality_controlled: 0
status: public
title: Bilayer segmentation of live video
type: conference
volume: 1
year: '2006'
...