Bilayer segmentation of live video

A. Criminisi, G. Cross, A. Blake, V. Kolmogorov, in:, IEEE, 2006, pp. 53–60.

Download
No fulltext has been uploaded. References only!

Conference Paper | Published
Author
; ; ;
Abstract
This paper presents an algorithm capable of real-time separation of foreground from background in monocular video sequences. Automatic segmentation of layers from colour/contrast or from motion alone is known to be error-prone. Here motion, colour and contrast cues are probabilistically fused together with spatial and temporal priors to infer layers accurately and efficiently. Central to our algorithm is the fact that pixel velocities are not needed, thus removing the need for optical flow estimation, with its tendency to error and computational expense. Instead, an efficient motion vs non-motion classifier is trained to operate directly and jointly on intensity-change and contrast. Its output is then fused with colour information. The prior on segmentation is represented by a second order, temporal, Hidden Markov Model, together with a spatial MRF favouring coherence except where contrast is high. Finally, accurate layer segmentation and explicit occlusion detection are efficiently achieved by binary graph cut. The segmentation accuracy of the proposed algorithm is quantitatively evaluated with respect to existing ground-truth data and found to be comparable to the accuracy of a state of the art stereo segmentation algorithm. Fore-ground/background segmentation is demonstrated in the application of live background substitution and shown to generate convincingly good quality composite video.
Publishing Year
Date Published
2006-07-05
Volume
1
Page
53 - 60
Conference
CVPR: Computer Vision and Pattern Recognition
IST-REx-ID

Cite this

Criminisi A, Cross G, Blake A, Kolmogorov V. Bilayer segmentation of live video. In: Vol 1. IEEE; 2006:53-60. doi:10.1109/CVPR.2006.69
Criminisi, A., Cross, G., Blake, A., & Kolmogorov, V. (2006). Bilayer segmentation of live video (Vol. 1, pp. 53–60). Presented at the CVPR: Computer Vision and Pattern Recognition, IEEE. https://doi.org/10.1109/CVPR.2006.69
Criminisi, Antonio, Geoffrey Cross, Andrew Blake, and Vladimir Kolmogorov. “Bilayer Segmentation of Live Video,” 1:53–60. IEEE, 2006. https://doi.org/10.1109/CVPR.2006.69.
A. Criminisi, G. Cross, A. Blake, and V. Kolmogorov, “Bilayer segmentation of live video,” presented at the CVPR: Computer Vision and Pattern Recognition, 2006, vol. 1, pp. 53–60.
Criminisi A, Cross G, Blake A, Kolmogorov V. 2006. Bilayer segmentation of live video. CVPR: Computer Vision and Pattern Recognition vol. 1. 53–60.
Criminisi, Antonio, et al. Bilayer Segmentation of Live Video. Vol. 1, IEEE, 2006, pp. 53–60, doi:10.1109/CVPR.2006.69.

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar