Topic models for semantic video compression

J. Wanke, A. Ulges, C. Lampert, T. Breuel, in:, ACM, 2010, pp. 275–284.

Download
No fulltext has been uploaded. References only!

Conference Paper | Published
Author
Wanke,Jörn; Ulges, Adrian; Lampert, ChristophIST Austria ; Breuel,Thomas M
Abstract
Most state-of-the-art systems for content-based video understanding tasks require video content to be represented as collections of many low-level descriptors, e.g. as histograms of the color, texture or motion in local image regions. In order to preserve as much of the information contained in the original video as possible, these representations are typically high-dimensional, which conflicts with the aim for compact descriptors that would allow better efficiency and lower storage requirements. In this paper, we address the problem of semantic com- pression of video, i.e. the reduction of low-level descriptors to a small number of dimensions while preserving most of the semantic information. For this, we adapt topic models – which have previously been used as compact representations of still images – to take into account the temporal structure of a video, as well as multi-modal components such as motion information. Experiments on a large-scale collection of YouTube videos show that we can achieve a compression ratio of 20 : 1 compared to ordinary histogram representations and at least 2 : 1 compared to other dimensionality reduction techniques without significant loss of prediction accuracy. Also, improvements are demonstrated for our video-specific extensions modeling temporal structure and multiple modalities.
Publishing Year
Date Published
2010-03-31
Page
275 - 284
Conference
MIR: Multimedia Information Retrieval
IST-REx-ID

Cite this

Wanke J, Ulges A, Lampert C, Breuel T. Topic models for semantic video compression. In: ACM; 2010:275-284. doi:10.1145/1743384.1743433
Wanke, J., Ulges, A., Lampert, C., & Breuel, T. (2010). Topic models for semantic video compression (pp. 275–284). Presented at the MIR: Multimedia Information Retrieval, ACM. https://doi.org/10.1145/1743384.1743433
Wanke, Jörn, Adrian Ulges, Christoph Lampert, and Thomas Breuel. “Topic Models for Semantic Video Compression,” 275–84. ACM, 2010. https://doi.org/10.1145/1743384.1743433.
J. Wanke, A. Ulges, C. Lampert, and T. Breuel, “Topic models for semantic video compression,” presented at the MIR: Multimedia Information Retrieval, 2010, pp. 275–284.
Wanke J, Ulges A, Lampert C, Breuel T. 2010. Topic models for semantic video compression. MIR: Multimedia Information Retrieval 275–284.
Wanke, Jörn, et al. Topic Models for Semantic Video Compression. ACM, 2010, pp. 275–84, doi:10.1145/1743384.1743433.

Link(s) to Main File(s)
Access Level
Restricted Closed Access

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar