Wanke,Jörn ; Ulges, Adrian ; Lampert, ChristophIST Austria ; Breuel,Thomas M
Most state-of-the-art systems for content-based video understanding tasks require video content to be represented as collections of many low-level descriptors, e.g. as histograms of the color, texture or motion in local image regions. In order to preserve as much of the information contained in the original video as possible, these representations are typically high-dimensional, which conflicts with the aim for compact descriptors that would allow better efficiency and lower storage requirements. In this paper, we address the problem of semantic com- pression of video, i.e. the reduction of low-level descriptors to a small number of dimensions while preserving most of the semantic information. For this, we adapt topic models – which have previously been used as compact representations of still images – to take into account the temporal structure of a video, as well as multi-modal components such as motion information. Experiments on a large-scale collection of YouTube videos show that we can achieve a compression ratio of 20 : 1 compared to ordinary histogram representations and at least 2 : 1 compared to other dimensionality reduction techniques without significant loss of prediction accuracy. Also, improvements are demonstrated for our video-specific extensions modeling temporal structure and multiple modalities.
275 - 284
MIR: Multimedia Information Retrieval
Wanke J, Ulges A, Lampert C, Breuel T. Topic models for semantic video compression. In: ACM; 2010:275-284. doi:10.1145/1743384.1743433
Wanke, J., Ulges, A., Lampert, C., & Breuel, T. (2010). Topic models for semantic video compression (pp. 275–284). Presented at the MIR: Multimedia Information Retrieval, ACM. https://doi.org/10.1145/1743384.1743433
Wanke, Jörn, Adrian Ulges, Christoph Lampert, and Thomas Breuel. “Topic Models for Semantic Video Compression,” 275–84. ACM, 2010. https://doi.org/10.1145/1743384.1743433.
J. Wanke, A. Ulges, C. Lampert, and T. Breuel, “Topic models for semantic video compression,” presented at the MIR: Multimedia Information Retrieval, 2010, pp. 275–284.
Wanke J, Ulges A, Lampert C, Breuel T. 2010. Topic models for semantic video compression. MIR: Multimedia Information Retrieval 275–284.
Wanke, Jörn, et al. Topic Models for Semantic Video Compression. ACM, 2010, pp. 275–84, doi:10.1145/1743384.1743433.
Link(s) to Main File(s)