Weakly-Supervised Segmentation and Unsupervised Modeling of Natural Images

A. Kolesnikov, Weakly-Supervised Segmentation and Unsupervised Modeling of Natural Images, IST Austria, 2018.

Download
OA 12.92 MB

Thesis | Published | English
Department
Series Title
IST Austria Thesis
Abstract
Modern computer vision systems heavily rely on statistical machine learning models, which typically require large amounts of labeled data to be learned reliably. Moreover, very recently computer vision research widely adopted techniques for representation learning, which further increase the demand for labeled data. However, for many important practical problems there is relatively small amount of labeled data available, so it is problematic to leverage full potential of the representation learning methods. One way to overcome this obstacle is to invest substantial resources into producing large labelled datasets. Unfortunately, this can be prohibitively expensive in practice. In this thesis we focus on the alternative way of tackling the aforementioned issue. We concentrate on methods, which make use of weakly-labeled or even unlabeled data. Specifically, the first half of the thesis is dedicated to the semantic image segmentation task. We develop a technique, which achieves competitive segmentation performance and only requires annotations in a form of global image-level labels instead of dense segmentation masks. Subsequently, we present a new methodology, which further improves segmentation performance by leveraging tiny additional feedback from a human annotator. By using our methods practitioners can greatly reduce the amount of data annotation effort, which is required to learn modern image segmentation models. In the second half of the thesis we focus on methods for learning from unlabeled visual data. We study a family of autoregressive models for modeling structure of natural images and discuss potential applications of these models. Moreover, we conduct in-depth study of one of these applications, where we develop the state-of-the-art model for the probabilistic image colorization task.
Publishing Year
Date Published
2018-05-25
Acknowledgement
I also gratefully acknowledge the support of NVIDIA Corporation with the donation of the GPUs used for this research.
Page
113
IST-REx-ID

Cite this

Kolesnikov A. Weakly-Supervised Segmentation and Unsupervised Modeling of Natural Images. IST Austria; 2018. doi:10.15479/AT:ISTA:th_1021
Kolesnikov, A. (2018). Weakly-Supervised Segmentation and Unsupervised Modeling of Natural Images. IST Austria. https://doi.org/10.15479/AT:ISTA:th_1021
Kolesnikov, Alexander. Weakly-Supervised Segmentation and Unsupervised Modeling of Natural Images. IST Austria, 2018. https://doi.org/10.15479/AT:ISTA:th_1021.
A. Kolesnikov, Weakly-Supervised Segmentation and Unsupervised Modeling of Natural Images. IST Austria, 2018.
Kolesnikov A. 2018. Weakly-Supervised Segmentation and Unsupervised Modeling of Natural Images, IST Austria, 113p.
Kolesnikov, Alexander. Weakly-Supervised Segmentation and Unsupervised Modeling of Natural Images. IST Austria, 2018, doi:10.15479/AT:ISTA:th_1021.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2018-12-12T10:14:57Z

Source File
Access Level
Restricted Closed Access
Last Uploaded
2019-08-13T12:33:39Z

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar