VNU-UET Repository

A feature-word-topic model for image annotation and retrieval

Nguyen, Cam Tu and Kaothanthong, Natsuda and Tokuyama, Takeshi and Phan, Xuan Hieu (2013) A feature-word-topic model for image annotation and retrieval. ACM Transactions on the Web, 7 (3). pp. 1-24. ISSN 1559-1131

Full text not available from this repository.


Image annotation is a process of finding appropriate semantic labels for images in order to obtain a more convenient way for indexing and searching images on the Web. This article proposes a novel method for image annotation based on combining feature-word distributions, which map from visual space to word space, and word-topic distributions, which form a structure to capture label relationships for annotation. We refer to this type of model as Feature-Word-Topic models. The introduction of topics allows us to efficiently take word associations, such as {ocean, fish, coral} or {desert, sand, cactus}, into account for image annotation. Unlike previous topic-based methods, we do not consider topics as joint distributions of words and visual features, but as distributions of words only. Feature-word distributions are utilized to define weights in computation of topic distributions for annotation. By doing so, topic models in text mining can be applied directly in our method. Our Feature-word-topic model, which exploits Gaussian Mixtures for feature-word distributions, and probabilistic Latent Semantic Analysis (pLSA) for word-topic distributions, shows that our method is able to obtain promising results in image annotation and retrieval.

Item Type: Article
Subjects: Information Technology (IT)
ISI-indexed journals
Divisions: Faculty of Information Technology (FIT)
Depositing User: A/Prof. Xuan Hieu Phan
Date Deposited: 14 Nov 2016 02:39
Last Modified: 14 Nov 2016 02:39

Actions (login required)

View Item View Item