Social tag relevance estimation via ranking-oriented neighbour voting

Chaoran Cui, Jialie Shen, Jun Ma, Tao Lian

Research output: Chapter in Book/Report/Conference proceedingConference Paper published in ProceedingsResearchpeer-review

Abstract

User-generated tags associated with social images are frequently imprecise and incomplete. Therefore, a fundamental challenge in tag-based applications is the problem of tag relevance estimation, which concerns how to interpret and quantify the relevance of a tag with respect to the contents of an image. In this paper, we address the key problem from a new perspective of learning to rank, and develop a novel approach to facilitate tag relevance estimation to directly optimize the ranking performance of tag-based image search. A supervision step is introduced into the neighbour voting scheme, in which tag relevance is estimated by accumulating votes from visual neighbours. Through explicitly modelling the neighbour weights and tag correlations, the risk of making heuristic assumptions is effectively avoided for conventional methods. Extensive experiments on a benchmark dataset in comparison with the state-of-The-Art methods demonstrate the promise of our approach.

Original languageEnglish
Title of host publicationMM 2015 - Proceedings of the 2015 ACM Multimedia Conference
Place of PublicationBrisbane, Australia
PublisherAssociation for Computing Machinery, Inc
Pages895-898
Number of pages4
ISBN (Electronic)9781450334594
DOIs
Publication statusPublished - 13 Oct 2015
Externally publishedYes
Event23rd ACM International Conference on Multimedia, MM 2015 - Brisbane, Australia
Duration: 26 Oct 201530 Oct 2015

Conference

Conference23rd ACM International Conference on Multimedia, MM 2015
CountryAustralia
CityBrisbane
Period26/10/1530/10/15

Fingerprint

Experiments

Cite this

Cui, C., Shen, J., Ma, J., & Lian, T. (2015). Social tag relevance estimation via ranking-oriented neighbour voting. In MM 2015 - Proceedings of the 2015 ACM Multimedia Conference (pp. 895-898). Brisbane, Australia: Association for Computing Machinery, Inc. https://doi.org/10.1145/2733373.2806358
Cui, Chaoran ; Shen, Jialie ; Ma, Jun ; Lian, Tao. / Social tag relevance estimation via ranking-oriented neighbour voting. MM 2015 - Proceedings of the 2015 ACM Multimedia Conference. Brisbane, Australia : Association for Computing Machinery, Inc, 2015. pp. 895-898
@inproceedings{a4d6daf1e7dd43e0ac3d2ab96be383c9,
title = "Social tag relevance estimation via ranking-oriented neighbour voting",
abstract = "User-generated tags associated with social images are frequently imprecise and incomplete. Therefore, a fundamental challenge in tag-based applications is the problem of tag relevance estimation, which concerns how to interpret and quantify the relevance of a tag with respect to the contents of an image. In this paper, we address the key problem from a new perspective of learning to rank, and develop a novel approach to facilitate tag relevance estimation to directly optimize the ranking performance of tag-based image search. A supervision step is introduced into the neighbour voting scheme, in which tag relevance is estimated by accumulating votes from visual neighbours. Through explicitly modelling the neighbour weights and tag correlations, the risk of making heuristic assumptions is effectively avoided for conventional methods. Extensive experiments on a benchmark dataset in comparison with the state-of-The-Art methods demonstrate the promise of our approach.",
keywords = "Learning to rank, Neighbour voting, Tag relevance estimation, Tag-based image search",
author = "Chaoran Cui and Jialie Shen and Jun Ma and Tao Lian",
year = "2015",
month = "10",
day = "13",
doi = "10.1145/2733373.2806358",
language = "English",
pages = "895--898",
booktitle = "MM 2015 - Proceedings of the 2015 ACM Multimedia Conference",
publisher = "Association for Computing Machinery, Inc",

}

Cui, C, Shen, J, Ma, J & Lian, T 2015, Social tag relevance estimation via ranking-oriented neighbour voting. in MM 2015 - Proceedings of the 2015 ACM Multimedia Conference. Association for Computing Machinery, Inc, Brisbane, Australia, pp. 895-898, 23rd ACM International Conference on Multimedia, MM 2015, Brisbane, Australia, 26/10/15. https://doi.org/10.1145/2733373.2806358

Social tag relevance estimation via ranking-oriented neighbour voting. / Cui, Chaoran; Shen, Jialie; Ma, Jun; Lian, Tao.

MM 2015 - Proceedings of the 2015 ACM Multimedia Conference. Brisbane, Australia : Association for Computing Machinery, Inc, 2015. p. 895-898.

Research output: Chapter in Book/Report/Conference proceedingConference Paper published in ProceedingsResearchpeer-review

TY - GEN

T1 - Social tag relevance estimation via ranking-oriented neighbour voting

AU - Cui, Chaoran

AU - Shen, Jialie

AU - Ma, Jun

AU - Lian, Tao

PY - 2015/10/13

Y1 - 2015/10/13

N2 - User-generated tags associated with social images are frequently imprecise and incomplete. Therefore, a fundamental challenge in tag-based applications is the problem of tag relevance estimation, which concerns how to interpret and quantify the relevance of a tag with respect to the contents of an image. In this paper, we address the key problem from a new perspective of learning to rank, and develop a novel approach to facilitate tag relevance estimation to directly optimize the ranking performance of tag-based image search. A supervision step is introduced into the neighbour voting scheme, in which tag relevance is estimated by accumulating votes from visual neighbours. Through explicitly modelling the neighbour weights and tag correlations, the risk of making heuristic assumptions is effectively avoided for conventional methods. Extensive experiments on a benchmark dataset in comparison with the state-of-The-Art methods demonstrate the promise of our approach.

AB - User-generated tags associated with social images are frequently imprecise and incomplete. Therefore, a fundamental challenge in tag-based applications is the problem of tag relevance estimation, which concerns how to interpret and quantify the relevance of a tag with respect to the contents of an image. In this paper, we address the key problem from a new perspective of learning to rank, and develop a novel approach to facilitate tag relevance estimation to directly optimize the ranking performance of tag-based image search. A supervision step is introduced into the neighbour voting scheme, in which tag relevance is estimated by accumulating votes from visual neighbours. Through explicitly modelling the neighbour weights and tag correlations, the risk of making heuristic assumptions is effectively avoided for conventional methods. Extensive experiments on a benchmark dataset in comparison with the state-of-The-Art methods demonstrate the promise of our approach.

KW - Learning to rank

KW - Neighbour voting

KW - Tag relevance estimation

KW - Tag-based image search

UR - http://www.scopus.com/inward/record.url?scp=84962821192&partnerID=8YFLogxK

U2 - 10.1145/2733373.2806358

DO - 10.1145/2733373.2806358

M3 - Conference Paper published in Proceedings

SP - 895

EP - 898

BT - MM 2015 - Proceedings of the 2015 ACM Multimedia Conference

PB - Association for Computing Machinery, Inc

CY - Brisbane, Australia

ER -

Cui C, Shen J, Ma J, Lian T. Social tag relevance estimation via ranking-oriented neighbour voting. In MM 2015 - Proceedings of the 2015 ACM Multimedia Conference. Brisbane, Australia: Association for Computing Machinery, Inc. 2015. p. 895-898 https://doi.org/10.1145/2733373.2806358