TY - GEN
T1 - Building a large scale test collection for effective benchmarking of mobile landmark search
AU - Cheng, Zhiyong
AU - Ren, Jing
AU - Shen, Jialie
AU - Miao, Haiyan
PY - 2013
Y1 - 2013
N2 - Studying and analyzing system performance is one of the fundamental factors for the related technological advancement in image retrieval. In this paper, we report the construction of a large scale test collection for facilitating robust performance evaluation of mobile landmark image search. Totally, the test collection consists of (1) 355,141 images about 128 landmarks in five cities over 3 continents from Flickr; (2) different kinds of textual features for each image, including surrounding text (e.g. tags), contextual data (e.g. geo-location and upload time), and metadata (e.g. uploader and EXIF); and (3) six types of low-level visual features. For the task of landmark image retrieval evaluation, we also conduct a series of baseline experimental studies on the search performance over different visual queries, which represent different views of a landmark.
AB - Studying and analyzing system performance is one of the fundamental factors for the related technological advancement in image retrieval. In this paper, we report the construction of a large scale test collection for facilitating robust performance evaluation of mobile landmark image search. Totally, the test collection consists of (1) 355,141 images about 128 landmarks in five cities over 3 continents from Flickr; (2) different kinds of textual features for each image, including surrounding text (e.g. tags), contextual data (e.g. geo-location and upload time), and metadata (e.g. uploader and EXIF); and (3) six types of low-level visual features. For the task of landmark image retrieval evaluation, we also conduct a series of baseline experimental studies on the search performance over different visual queries, which represent different views of a landmark.
KW - Mobile landmark search
KW - Performance evaluation
UR - http://www.scopus.com/inward/record.url?scp=84887498996&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-35728-2_4
DO - 10.1007/978-3-642-35728-2_4
M3 - Conference Paper published in Proceedings
AN - SCOPUS:84887498996
SN - 9783642357275
VL - 7733 LNCS
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 36
EP - 46
BT - Advances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings
T2 - 19th International Conference on Advances in Multimedia Modeling, MMM 2013
Y2 - 7 January 2013 through 9 January 2013
ER -