Building a large scale test collection for effective benchmarking of mobile landmark search

Zhiyong Cheng; Jing Ren; Jialie Shen; Haiyan Miao

doi:10.1007/978-3-642-35728-2_4

Building a large scale test collection for effective benchmarking of mobile landmark search

Zhiyong Cheng, Jing Ren, Jialie Shen, Haiyan Miao

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper published in Proceedings

Abstract

Studying and analyzing system performance is one of the fundamental factors for the related technological advancement in image retrieval. In this paper, we report the construction of a large scale test collection for facilitating robust performance evaluation of mobile landmark image search. Totally, the test collection consists of (1) 355,141 images about 128 landmarks in five cities over 3 continents from Flickr; (2) different kinds of textual features for each image, including surrounding text (e.g. tags), contextual data (e.g. geo-location and upload time), and metadata (e.g. uploader and EXIF); and (3) six types of low-level visual features. For the task of landmark image retrieval evaluation, we also conduct a series of baseline experimental studies on the search performance over different visual queries, which represent different views of a landmark.

Original language	English
Title of host publication	Advances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings
Pages	36-46
Number of pages	11
Volume	7733 LNCS
Edition	PART 2
DOIs	https://doi.org/10.1007/978-3-642-35728-2_4
Publication status	Published - 2013
Externally published	Yes
Event	19th International Conference on Advances in Multimedia Modeling, MMM 2013 - Huangshan, China Duration: 7 Jan 2013 → 9 Jan 2013

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 2
Volume	7733 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	19th International Conference on Advances in Multimedia Modeling, MMM 2013
Country	China
City	Huangshan
Period	7/01/13 → 9/01/13

Access to Document

10.1007/978-3-642-35728-2_4

Link to publication in Scopus

Fingerprint Dive into the research topics of 'Building a large scale test collection for effective benchmarking of mobile landmark search'. Together they form a unique fingerprint.

Cite this

Cheng, Z., Ren, J., Shen, J., & Miao, H. (2013). Building a large scale test collection for effective benchmarking of mobile landmark search. In Advances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings (PART 2 ed., Vol. 7733 LNCS, pp. 36-46). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7733 LNCS, No. PART 2). https://doi.org/10.1007/978-3-642-35728-2_4

Cheng, Zhiyong ; Ren, Jing ; Shen, Jialie ; Miao, Haiyan. / Building a large scale test collection for effective benchmarking of mobile landmark search. Advances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings. Vol. 7733 LNCS PART 2. ed. 2013. pp. 36-46 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2).

@inproceedings{e982ef577285418e8902dcfc8f20c391,

title = "Building a large scale test collection for effective benchmarking of mobile landmark search",

abstract = "Studying and analyzing system performance is one of the fundamental factors for the related technological advancement in image retrieval. In this paper, we report the construction of a large scale test collection for facilitating robust performance evaluation of mobile landmark image search. Totally, the test collection consists of (1) 355,141 images about 128 landmarks in five cities over 3 continents from Flickr; (2) different kinds of textual features for each image, including surrounding text (e.g. tags), contextual data (e.g. geo-location and upload time), and metadata (e.g. uploader and EXIF); and (3) six types of low-level visual features. For the task of landmark image retrieval evaluation, we also conduct a series of baseline experimental studies on the search performance over different visual queries, which represent different views of a landmark.",

keywords = "Mobile landmark search, Performance evaluation",

author = "Zhiyong Cheng and Jing Ren and Jialie Shen and Haiyan Miao",

year = "2013",

doi = "10.1007/978-3-642-35728-2_4",

language = "English",

isbn = "9783642357275",

volume = "7733 LNCS",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 2",

pages = "36--46",

booktitle = "Advances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings",

edition = "PART 2",

note = "19th International Conference on Advances in Multimedia Modeling, MMM 2013 ; Conference date: 07-01-2013 Through 09-01-2013",

}

Cheng, Z, Ren, J, Shen, J & Miao, H 2013, Building a large scale test collection for effective benchmarking of mobile landmark search. in Advances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings. PART 2 edn, vol. 7733 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 2, vol. 7733 LNCS, pp. 36-46, 19th International Conference on Advances in Multimedia Modeling, MMM 2013, Huangshan, China, 7/01/13. https://doi.org/10.1007/978-3-642-35728-2_4

Building a large scale test collection for effective benchmarking of mobile landmark search. / Cheng, Zhiyong; Ren, Jing; Shen, Jialie; Miao, Haiyan.

Advances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings. Vol. 7733 LNCS PART 2. ed. 2013. p. 36-46 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7733 LNCS, No. PART 2).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper published in Proceedings

TY - GEN

T1 - Building a large scale test collection for effective benchmarking of mobile landmark search

AU - Cheng, Zhiyong

AU - Ren, Jing

AU - Shen, Jialie

AU - Miao, Haiyan

PY - 2013

Y1 - 2013

N2 - Studying and analyzing system performance is one of the fundamental factors for the related technological advancement in image retrieval. In this paper, we report the construction of a large scale test collection for facilitating robust performance evaluation of mobile landmark image search. Totally, the test collection consists of (1) 355,141 images about 128 landmarks in five cities over 3 continents from Flickr; (2) different kinds of textual features for each image, including surrounding text (e.g. tags), contextual data (e.g. geo-location and upload time), and metadata (e.g. uploader and EXIF); and (3) six types of low-level visual features. For the task of landmark image retrieval evaluation, we also conduct a series of baseline experimental studies on the search performance over different visual queries, which represent different views of a landmark.

AB - Studying and analyzing system performance is one of the fundamental factors for the related technological advancement in image retrieval. In this paper, we report the construction of a large scale test collection for facilitating robust performance evaluation of mobile landmark image search. Totally, the test collection consists of (1) 355,141 images about 128 landmarks in five cities over 3 continents from Flickr; (2) different kinds of textual features for each image, including surrounding text (e.g. tags), contextual data (e.g. geo-location and upload time), and metadata (e.g. uploader and EXIF); and (3) six types of low-level visual features. For the task of landmark image retrieval evaluation, we also conduct a series of baseline experimental studies on the search performance over different visual queries, which represent different views of a landmark.

KW - Mobile landmark search

KW - Performance evaluation

UR - http://www.scopus.com/inward/record.url?scp=84887498996&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-35728-2_4

DO - 10.1007/978-3-642-35728-2_4

M3 - Conference Paper published in Proceedings

AN - SCOPUS:84887498996

SN - 9783642357275

VL - 7733 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 36

EP - 46

BT - Advances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings

T2 - 19th International Conference on Advances in Multimedia Modeling, MMM 2013

Y2 - 7 January 2013 through 9 January 2013

ER -

Cheng Z, Ren J, Shen J, Miao H. Building a large scale test collection for effective benchmarking of mobile landmark search. In Advances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings. PART 2 ed. Vol. 7733 LNCS. 2013. p. 36-46. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2). https://doi.org/10.1007/978-3-642-35728-2_4