Fast query for large treebanks

Sumukh Ghodke; Steven Bird

Fast query for large treebanks

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper published in Proceedings › peer-review

Abstract

A variety of query systems have been developed for interrogating parsed corpora, or tree-banks. With the arrival of efficient, wide-coverage parsers, it is feasible to create very large databases of trees. However, existing approaches that use in-memory search, or relational or XML database technologies, do not scale up. We describe a method for storage, indexing, and query of treebanks that uses an information retrieval engine. Several experiments with a large treebank demonstrate excellent scaling characteristics for a wide range of query types. This work facilitates the curation of much larger treebanks, and enables them to be used effectively in a variety of scientific and engineering tasks.

Original language	English
Title of host publication	NAACL HLT 2010 - Human Language Technologies
Subtitle of host publication	The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference
Pages	267-275
Number of pages	9
Publication status	Published - 1 Dec 2010
Event	2010 Human Language Technologies Conference ofthe North American Chapter of the Association for Computational Linguistics, NAACL HLT 2010 - Los Angeles, CA, United States Duration: 2 Jun 2010 → 4 Jun 2010

Publication series

Name	NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference

Conference

Conference	2010 Human Language Technologies Conference ofthe North American Chapter of the Association for Computational Linguistics, NAACL HLT 2010
Country/Territory	United States
City	Los Angeles, CA
Period	2/06/10 → 4/06/10

Access to Document

https://www.aclweb.org/anthology/N10-1034/Licence: Other
https://www.aclweb.org/anthology/N10-1034.pdfLicence: Other

Cite this

Ghodke, S., & Bird, S. (2010). Fast query for large treebanks. In NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference (pp. 267-275). (NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference). https://www.aclweb.org/anthology/N10-1034/

Ghodke, Sumukh ; Bird, Steven. / Fast query for large treebanks. NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference. 2010. pp. 267-275 (NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference).

@inproceedings{a0a3f55bff88454395b4999df89c7054,

title = "Fast query for large treebanks",

abstract = "A variety of query systems have been developed for interrogating parsed corpora, or tree-banks. With the arrival of efficient, wide-coverage parsers, it is feasible to create very large databases of trees. However, existing approaches that use in-memory search, or relational or XML database technologies, do not scale up. We describe a method for storage, indexing, and query of treebanks that uses an information retrieval engine. Several experiments with a large treebank demonstrate excellent scaling characteristics for a wide range of query types. This work facilitates the curation of much larger treebanks, and enables them to be used effectively in a variety of scientific and engineering tasks.",

author = "Sumukh Ghodke and Steven Bird",

year = "2010",

month = dec,

day = "1",

language = "English",

isbn = "1932432655",

series = "NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference",

pages = "267--275",

booktitle = "NAACL HLT 2010 - Human Language Technologies",

note = "2010 Human Language Technologies Conference ofthe North American Chapter of the Association for Computational Linguistics, NAACL HLT 2010 ; Conference date: 02-06-2010 Through 04-06-2010",

}

Ghodke, S & Bird, S 2010, Fast query for large treebanks. in NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference. NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference, pp. 267-275, 2010 Human Language Technologies Conference ofthe North American Chapter of the Association for Computational Linguistics, NAACL HLT 2010, Los Angeles, CA, United States, 2/06/10. <https://www.aclweb.org/anthology/N10-1034/>

Fast query for large treebanks. / Ghodke, Sumukh; Bird, Steven.
NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference. 2010. p. 267-275 (NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper published in Proceedings › peer-review

TY - GEN

T1 - Fast query for large treebanks

AU - Ghodke, Sumukh

AU - Bird, Steven

PY - 2010/12/1

Y1 - 2010/12/1

N2 - A variety of query systems have been developed for interrogating parsed corpora, or tree-banks. With the arrival of efficient, wide-coverage parsers, it is feasible to create very large databases of trees. However, existing approaches that use in-memory search, or relational or XML database technologies, do not scale up. We describe a method for storage, indexing, and query of treebanks that uses an information retrieval engine. Several experiments with a large treebank demonstrate excellent scaling characteristics for a wide range of query types. This work facilitates the curation of much larger treebanks, and enables them to be used effectively in a variety of scientific and engineering tasks.

AB - A variety of query systems have been developed for interrogating parsed corpora, or tree-banks. With the arrival of efficient, wide-coverage parsers, it is feasible to create very large databases of trees. However, existing approaches that use in-memory search, or relational or XML database technologies, do not scale up. We describe a method for storage, indexing, and query of treebanks that uses an information retrieval engine. Several experiments with a large treebank demonstrate excellent scaling characteristics for a wide range of query types. This work facilitates the curation of much larger treebanks, and enables them to be used effectively in a variety of scientific and engineering tasks.

UR - http://www.scopus.com/inward/record.url?scp=80053274769&partnerID=8YFLogxK

M3 - Conference Paper published in Proceedings

AN - SCOPUS:80053274769

SN - 1932432655

SN - 9781932432657

T3 - NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference

SP - 267

EP - 275

BT - NAACL HLT 2010 - Human Language Technologies

T2 - 2010 Human Language Technologies Conference ofthe North American Chapter of the Association for Computational Linguistics, NAACL HLT 2010

Y2 - 2 June 2010 through 4 June 2010

ER -

Ghodke S, Bird S. Fast query for large treebanks. In NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference. 2010. p. 267-275. (NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference).

Fast query for large treebanks

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this