Towards a data model for the universal corpus

Steven Abney; Steven Bird

Towards a data model for the universal corpus

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper published in Proceedings › peer-review

Abstract

We describe the design of a comparable corpus that spans all of the world’s languages and facilitates large-scale cross-linguistic processing. This Universal Corpus consists of text collections aligned at the document and sentence level, multilingual wordlists, and a small set of morphological, lexical, and syntactic annotations. The design encompasses submission, storage, and access. Submission preserves the integrity of the work, allows asynchronous updates, and facilitates scholarly citation. Storage employs a cloud-hosted filestore containing normalized source data together with a database of texts and annotations. Access is permitted to the filestore, the database, and an application programming interface. All aspects of the Universal Corpus
are open, and we invite community participation in its design and implementation, and in supplying and using its data.

Original language	English
Title of host publication	Proceedings of the 4th workshop on building and using comparable corpora
Subtitle of host publication	Comparable corpora and the web
Pages	120-127
Number of pages	8
Publication status	Published - 2011
Externally published	Yes
Event	49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, ACL-HLT 2011 - Portland, OR, United States Duration: 19 Jun 2011 → 24 Jun 2011

Conference

Conference	49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, ACL-HLT 2011
Country/Territory	United States
City	Portland, OR
Period	19/06/11 → 24/06/11

Access to Document

Cite this

@inproceedings{87d2f8c3a60a4acf962560ff5dfa3b76,

title = "Towards a data model for the universal corpus",

abstract = "We describe the design of a comparable corpus that spans all of the world{\textquoteright}s languages and facilitates large-scale cross-linguistic processing. This Universal Corpus consists of text collections aligned at the document and sentence level, multilingual wordlists, and a small set of morphological, lexical, and syntactic annotations. The design encompasses submission, storage, and access. Submission preserves the integrity of the work, allows asynchronous updates, and facilitates scholarly citation. Storage employs a cloud-hosted filestore containing normalized source data together with a database of texts and annotations. Access is permitted to the filestore, the database, and an application programming interface. All aspects of the Universal Corpusare open, and we invite community participation in its design and implementation, and in supplying and using its data.",

author = "Steven Abney and Steven Bird",

year = "2011",

language = "English",

pages = "120--127",

booktitle = "Proceedings of the 4th workshop on building and using comparable corpora",

note = "49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, ACL-HLT 2011 ; Conference date: 19-06-2011 Through 24-06-2011",

}

Abney, S & Bird, S 2011, Towards a data model for the universal corpus. in Proceedings of the 4th workshop on building and using comparable corpora: Comparable corpora and the web. pp. 120-127, 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, ACL-HLT 2011, Portland, OR, United States, 19/06/11. <https://www.aclweb.org/anthology/W11-1216>

TY - GEN

T1 - Towards a data model for the universal corpus

AU - Abney, Steven

AU - Bird, Steven

PY - 2011

Y1 - 2011

N2 - We describe the design of a comparable corpus that spans all of the world’s languages and facilitates large-scale cross-linguistic processing. This Universal Corpus consists of text collections aligned at the document and sentence level, multilingual wordlists, and a small set of morphological, lexical, and syntactic annotations. The design encompasses submission, storage, and access. Submission preserves the integrity of the work, allows asynchronous updates, and facilitates scholarly citation. Storage employs a cloud-hosted filestore containing normalized source data together with a database of texts and annotations. Access is permitted to the filestore, the database, and an application programming interface. All aspects of the Universal Corpusare open, and we invite community participation in its design and implementation, and in supplying and using its data.

AB - We describe the design of a comparable corpus that spans all of the world’s languages and facilitates large-scale cross-linguistic processing. This Universal Corpus consists of text collections aligned at the document and sentence level, multilingual wordlists, and a small set of morphological, lexical, and syntactic annotations. The design encompasses submission, storage, and access. Submission preserves the integrity of the work, allows asynchronous updates, and facilitates scholarly citation. Storage employs a cloud-hosted filestore containing normalized source data together with a database of texts and annotations. Access is permitted to the filestore, the database, and an application programming interface. All aspects of the Universal Corpusare open, and we invite community participation in its design and implementation, and in supplying and using its data.

M3 - Conference Paper published in Proceedings

SP - 120

EP - 127

BT - Proceedings of the 4th workshop on building and using comparable corpora

T2 - 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, ACL-HLT 2011

Y2 - 19 June 2011 through 24 June 2011

ER -

Towards a data model for the universal corpus

Abstract

Conference

Access to Document

Fingerprint

Cite this