Image-Gesture-Voice: A Web Component for Eliciting Speech

Mat Bettinson; Steven Bird

Image-Gesture-Voice: A Web Component for Eliciting Speech

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper published in Proceedings › peer-review

101 Downloads (Pure)

Abstract

We describe a reusable Web component for capturing talk about images. A speaker is prompted with a series of images and talks about each one while adding gestures. Others can watch the audio-visual slideshow, and navigate forwards and backwards by swiping on the images. The component supports phrase-aligned respeaking, translation, and commentary. This work extends the method of Basic Oral Language Documentation by prompting speakers with images and capturing their gestures. We show how the component is deployed ina mobile app for collecting and sharing know-how which was developed in consultation with indigenous groups in Taiwan and Australia. We focus on food preparation practices since this is an area where people are motivated to preserve and disseminate their cultural and linguistic heritage.

Original language	English
Title of host publication	LREC 2018 Workshop
Subtitle of host publication	CCURL2018: Sustaining Knowledge Diversity in the Digital Age
Editors	Claudia Soria, Laurent Besacier, Laurette Pretorius
Place of Publication	Japan
Publisher	European Language Resources Association (ELRA)
Pages	1-8
Number of pages	8
Volume	1
ISBN (Print)	979-10-95546-22-1
Publication status	Published - 12 May 2018
Event	11th International Conference on Language Resources and Evaluation, LREC 2018 - Miyazaki, Japan Duration: 7 May 2018 → 12 May 2018

Conference

Conference	11th International Conference on Language Resources and Evaluation, LREC 2018
Country/Territory	Japan
City	Miyazaki
Period	7/05/18 → 12/05/18

Access to Document

23708547-oaFinal published version, 933 KBLicence: CC BY-NC

http://lrec-conf.org/workshops/lrec2018/W26/pdf/book_of_proceedings.pdf#page=11Licence: CC BY-NC

Cite this

@inproceedings{ac571c04ca244f73bee557554342d9e6,

title = "Image-Gesture-Voice: A Web Component for Eliciting Speech",

abstract = "We describe a reusable Web component for capturing talk about images. A speaker is prompted with a series of images and talks about each one while adding gestures. Others can watch the audio-visual slideshow, and navigate forwards and backwards by swiping on the images. The component supports phrase-aligned respeaking, translation, and commentary. This work extends the method of Basic Oral Language Documentation by prompting speakers with images and capturing their gestures. We show how the component is deployed ina mobile app for collecting and sharing know-how which was developed in consultation with indigenous groups in Taiwan and Australia. We focus on food preparation practices since this is an area where people are motivated to preserve and disseminate their cultural and linguistic heritage.",

author = "Mat Bettinson and Steven Bird",

year = "2018",

month = may,

day = "12",

language = "English",

isbn = "979-10-95546-22-1",

volume = "1",

pages = "1--8",

editor = "Claudia Soria and Laurent Besacier and Laurette Pretorius",

booktitle = "LREC 2018 Workshop",

publisher = "European Language Resources Association (ELRA)",

note = "11th International Conference on Language Resources and Evaluation, LREC 2018 ; Conference date: 07-05-2018 Through 12-05-2018",

}

Bettinson, M & Bird, S 2018, Image-Gesture-Voice: A Web Component for Eliciting Speech. in C Soria, L Besacier & L Pretorius (eds), LREC 2018 Workshop: CCURL2018: Sustaining Knowledge Diversity in the Digital Age. vol. 1, European Language Resources Association (ELRA), Japan, pp. 1-8, 11th International Conference on Language Resources and Evaluation, LREC 2018, Miyazaki, Japan, 7/05/18. <http://lrec-conf.org/workshops/lrec2018/W26/pdf/book_of_proceedings.pdf#page=11>

Image-Gesture-Voice: A Web Component for Eliciting Speech. / Bettinson, Mat; Bird, Steven.
LREC 2018 Workshop: CCURL2018: Sustaining Knowledge Diversity in the Digital Age. ed. / Claudia Soria; Laurent Besacier; Laurette Pretorius. Vol. 1 Japan: European Language Resources Association (ELRA), 2018. p. 1-8.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper published in Proceedings › peer-review

TY - GEN

T1 - Image-Gesture-Voice

T2 - 11th International Conference on Language Resources and Evaluation, LREC 2018

AU - Bettinson, Mat

AU - Bird, Steven

PY - 2018/5/12

Y1 - 2018/5/12

N2 - We describe a reusable Web component for capturing talk about images. A speaker is prompted with a series of images and talks about each one while adding gestures. Others can watch the audio-visual slideshow, and navigate forwards and backwards by swiping on the images. The component supports phrase-aligned respeaking, translation, and commentary. This work extends the method of Basic Oral Language Documentation by prompting speakers with images and capturing their gestures. We show how the component is deployed ina mobile app for collecting and sharing know-how which was developed in consultation with indigenous groups in Taiwan and Australia. We focus on food preparation practices since this is an area where people are motivated to preserve and disseminate their cultural and linguistic heritage.

AB - We describe a reusable Web component for capturing talk about images. A speaker is prompted with a series of images and talks about each one while adding gestures. Others can watch the audio-visual slideshow, and navigate forwards and backwards by swiping on the images. The component supports phrase-aligned respeaking, translation, and commentary. This work extends the method of Basic Oral Language Documentation by prompting speakers with images and capturing their gestures. We show how the component is deployed ina mobile app for collecting and sharing know-how which was developed in consultation with indigenous groups in Taiwan and Australia. We focus on food preparation practices since this is an area where people are motivated to preserve and disseminate their cultural and linguistic heritage.

UR - http://www.ilc.cnr.it/ccurl2018/index.htm

UR - http://www.lrec-conf.org/proceedings/lrec2018/index.html

M3 - Conference Paper published in Proceedings

SN - 979-10-95546-22-1

VL - 1

SP - 1

EP - 8

BT - LREC 2018 Workshop

A2 - Soria, Claudia

A2 - Besacier, Laurent

A2 - Pretorius, Laurette

PB - European Language Resources Association (ELRA)

CY - Japan

Y2 - 7 May 2018 through 12 May 2018

ER -

Image-Gesture-Voice: A Web Component for Eliciting Speech

Abstract

Conference

Access to Document

Other files and links

Fingerprint

Cite this