Authors
Sandrine Tornay, Necati Cihan Camgoz, Richard Bowden, Mathew Magimai Doss
Publication date
2020/10/25
Book
Companion Publication of the 2020 International Conference on Multimodal Interaction
Pages
102-106
Description
Interactive learning platforms are in the top choices to acquire new languages. Such applications or platforms are more easily available for spoken languages, but rarely for sign languages. Assessment of the production of signs is a challenging problem because of the multichannel aspect (e.g., hand shape, hand movement, mouthing, facial expression) inherent in sign languages. In this paper, we propose an automatic sign language production assessment approach which allows assessment of two linguistic aspects: (i) the produced lexeme and (ii) the produced forms. On a linguistically annotated Swiss German Sign Language dataset, SMILE DSGS corpus, we demonstrate that the proposed approach can effectively assess the two linguistic aspects in an integrated manner.
Total citations
20212022202320241123
Scholar articles
S Tornay, NC Camgoz, R Bowden, M Magimai Doss - Companion Publication of the 2020 International …, 2020