Details

Autor(en) / Beteiligte

• Xu, Ming
• Raytchev, Bisser
• Sakaue, Katsuhiko
• Hasegawa, Osamu
• Koizumi, Atsuko
• Takeuchi, Masaru
• Sagawa, Hirohiko
• Gao, Wen
• Tan, Tieniu
• Shi, Yuanchun

Titel

A Vision-Based Method for Recognizing Non-manual Information in Japanese Sign Language

Ist Teil von

• Advances in Multimodal Interfaces — ICMI 2000, 2000, p.572-581

Ort / Verlag

Berlin, Heidelberg: Springer Berlin Heidelberg

Erscheinungsjahr

2000

Quelle

Alma/SFX Local Collection

Beschreibungen/Notizen

• This paper describes a vision-based method for recognizing the non- manual information in Japanese Sign Language (JSL). This new modality information provides grammatical constraints useful for JSL word segmentation and interpretation. Our attention is focused on head motion, the most dominant non-manual information in JSL. We designed an interactive color-modeling scheme for robust face detection. Two video cameras are vertically arranged to take the frontal and profile image of the JSL user, and head motions are classified into eleven patterns. Moment-based feature and statistical motion feature are adopted to represent these motion patterns. Classification of the motion features is performed with linear discrimant analysis method. Initial experimental results show that the method has good recognition rate and can be realized in real-time.