SignFind: A Synchronized Sign Language and Chinese Character Teaching Game for Chinese Deaf Children Using Gesture Recognition

This paper presents a targeted system to help Chinese deaf children learn both sign language and Chinese characters in early language learning. The system combines sign recognition and in-air writing techniques with games so that children can practice sign language and Chinese character writing at the same time. Sign recognition is used to assess the accuracy of sign language and in-air writing records the process of writing Chinese characters. In addition, the game adds to the learning fun and makes children more willing to complete learning tasks. We have developed a prototype to evaluate the effectiveness of a simultaneous Chinese sign language and Chinese character teaching system based on gesture recognition and in-air writing. We expect that this system will increase children's willingness and efficiency to learn sign language and Chinese characters, and eventually be used to assist in early language education for deaf children in the Chinese region.

Zhao, YijunZhejiang University, China (författare)
Yao, BingZhejiang University, China (författare)
Xu, ZhengZhejiang University, China (författare)
Chen, JiayanZhejiang University, China (författare)
Yu, ChangchaoZhejiang University, China (författare)
Hansen, PrebenStockholms universitet,Institutionen för data- och systemvetenskap(Swepub:su)prha5887 (författare)
Liu, JianhuiZhejiang University, China (författare)
Wang, JiadiZhejiang University, China (författare)
Yan, GeZhejiang University, China (författare)
Yao, ChengZhejiang University, China (författare)
Zhou, LeijingZhejiang University, China (författare)
Ying, FangtianZhejiang University, China (författare)
Liang, XiuboZhejiang University, China (författare)
Wang, GuanyunZhejiang University, China (författare)
Zhejiang University, ChinaInstitutionen för data- och systemvetenskap (creator_code:org_t)

Ingår i:CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing SystemsNew York, NY, USA : Association for Computing Machinery (ACM), s. 1-79781450391566

Av författaren/redakt...: Nie, Jintao; Zhao, Yijun; Yao, Bing; Xu, Zheng; Chen, Jiayan; Yu, Changchao; visa fler...; Hansen, Preben; Liu, Jianhui; Wang, Jiadi; Yan, Ge; Yao, Cheng; Zhou, Leijing; Ying, Fangtian; Liang, Xiubo; Wang, Guanyun; visa färre...

Om ämnet

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...; och Människa datorin ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.