L'IA può tradurre il mandarino parlato nella lingua dei segni americana in tempo reale ?

La traduzione della lingua dei segni è stata a lungo una sfida a causa della natura visiva e gestuale dell'ASL rispetto alle lingue parlate. Recenti sistemi di intelligenza artificiale ora abbinano la visione artificiale con modelli generativi per colmare questo divario. L'integrazione della motion capture e dei modelli linguistici consente la traduzione dinamica tra le modalità. Questa capacità sta trasformando l'accessibilità per le comunità sorde in contesti dal vivo.

Background

Sign language translation has long been a challenge due to the visual and gestural nature of ASL versus spoken language. Recent AI systems now pair computer vision with generative models to bridge this gap. The integration of motion capture and language models allows for dynamic translation between modalities. This capability is transforming accessibility for Deaf communities in live settings.

Currently, there are various technologies and research projects focused on developing systems that can translate spoken languages into sign languages in real-time. However, translating spoken Mandarin into American Sign Language (ASL) in real-time is a complex task due to the distinct grammatical structures and vocabularies of these two languages. Several studies have explored the use of machine learning and computer vision to recognize and interpret sign language, as well as speech recognition technologies to process spoken Mandarin. These systems often involve a combination of automatic speech recognition, machine translation, and sign language generation using avatars or robots. While significant progress has been made, real-time translation systems that can accurately and reliably translate spoken Mandarin into ASL are still in the early stages of development.

Researchers continue to work on improving the accuracy and speed of these systems, as well as addressing the challenges of capturing the nuances and contextual information of both spoken and sign languages. Despite these challenges, advancements in this area have the potential to greatly improve communication between Mandarin speakers and ASL users. The development of such technologies requires collaboration between experts in linguistics, computer science, and engineering.

+- administered May 13, 2026 · Source: IEEE — National Institute on Deafness and Other Communication Disorders