Poate AI să traducă vorbirea mandarină în limbajul american al semnelor în timp real ?

Traducerea limbajului semnelor a reprezentat întotdeauna o provocare datorită naturii vizuale și gestuale a ASL în comparație cu limbile vorbite. Sistemele recente de inteligență artificială combină acum viziunea computerizată cu modele generative pentru a depăși această barieră. Integrarea captării mișcărilor și a modelelor lingvistice permite traducerea dinamică între modalități. Această capacitate transformă accesibilitatea pentru comunitățile surde în contexte live.

Background

Sign language translation has long been a challenge due to the visual and gestural nature of ASL versus spoken language. Recent AI systems now pair computer vision with generative models to bridge this gap. The integration of motion capture and language models allows for dynamic translation between modalities. This capability is transforming accessibility for Deaf communities in live settings.

Currently, there are various technologies and research projects focused on developing systems that can translate spoken languages into sign languages in real-time. However, translating spoken Mandarin into American Sign Language (ASL) in real-time is a complex task due to the distinct grammatical structures and vocabularies of these two languages. Several studies have explored the use of machine learning and computer vision to recognize and interpret sign language, as well as speech recognition technologies to process spoken Mandarin. These systems often involve a combination of automatic speech recognition, machine translation, and sign language generation using avatars or robots. While significant progress has been made, real-time translation systems that can accurately and reliably translate spoken Mandarin into ASL are still in the early stages of development.

Researchers continue to work on improving the accuracy and speed of these systems, as well as addressing the challenges of capturing the nuances and contextual information of both spoken and sign languages. Despite these challenges, advancements in this area have the potential to greatly improve communication between Mandarin speakers and ASL users. The development of such technologies requires collaboration between experts in linguistics, computer science, and engineering.

+- administered May 13, 2026 · Source: IEEE — National Institute on Deafness and Other Communication Disorders