¿Puede la IA traducir el mandarín hablado a la lengua de señas americana en tiempo real ?

La traducción de lenguaje de señas ha sido durante mucho tiempo un desafío debido a la naturaleza visual y gestual del ASL en comparación con el lenguaje hablado. Los sistemas de IA recientes ahora combinan visión por computadora con modelos generativos para salvar esta brecha. La integración de captura de movimiento y modelos de lenguaje permite la traducción dinámica entre modalidades. Esta capacidad está transformando la accesibilidad para las comunidades sordas en entornos en vivo.

Background

Sign language translation has long been a challenge due to the visual and gestural nature of ASL versus spoken language. Recent AI systems now pair computer vision with generative models to bridge this gap. The integration of motion capture and language models allows for dynamic translation between modalities. This capability is transforming accessibility for Deaf communities in live settings.

Currently, there are various technologies and research projects focused on developing systems that can translate spoken languages into sign languages in real-time. However, translating spoken Mandarin into American Sign Language (ASL) in real-time is a complex task due to the distinct grammatical structures and vocabularies of these two languages. Several studies have explored the use of machine learning and computer vision to recognize and interpret sign language, as well as speech recognition technologies to process spoken Mandarin. These systems often involve a combination of automatic speech recognition, machine translation, and sign language generation using avatars or robots. While significant progress has been made, real-time translation systems that can accurately and reliably translate spoken Mandarin into ASL are still in the early stages of development.

Researchers continue to work on improving the accuracy and speed of these systems, as well as addressing the challenges of capturing the nuances and contextual information of both spoken and sign languages. Despite these challenges, advancements in this area have the potential to greatly improve communication between Mandarin speakers and ASL users. The development of such technologies requires collaboration between experts in linguistics, computer science, and engineering.

+- administered May 13, 2026 · Source: IEEE — National Institute on Deafness and Other Communication Disorders