Kann KI gesprochene Mandarin in die amerikanische Gebärdensprache in Echtzeit übersetzen ?

Gebärdensprachübersetzung war lange Zeit eine Herausforderung aufgrund der visuellen und gestischen Natur von ASL im Vergleich zu gesprochener Sprache. Aktuelle KI-Systeme kombinieren nun Computer Vision mit generativen Modellen, um diese Lücke zu schließen. Die Integration von Motion-Capture und Sprachmodellen ermöglicht dynamische Übersetzungen zwischen verschiedenen Modalitäten. Diese Fähigkeit verändert die Zugänglichkeit für Gehörlosencommunities in Live-Situationen.

Background

Sign language translation has long been a challenge due to the visual and gestural nature of ASL versus spoken language. Recent AI systems now pair computer vision with generative models to bridge this gap. The integration of motion capture and language models allows for dynamic translation between modalities. This capability is transforming accessibility for Deaf communities in live settings.

Currently, there are various technologies and research projects focused on developing systems that can translate spoken languages into sign languages in real-time. However, translating spoken Mandarin into American Sign Language (ASL) in real-time is a complex task due to the distinct grammatical structures and vocabularies of these two languages. Several studies have explored the use of machine learning and computer vision to recognize and interpret sign language, as well as speech recognition technologies to process spoken Mandarin. These systems often involve a combination of automatic speech recognition, machine translation, and sign language generation using avatars or robots. While significant progress has been made, real-time translation systems that can accurately and reliably translate spoken Mandarin into ASL are still in the early stages of development.

Researchers continue to work on improving the accuracy and speed of these systems, as well as addressing the challenges of capturing the nuances and contextual information of both spoken and sign languages. Despite these challenges, advancements in this area have the potential to greatly improve communication between Mandarin speakers and ASL users. The development of such technologies requires collaboration between experts in linguistics, computer science, and engineering.

+- administered May 13, 2026 · Source: IEEE — National Institute on Deafness and Other Communication Disorders