Tech4Gamer discovered that Sony has applied for a patent called “Sign Language Translation in Virtual Environments”, which aims to add real-time sign language translation tools to games to help disabled players enjoy the game. The patent discusses the situation on both the sending and receiving sides, first translating the sign language on one side into text, and then translating the text into sign language and presenting it on the receiving side’s screen.
Because sign language varies between languages, Sony says the system also includes “extremely important” real-time translation capabilities during conversations. “Sign language is not universal, which requires properly capturing the sign language of one user, understanding their native language, and generating new sign language as output in another user’s native language,” the patent reads.
Sony also pointed out that the system can distinguish between simple gestures and sign language to ensure that the user’s immersive experience is not affected. According to the company, this system can be applied to VR games, traditional games, and various other non-gaming applications. Obviously, this function is quite practical, but applying for a patent does not mean that the technology has been achieved or is even in the development stage. It will probably take a long time before it appears in Sony’s games.