Steam Controller mod allows deaf players to "feel" sound through haptic feedback

Valve decided to use the controller's function to transmit sound

Recently, developer FamBoy32-dev introduced a modification for the Steam Controller that makes video games more accessible for people with hearing impairments. It proposes using the haptic feedback function to transmit audio (game sounds) in real time.

The developer explained that LiveHaptics captures system audio, processes it through a DSP chain for each channel (gain adjustment, bass, limiter), and transmits it as a haptic PCM signal to the controller's actuators (motors): "You will feel music, sounds from movies and games with both motors, in stereo mode, regardless of how the controller is connected." In theory, any sound output to the PC's audio device can trigger haptic feedback from the controller.

Developer FamBoy32-dev has published the source code for the "steam-controller-live-haptics" project on GitHub. The project is available not only to Windows users, but can also be used on Linux.

An example of the system's operation can be viewed at the following link. According to comments, some deaf players were interested in this. For example, ThatDeafDude explained that he "has residual hearing" but usually plays games without sound. Now he plans to try using the Steam Controller modification to better understand what is happening around him in the game.

FamBoy32-dev is studying feedback and releasing updates, for example, he recently implemented a new interface, and implemented the ability to select a device/capture source (sound) with real-time switching.