Horror-movie cue inspires wearable that turns robot movements into warning music

Georgia Tech researchers developed Spherephones, an open-ear wearable intended to make human-robot work safer by converting nearby robot motion into spatialized, computer-generated lo-fi music. The project was created by Amit Rogel in Gil Weinberg’s Robotic Musicianship Group at the Center for Music Technology. It responds to a factory-floor concern: robots may move before people notice them, while ordinary alarms can be ignored and often fail to communicate what is approaching, from where, or how soon.

The headset places four speakers around each ear: in front, behind, above, and below. The lower speaker enables sound to be located beneath the listener, an effect unavailable in most headphones. As a robot nears, a melody begins, allowing a wearer to anticipate its arrival, including when it will hand over an object. The system is designed to let music remain in the background and vary in intensity or position without requiring workers to stop or look.

Early workplace tests found that participants continued assembling, sorting, and concentrating while the audio changed around them. Earlier workspace-mounted speakers delivered all cues to all workers, but the wearable was designed to provide each worker audio only for robots within reach. Researchers say the music can communicate direction and whether an approaching object is dangerous.

The team also tested Spherephones in virtual reality. Users followed a flying bird, then reacted physically when a sound came from behind without a visual object. The researchers are examining uses beyond industrial safety, including gaming, navigation for people without sight, and support for veterans coping with PTSD. In games, the system could add above, behind, and below to conventional left-right audio while preserving awareness of the surrounding environment.