The patent, which was first spotted by Gaming Intel, describes an AI-powered system that adapts background music to game scenarios and a player’s activity. The feature maps emotions such as tension, joy, and fear to musical components including rhythm, melodic structure, and harmonic density, based on published reviews and social media opinions. This data will train algorithms to play sounds that trigger the desired feelings. According to the patent, composers would first create musical motifs for characters, activities, areas, and even player personalities: The algorithms would then adjust the motifs to the gamer’s style of play, the time of day, state of the game, and the hours that they’ve been playing. [Read: Nvidia teaches AI to create new version of Pac-Man just by watching gameplay] It’s not entirely clear how this will work in practice. But the filing suggests that the music’s tempo could be increased if the player’s moving quickly, and then reduced when they’re less active.
Patents offer hints for future gaming
While the filing makes no specific mention of the PS5, its timing suggests that feature could be used in the console. It joins a growing list of gaming-related patents recently filed by Sony. Others include a controller sensor that measures sweat and heart rates to understand how a player’s feeling and a companion robot that reacts to their emotions. The new patent suggests that some of these could be combined with the music generator: The wackier ideas are less likely to get the green light, but the filings show that Sony sees a big future for real-time personalization in gaming.
