PlayStation wants to predict player movements. Sony is working on a new solution.

Sony has patented frame generation technology that predicts player actions based on controller data and pre-renders images to reduce latency.

Sony has patented a frame generation technology for PlayStation that will predict player actions based on controller data and pre-render images to reduce latency.

Unlike existing Frame Generation systems, Sony's technology analyzes not only already rendered frames but also controller input, attempting to anticipate the player's next actions.

Modern frame generation inserts artificial images between frames processed by the graphics card. This increases fluidity but can increase input lag. Sony proposes an approach similar to network rollback in online games: for example, by recognizing the intention to jump, the system will pre-render the corresponding animation frames.

The patent also describes a mechanism for reducing visual artifacts in case of erroneous prediction. The technology is tentatively called Frame Generation Super Sampling and uses an encoder to analyze the image and a decoder to create a synthetic frame before normal rendering is complete.

For now, this is just a patent: Sony has not announced whether the technology will appear in PlayStation consoles and what hardware requirements it imposes. Erroneous predictions in dynamic games can worsen gameplay, so testing will play a crucial role.