How the Oppo Reno 5 Pro will use AI for better video recording Oppo Reno 5 Pro

The Oppo Reno 5 Pro is set to launch later this month on January 18. Since camera features are a focus point for the new smartphone, they gave us a preview of the new shooting modes that will debut on it before the unveiling. The key talking point will be Full Dimension Fusion portrait video system — a new way to shoot videos across scenarios high-end hardware and innovative software.

Oppo started the workshop by talking about the future of smartphone photography and how “hardware can guarantee the lower limits of image quality, but the upper limits can only be reached through the innovation of advanced algorithms.” Since imagery has no real upper limit, the next wave of advancements will be driven by software as hardware is nearing a point of saturation. 

(Image credit: Oppo India)

FDF is a set of complex actions that work in parallel to achieve better video quality and portrait effects. This is done to ensure that the shots are not held back by the inherent shooting limitations, overriding the exposure triangle in some ways. 

The first step revolves around improving the quality of the image, especially in less than ideal conditions such as low light or high shake. Toggling ‘AI Highlight video’ on will activate Ultra Night video and Live HDR simultaneously to achieve better brightness, colour and clarity in the video. 

(Image credit: Oppo India)

Simply enhancing brightness is not enough.

Instead of increasing the entire frame’s exposure, it uses adaptive gain to raise the shadows in some parts while keeping the highlights from clipping or overexposing for an evenly exposed image. Similarly, an adaptive dynamic range filter is applied to fuse multiple HDR frames to expose the subject as well as the background correctly. These adjustments are applied to each frame individually to account for any changes. Since the phone understands what scene is being shot, it can make more accurate tweaks based on the subject.

(Image credit: Oppo India)

Lastly, to take care of the digital grain that might get introduced, the Oppo Reno 5 Pro will run two rounds of noise reduction. On a temporal level, multiple frames at 5ms intervals will be synthesized together along with movement data from the auxiliary sensor to reduce noise at a pixel level as well as take care of ghosting and shakes. Then, the image goes through spatial noise reduction where parts at different frequency levels are dealt with separately — stronger noise reduction in low-frequency areas (such as the sky) and texture retention in the higher frequencies (such as the subject/person/buildings) where the details need to be preserved.