Apple really went to town on the new iPhone 12 Pro‘s camera tech this year, but perhaps the most intriguing feature is a new photo format called Apple ProRaw.
Coming to the iPhone 12 Pro and iPhone 12 Pro Max “later this year”, it’s promising to offer photographers the dream combo of computational photography’s smarts and the flexibility of raw editing.
But what exactly does that mean, and how will it work in practice? Here’s what we learned from Apple’s Senior Manager of Camera Software Engineering about Apple ProRaw, and how it could take iPhone photo editing to the next level.
Before we jump into the details of how Apple ProRaw will work, it’s worth rewinding, and asking why we have different photography formats at all. After all, don’t they just cause confusion and compatibility migraines?
They certainly can, as anyone who’s experienced frustrations with HEIF, the JPEG alternative that Apple adopted for the iPhone 11, will attest. But having choices with image formats can also be very helpful, in the same way that it’s nice to choose between driving an automatic or manual car.
You’ve probably already heard of the raw photo format. This sits towards the ‘pro’ end of the photo format spectrum, because these files are almost completely unprocessed. The downside is their size and complexity, but the considerable benefit is the amount of editing freedom they give you.
With a raw photo, you can completely change the photo’s white balance, exposure, tones and color after the fact, and without degrading the image quality. In this sense, they’re the opposite of JPEG and HEIF files, which are the ready-processed, microwave meals of photo formats. They’re fast and convenient, but also discard important photographic goodness that you can no longer recover after you’ve hit the shutter.
So where does Apple ProRaw fit into all of this? In short, it’s here to offer people who’ve previously been put off by raw a simpler, halfway house between the two options – or, as Apple naturally put it, “the best of both worlds”. And the reason why Apple needs a new format is because until now cameras simply haven’t taken photos in the same way as phones like the iPhone 12 Pro.
Manual without the labor
The problem that Apple ProRaw is trying to solve is that, on the latest iPhones, the raw format hasn’t really fully satisfied either beginner or pro photographers. This is probably why Apple has never included a raw mode in its default Camera app, instead leaving third-party apps to offer it instead.
For beginners, shooting in raw can sometimes be unsatisfying, because the results often look underwhelming compared to a processed shot. And, until now, shooting in raw has also meant keen photographers have missed out on some of the clever multi-frame processing from Apple’s Deep Fusion tech.
Sure, they could happily tweak the exposure and tones of a raw photo to get a great result, but what if the starting point could be images that benefit from all the smart processing offered by today’s computational photography? With several frames already smartly merged and with noise reduction applied, it would be like getting an instant helping hand from a pro editor, while retaining the malleability of raw files.
This is where Apple ProRaw fits in. As Alok Deshpande, Apple’s Senior Manager of Camera Software Engineering, explained, ProRaw “provides many of the benefits of our multi-frame image processing and computational photography, like Deep Fusion and Smart HDR, and combines them with the depth and flexibility of a raw format”.
He then went into a little more detail about how this is done, adding: “In order to achieve this, we constructed a new pipeline that takes components of the processing we do in our CPU, GPU, ISP and neural engine, and combines them into a new deep image file, computed at the time of capture, without any shutter delay. And we do this for all four cameras, dynamically adapting for various scenes while maintaining our intuitive camera experience.”
That final comment is really the key to what could make ProRaw a popular new format, at least among iPhone 12 users. Rather than baffling you with a grid of sliders and confusing terms like ‘vibrance’, ProRaw editing will take place directly in the Photos app. But it won’t only live there.
Apple said that ProRaw editing will be available in “other professional photo editing apps” and that it’s also creating an API for third-party apps to capture in Apple ProRaw. There are still quite a few unknowns, such as the file sizes ProRaw might produce, but it seems likely that Apple’s approach in the Photos app will be characteristically user-friendly.
The raw killer?
In this sense, then, Apple ProRaw won’t be a raw format killer, more just another handy tool in the mobile photographer’s growing arsenal. Many experienced shooters will still prefer standard raw, because it gives you an editing ‘blank’ canvas to work with; in other words, no artistic decisions have been made for you.
The simplicity of compressed formats like JPEG will continue to remain popular, too. These are universal file formats that don’t take up much storage space, and can be viewed and shared anywhere. Like raw, ProRaw files will likely need to be processed before they can shared directly to places like social media, which some might see as too much hassle.
But we’re also looking forward to dabbling with ProRaw editing to see if it really does boost our mobile photo-editing workflows in the way Apple promises. Perhaps the only downside to Apple ProRaw is how few devices will support it – Apple didn’t say whether or not the format would be coming to other iPhones, and we suspect it won’t.
Still, while adoption will certainly be slow to start with, you can expect to see Apple ProRaw take off as more iPhone photographers start to see the benefits appear in their Instagram feeds later this year.