Hot topics

How Samsung uses AI to improve photos taken on the Galaxy S21

NextPit Samsung galaxy S21 Ultra hands on back
© nextpit

Read in other languages:

In our reviews, we made clear that the Galaxy S21 Ultra and the S21+ are capable of capturing excellent photos. While the camera sensors do play a part in this, modern photography is now also a lot about AI and image processing and that is exactly what Samsung reveals in a blog post that details how the AI-algorithm works on the new Samsung flagships.

  • Samsung reveals specific details about the AI post-processing of its photos
  • It involves the camera detecting faces and separating them from their surroundings before editing them
  • Blurred backgrounds in portraits are also more accurate and feature a sharpening gradient

It's always exciting to see what technology smartphone manufacturers use to improve the images on their latest smartphones. Samsung, in its blog post, details the magic it uses to improve portraits captured on its phones in fair detail.

Behind the Snapshot S21 AI main1
The software uses masks to separate faces and enhance fine details / © Samsung

First of all, it's all about making faces look natural and a little bit out of the subject at the same time. To do this, the software detects the two faces of the subjects and separates them from the rest of the image for post-processing. Samsung then uses "natural enhancements" to tweak things like the eyes, hair, face shape, and white balance to create natural faces. Here, Samsung basically takes the same approach as it does with manual digital photo editing, which also uses masks to tweak only certain areas of the image.

Precise portrait mode with sharpness gradient

Masks are also about blurring backgrounds. It's been a trend in camera smartphones for a few years now to mimic the depth of field of portrait lenses with a small open aperture, and in fact it worked very well in my review of the Galaxy S21+. For portraits, Samsung takes advantage of the depth information gained from the Time-of-Flight sensor on the S21 Ultra and the additional and slightly differently positioned cameras on the S21+.

As with the faces in the first example, Samsung's camera software creates a mask and then optimizes the transition between subject and background. By using a tri-mask consisting of background, subject and the area of transition, Samsung can also identify hair with greater accuracy and omit it when blurring.

Hauswand Portraet Galaxy S21 Plus
Even though Samsung messes up the bars on the left side of the image, the sharpness gradient is killer! / © NextPit

At the same time, the software segments subjects if they are at different distances from the camera. This explains the quite natural-looking sharpness gradient you can see in my test photo of the Galaxy S21.

Source: Samsung

The best Samsung Galaxy phones compared

  Best flagship Best all-rounder Best foldable Best compact foldable Best midrange model Best budget model
Device Samsung Galaxy Z Flip 5
Samsung Galaxy S23 Ultra
Samsung Galaxy S23
Samsung Galaxy Z Fold 5
Samsung Galaxy Z Flip 5
Samsung Galaxy A54
Samsung Galaxy A34
Samsung Galaxy S23 Ultra review
Samsung Galaxy S23 review
Samsung Galaxy Z Fold 5 review
Samsung Galaxy Z Flip 5 review
Samsung Galaxy A54 review
Samsung Galaxy A34 review
Check offer*
Go to comment (0)
Benjamin Lucks

Benjamin Lucks
Product Reviewer

Benjamin works as a freelance journalist and is always on the lookout for special features that make new cell phones, headphones and gadgets interesting for the reader. If he doesn't succeed, he comforts himself by writing short stories and using his digital camera.

To the author profile
Liked this article? Share now!
Recommended articles
Latest articles
Push notification Next article
No comments
Write new comment:
All changes will be saved. No drafts are saved when editing
Write new comment:
All changes will be saved. No drafts are saved when editing