Hot topics

Apple may enable realistic 3D video streaming on its Reality Pro

NextPit HTC VR Glasses 09
© nextpit

Read in other languages:

Several of the purported features of Apple's Reality Pro extended reality headset have been uncovered recently. One of those mentioned includes an immersive or 3D realistic video which is touted as the core content of the device alongside gaming. A new patent awarded to the iPhone maker might hint at how this will be enabled.

Spotted by Patently Apple, the filing describes immersive video streaming through an Apple HMD (head-mounted device). The device can be in the form of a mixed reality headset, smart Apple glasses, wearable holographic display, or a combination of any of these such as an XR or extended reality headset.

Apple Reality Pro to enable 3D realistic video when watching a video

Although the patent sounds basic in regards to the current capabilities of AR/VR glasses like the Meta Quest Pro, the interesting part is the utilization of a viewport. As detailed in the documentation, the method or system projects only a select portion of the video content in an extensive surrounding (e.g. sphere) while overlaying it to the user's position and orientation including the movements of the head and eyes.

Furthermore, tracking the head or knowing the location of the user will match the viewport to the corresponding visual data. Specifically, changes in eyes or head's direction will be continuously translated in the virtual environment. But as noted, a user is capable of adjusting its viewport through physical controls as well.

Apple's 3D Spatial or Reality Video Streaming
Apple's immersive video streaming patent uses viewport / © Patently Apple

Perhaps the closest example of this is a beefed-up reality world or spatial video. Every change in your gaze or head's movement is reflected giving you the impression you're inside the movie or series you're watching comparable to a 360 spatial sound.

Eye-control through advanced eye-tracking technology

In addition to this realistic video streaming, Apple is also working to add advanced eye and head tracking to its headsets and glasses. The technology is said to allow the user to control virtual content through the gaze. However, all of these are not yet confirmed to ship with Apple's Reality Pro.

What are your thoughts on streaming your favorite movie or series in virtual reality using a wearable? Do you think it will be more immersive? Let us hear your thoughts. 

The best camera phones to buy in 2024

  Editor's Choice The Best Android Alternative The Best Camera iPhone The Best Camera Under $1,000 The Best Camera Under $600 The Best Camera Under $400 The Best Camera Foldable
Image Google Pixel 8 Pro Product Image Samsung Galaxy S23 Ultra Product Image Apple iPhone 15 Pro Max Product Image Google Pixel 8 Product Image Google Pixel 7 Product Image Google Pixel 6a Product Image OnePlus Open Product Image
Review: Google Pixel 8 Pro
Review: Samsung Galaxy S23 Ultra
Review: Apple iPhone 15 Pro Max
Review: Google Pixel 8
Review: Google Pixel 7
Review: Google Pixel 6a
Review: OnePlus Open
nextpit receives a commission for purchases made via the marked links. This has no influence on the editorial content and there are no costs for you. You can find out more about how we make money on our transparency page.
Go to comment (0)
Jade Bryan

Jade Bryan
Junior Editor

I still remember how amazed I was when I first got hold of the Nokia 3210 back when I was a kid, and it was during that time I developed my love for technology, particularly for mobile phones. I started sharing my knowledge through writing in different blogs and forums back in Nokia Nseries era. I even make videos before where I put different phones side-by-side. Today, I'm still an avid enthusiast of smartphones, but my interests have evolved into smart devices and electric vehicles.

View all articles
Liked this article? Share now!
Recommended articles
Latest articles
Push notification Next article
No comments
Write new comment:
All changes will be saved. No drafts are saved when editing
Write new comment:
All changes will be saved. No drafts are saved when editing