Hot topics

Apple May Copy Vision Pro's Hand Tracking Tech to Apple TV and iPad

Screenshot 2023 06 05 at 20.37.03
© Apple

Read in other languages:

Apple's Vision Pro headset heavily relies on hand tracking for controls and interactions from users. This function allows for a more immersive experience compared to other headsets that use dedicated controllers. Today, it appears the Cupertino company is planning to expand in-air hand gestures to its other devices like on Apple TV box or MacBook more than its AR/VR glasses.

Presently, the Apple Vision Pro enables eye and hand tracking through a set of cameras and sensors. These are paired with sophisticated software algorithms to allow controller-free input. In the latest patent filing of Apple (via Patently Apple), it indicates that the company will combine several devices to mimic a similar virtual experience to its Vision OS.

Do midair gestures to control an Apple TV or MacBook

One of the illustrations included specifically shows that a user wearing an Apple Watch creates in-air hand gestures which read and detect by an Apple TV equipped with cameras and sensors. Furthermore, it is likely that the smartwatch carries extra components to cater for the different orientation and position of the hand. Subsequently, all interactions on the UI are then projected on a TV or monitor.

Apple shows how Vision Pro's hand tracking features is going to work on Apple TV, iPad, and MacBook
Apple shows how Vision Pro's hand tracking features are going to work on Apple TV, iPad, and MacBook. / © Patently Apple

As with other applications, there are countless ways how hand tracking will be useful aside from the basic controls. For example, a user would be able to draw objects or compose a message in midair and without the aid of another external accessory for input.

Apart from the Apple Watch and Apple TV, it was also noted in the application that this technology is workable on a MacBook laptop and Mac desktop. It is even possible that an Apple iPad tablet will be utilized as a display and tracker given it already comes with cameras and sensors.

The idea of the patent seems very feasible if to be based on the current technologies available. Hence, we could predict that the idea of Apple would likely materialize in real-world applications in the coming years. Likewise, do you think this concept is practical and useful? 

  Editor's choice Best smart home control center Best price-performance ratio Best sound Best sound supplement Best display
Product image Amazon Echo Dot (5. Gen) 2022 Product Image Amazon Echo Hub Product Image Amazon Echo (4.Gen) Product Image Amazon Echo Studio Product Image Amazon Echo Sub Product Image Amazon Echo Show 10 (3rd. Gen) Product Image
Review: Amazon Echo Dot (5. Gen) 2022
Review: Amazon Echo Hub
Not yet tested
Review: Amazon Echo Studio
Not yet tested
Not yet tested
Price Compariosn
Go to comment (0)
Jade Bryan

Jade Bryan
Junior Editor

I still remember how amazed I was when I first got hold of the Nokia 3210 back when I was a kid, and it was during that time I developed my love for technology, particularly for mobile phones. I started sharing my knowledge through writing in different blogs and forums back in Nokia Nseries era. I even make videos before where I put different phones side-by-side. Today, I'm still an avid enthusiast of smartphones, but my interests have evolved into smart devices and electric vehicles.

To the author profile
Liked this article? Share now!
Recommended articles
Latest articles
Push notification Next article
No comments
Write new comment:
All changes will be saved. No drafts are saved when editing
Write new comment:
All changes will be saved. No drafts are saved when editing