Skip to main content

Apple’s Vision Pro could get this incredible gaming upgrade

Apple has touted its Vision Pro headset as a premier gaming device that works with many different controllers. But with extensive gesture control seemingly used everywhere on the product except for gaming, it feels like a missed opportunity.

Well, that could change in the future, as a newly published Apple patent (number 11709554) shows how future editions of the Vision Pro could transform your hands into gaming controllers, complete with fingertip controls and haptic feedback.

A person plays a game on the Apple Vision Pro.
Apple

That would be enabled through what Apple somewhat blandly labels “finger devices.” These would consist of a small housing that wraps around each finger, with various sensors packed inside to detect your digit movements.

The sensors could work out when your fingers are tapping together, for example. Apple says its finger devices might also be able to determine how hard you’re pressing or moving your fingers thanks to embedded force sensors.

That’s interesting, you might be thinking, but doesn’t the Vision Pro already detect your finger movements thanks to its outward-facing cameras? Why would you need these little finger devices in the first place?

Well, the really interesting part of the patent concerns haptic feedback. According to Apple, its finger devices could be outfitted with a system that can tap or otherwise interact with your fingers in order to give the sensation of touching a real object in virtual reality.

Haptic output, the patent explains, may be used “to provide the fingers of a user with a desired texture sensation as a user is touching a real object or as a user is touching a virtual object.” In other words, future Vision Pro headsets might be able to convince you that you’re holding or feeling something that isn’t really there.

More immersive gaming

A man plays NBA 2K23 with a DualSense controller.
Apple

The implications of this kind of haptic gaming could be incredible. Not only would you get a deeply immersive visual experience, but also a convincing tactile experience too. That could potentially take your engagement with a game to a new level.

Right now, gaming on the Vision Pro usually involves a controller. That doesn’t put you in the game in the same way a set of haptic hand controllers would — instead of pressing a button to swing a sword, for example, you could actually perform the gesture yourself and have the finger devices map out the weighty feeling of the sword haft in your hand.

All that said, this is just a patent, so it’s possible Apple will never put it into action. But if you’re a fan of virtual reality gaming and want to see what could come next for the Reality Pro, there may be exciting times ahead.

Editors' Recommendations

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
iMac 27-inch: Everything we know about Apple’s larger, more powerful iMac
Apple iMac Pro News

When Apple killed off the iMac Pro and then completely removed the 27-inch iMac from its online store, we thought that was the end of the road for the larger all-in-one computer. Right now, Apple only sells one size of iMac: the smaller 24-inch version. But what about that gaping hole in the iMac lineup previously occupied by the 27-inch model?

It could be that Apple decides to leave this device dead and buried and instead hopes that the Mac Studio and Studio Display scratch that itch -- that's certainly what sources at 9to5Mac have contended. But there are tantalizing clues that Apple is considering offering a larger iMac with a greater level of performance than the 24-inch iMac. Regardless of whether this is branded an iMac Pro or an iMac, here's everything we know about the next high-end all-in-one from Apple.
Price and release date

Read more
The Vision Pro SDK has arrived. Here’s what it’s revealed so far
The UI of Apple's Vision Pro headset.

We've already learned quite a bit about the Vision Pro since Apple's WWDC event, but many details are still unknown.

Now that the software developers kit (SDK) is available, coders are digging in and uncovering more about Apple's first mixed-reality headset. Here are some of the best finds so far.
Limited VR range

Read more
The Apple Vision Pro has given VR its iPhone moment
A person is watching a movie using the Apple Vision Pro.

"One more thing" means you're about to be treated to something groundbreaking -- and that's exactly what happened when Apple CEO Tim Cook uttered those fateful three words at the end of the recent Worldwide Developers Conference 2023 keynote. The Apple Vision Pro is not just another VR headset; no, it's an incredible piece of technology that pushes the boundaries of what we can expect from both virtual reality and augmented reality. The display tech, sensor quality, and polish are like nothing we've ever seen before in a headset — and they signal a big jump forward in VR and AR tech.

The only quibble is the price: $3,500. That's a whole lot of cash, and due to that, I'm not confident the Vision Pro will appear in every other house in the next few years.

Read more