Apple Vision Pro, the most exciting product launched at this year’s WWDC event, has taken the internet by storm. This new product from the tech giant has unlocked some never-seen-before possibilities. With Vision Pro, you can see, hear, and interact with digital content in a way that feels natural and immersive. You can use it to play games, watch movies, create art, and more. Interestingly, the company describes it as the most advanced device ever and claims it filed 5,000 patents to make it all happen. Read: Apple Vision Pro vs Meta Quest 3
In this article, we will look into some of the hidden features that were overlooked by many, which will surely blow your mind.
Double Chip
The chip, designed specifically for the mixed reality headset, is tasked with running all the sensors embedded into the headset to create precise head and hand tracking, along with real-time 3D mapping and eye-tracking. With a total of 12 cameras, 5 sensors, 6 microphones (including a lidar sensor), this super-speedy sensor processes data within 12 milliseconds, or one wing-flap of the hummingbird or eight times faster than the blink of an eye.
The combination of an M2 chip to pack a ton of computing power and an R1 chip to deal with inputs --executes the actions with any lag and reduces the possibility of motion sickness, nausea or disorientation. Apart from the R1 chip, the M2 chip, built on the second-generation 5nm architecture, offers an 18% increase in CPU performance compared to the previous M1 processor. The Vision Pro's operating system software, called VisionOS, runs on the same M2 processor that Apple uses in its Macs.
Despite using the same 5nm node as the M1, the M2 chip packs 20 billion transistors, 4 billion more than its predecessor, resulting in improved performance without the need for more cores.
Overall, the M2 chip provides a more powerful performance than the M1 but falls short of the high-end capabilities needed for tasks like 3D modelling and advanced video editing.
Display
The Apple Vision Pro utilises micro-OLED technology to deliver its display capabilities. Apple claims that each eye's display packs more than a 4K resolution and a total of 23 million pixels. In another interesting update, Apple introduced the Mac Virtual Display feature, allowing users to wirelessly bring their Mac content into the Vision Pro headset.
Face recognition
Vision Pro headset also showcased the innovative Persona feature, which relies on machine learning (ML). The built-in cameras scan the user's face, creating a lifelike digital doppelgänger. During video calls, the digital twin replaces the user, mimicking their expressions and gestures in real time. FaceTime, Teams, Webex and Zoom will support these 3D avatars.
This is like nothing seen before.
To better show the user’s face when using the headset, it includes an exterior display, on an OLED screen on the exterior that shows the user's eyes. The EyeSight system allows users to either obscure or reveal their digital eyes to others in the room, indicating their readiness for face-to-face conversation.
Optic ID
Optic ID, Apple's third biometric system apart from face and fingerprint recognition, was introduced specifically for the Vision Pro headset. It will be used for unlocking the device and for features like Apple Pay within the headset's interface.
It works by analysing a user's iris through LED light exposure and comparing it with an enrolled Optic ID stored on the device's Secure Enclave. According to Apple's VP of technology development group, Mike Rockwell, the system can detect iris differences, even among identical twins.
Custom lenses
Apple's VR/AR headset can now be customised with prescription lenses, thanks to easy installation using magnetic lens holders. The slim design of the headset is impressive, but its compact size may pose a challenge for those who wear glasses. However, Apple has found a solution. To ensure that all users can have a clear view in these applications, Apple has partnered with Zeiss to create optical inserts tailored to individual vision.
Unlike other VR headsets, there is no need to replace lenses. The Zeiss lenses can simply be placed over the Apple Vision Pro lenses using a magnetic holder, which automatically snaps them into place. While there is no information yet on pricing or whether the lenses will be available directly with the Apple Vision Pro, they will be sold separately.
Lastly, Privacy
As with all Apple security features, Optic ID is claimed to remain solely on the device and the information is fully encrypted. Optic ID is just one of the privacy protections implemented in the Vision Pro headset. Eye tracking data will not be accessible by Apple or any other party, and camera and sensor data will be processed at the system level to prevent unauthorised access. Visual indicators will also be present when capturing photos and videos to respect the privacy of those around the user.
Your reaction
Discussion
What's your take on this story?
No comments yet — be the first to share your view.