At the Meta Connect 2024 keynote, not only did Mark Zuckerberg debut actual Augmented Reality with holographic displays and neural control, it did so in a device that’s smaller, lighter, and one could argue, more socially acceptable (aka stylish) than Apple’s Vision Pro. Dubbed the Orion, it’s simply a developer prototype for now, but Meta hopes to refine the design, improve the displays, and actually sell it at an affordable price to consumers.

Designer: Meta

Orion is not a bulky headset—it’s a sleek, spectacle-like device that weighs under 100 grams, making it comfortable for extended use. This is an impressive feat considering the amount of technology packed into such a small form factor. While Meta Quest Pro and Apple’s Vision Pro are capable of mixed reality, Orion’s fully transparent, holographic display takes things to a different level. Instead of the passthrough experiences that blend digital elements on top of a live camera feed, Orion projects 3D objects directly into the real world using innovative waveguide technology. The frames are made from magnesium, a super-light metal known for its strength and ability to dissipate heat (something even NASA’s relied on for its space hardware).

The core of this magic is a set of tiny projectors embedded within the arms of the glasses. These projectors beam light into lenses that have nanoscale 3D structures, creating stunningly sharp holographic displays. Zuckerberg emphasized that you could go about your day—whether you’re working in a coffee shop or flying on a plane—while interacting with immersive AR elements like a cinema-sized virtual screen or multiple work monitors.

But it’s not just about visuals. The glasses also facilitate natural social interaction: you can maintain eye contact with others through the transparent lenses, and digital elements seamlessly overlay onto the real world. Need to send a message? Instead of fumbling for your phone, a hologram will appear before your eyes, letting you reply with a quick, subtle gesture. This fluid integration of the digital and physical worlds could set Orion apart from its competitors.

When it comes to control, the Orion glasses offer several interaction modes—voice, hand, and eye tracking—but the star of the show is the neural wristband. In contrast to the Vision Pro, which relies on hand gestures, eye-tracking, and voice commands, Orion takes the next step by reading neural signals from your wrist to control the device. This neural interface allows for discreet control. Imagine being in a meeting or walking down the street—gesturing in mid-air or speaking aloud commands isn’t always convenient. The wristband can pick up subtle electrical signals from your brain and translate them into actions, like tapping your fingers to summon a holographic card game or message a friend. This introduces a new level of human-computer interaction, far more intimate and nuanced than what’s currently available on the market.

While Apple’s Vision Pro and Meta’s previous Quest Pro have been praised for their intuitive interaction systems, Orion’s neural control represents a massive leap forward. It reduces the friction of interacting with digital elements by cutting down on the physical and vocal gestures required, creating a more seamless experience.

One of the key differentiators for Orion is its display technology. Unlike the Vision Pro or Meta Quest Pro, which rely on cameras to pass a live feed of the outside world onto a screen, Orion offers true augmented reality. The glasses project digital holograms directly into your field of view, blending with your surroundings. This isn’t just a camera feed of your environment with digital elements superimposed—it’s real-world AR with transparent lenses that you can see through as you would normal glasses. The holograms are bright enough to stand out even in varied lighting conditions and sharp enough to allow users to perceive fine details in their digital overlays.

Zuckerberg illustrated this with examples: receiving a message as a floating hologram or “teleporting” a distant friend’s avatar into your living room. The display architecture is entirely new, made possible by custom silicon chips and sensors integrated into the glasses, offering a level of immersion that’s more subtle yet more profound than the pass-through systems we’ve seen so far. In a private demo, he even played a metaverse version of Pong with key industry experts like Nvidia CEO Jensen Huang, and investors like Gary Vaynerchuck and Daymond John of Shark Tank.

For all its innovation, Orion is still in the development phase. Zuckerberg was candid that Orion is not yet ready for consumers. Instead, it will serve as a development kit for Meta’s internal teams and a select group of external partners. This will help refine both the hardware and software, as well as grow the ecosystem of apps and experiences that will make Orion valuable when it eventually hits the consumer market. There’s also the matter of affordability—Zuckerberg mentioned the team is working to improve manufacturing processes to bring the cost down. As it stands, this isn’t a device you’ll see in stores next week, but it’s a crucial step in realizing Meta’s vision for the future of AR.

The potential for Orion is vast. Zuckerberg envisions it as the next major computing platform, capable of reshaping how we work, play, and interact with others. By leveraging the power of true augmented reality with a groundbreaking neural interface, Orion positions itself as more than just a wearable gadget—it’s an entirely new way of interfacing with the digital and physical worlds. For now, it’s an exciting glimpse into what the future might hold. The Orion glasses may not be in your hands today, but their arrival could redefine the entire AR landscape in the years to come.

The post Meta’s futuristic Orion AR Glasses have Holographic Displays and Neural Control. Apple should take notes first appeared on Yanko Design.