The nascent world of mixed reality is rapidly evolving, with Google and Samsung collaborating on Project Moohan, a venture aimed at delivering compelling experiences through a mixed reality headset and accompanying smart glasses. The headset, designed for both immersive and see-through experiences, offers a blend of virtual and real-world interaction. Users can seamlessly transition between focused immersion and environment awareness, ensuring practical functionality within a collaborative workspace. Bluetooth keyboard and mouse connectivity provides familiarity for productivity tasks, while the see-through mode addresses the social awkwardness often associated with wearing headsets in shared environments. A key feature, mirroring Apple Vision Pro’s functionality, is the potential integration with laptops, enabling users to extend their digital workspace into mixed reality.
Central to the Project Moohan experience is Gemini, Google’s AI assistant. Activated via a side tap, Gemini provides persistent assistance, indicated by a constant virtual icon. This AI powerhouse brings a new level of interaction to mixed reality. By simply looking at an object and asking Gemini about it, users can access real-time information. In a demonstrated scenario, identifying a football team’s jersey triggered Gemini to display league standings and recent match scores. This context-aware information retrieval extends to various domains, from travel planning to restaurant exploration. Requesting directions to Peru, for instance, launches a 3D Google Maps interface, allowing virtual navigation and exploration. Furthermore, Gemini provides ancillary information like optimal travel times, enriching the user experience. Current app integrations include notifications and Google Maps navigation.
The potential of Gemini is further showcased in its ability to understand user intent within specific contexts. Virtually touring a restaurant, a user can inquire about reservations without explicitly mentioning the establishment’s name, relying on Gemini’s understanding of the visual context. While reservation booking isn’t currently integrated, it hints at future functionalities. Entertainment experiences are also enhanced through Gemini. Watching videos on platforms like YouTube, users can query about location details, leveraging Gemini’s content recognition. The headset also supports stereoscopic content, creating an immersive viewing experience, further augmented by spatialized audio that adds depth and layering to 2D videos. Dedicated cinema modes, akin to those found in other VR headsets, transform the viewing experience into a virtual theater.
Beyond Gemini’s contextual awareness, Project Moohan integrates Google’s “Circle to Search” functionality, previously introduced on Android phones. This feature allows users to identify physical objects by drawing a virtual circle around them, triggering a Google Search results page. This bridges the gap between the physical and digital worlds, providing immediate access to relevant information. While the headset brings together several existing VR features with the addition of Gemini, the smart glasses accompanying the project hold even greater potential for seamless AI integration.
The smart glasses component of Project Moohan marks a significant step in wearable technology. Available with both clear and tinted lenses, these prescription-compatible glasses seamlessly integrate Gemini into everyday life. While currently unnamed, the prototype glasses demonstrate the potential for unobtrusive AI assistance. Gemini’s capabilities, when combined with the portability of smart glasses, promise a future where information is readily accessible at a glance. This creates an augmented reality experience that blends seamlessly with the real world. While Project Moohan currently focuses on demonstrating potential, it signifies a concerted effort by Google and Samsung to push the boundaries of mixed reality and redefine how we interact with information and the world around us.
In summary, Project Moohan represents a significant leap forward in the mixed reality landscape. The combination of a versatile headset with Gemini’s powerful AI capabilities creates a unique user experience, blurring the lines between the physical and digital worlds. From navigating virtual landscapes to accessing real-time information about everyday objects, the project showcases the potential for a future where AI assistance is seamlessly integrated into our daily lives. The addition of smart glasses further amplifies this potential, suggesting a future where augmented reality is readily accessible and seamlessly integrated with our natural visual perception. While Project Moohan is still in its early stages, it offers a compelling glimpse into the future of mixed reality and the transformative potential of AI-powered assistance.
