We’re excited to announce the launch of Umajin XR Assistant, now available on Meta Quest.
Designed for frontline workers, field technicians, trainers, and support teams, Umajin XR Assistant brings real-time expert guidance into the physical world through immersive extended reality (XR) collaboration.
Using a Meta Quest headset, workers can connect directly with remote experts. The expert sees exactly what the worker sees, then guides them through the task using voice and precise 3D spatial annotations placed directly in the worker’s field of view. The result is faster problem-solving, improved training outcomes, reduced travel requirements, and greater confidence when performing complex tasks.
How It Works
Umajin XR Assistant connects two users:
The Worker
The worker wears a Meta Quest headset while performing a task in the real world. Through the headset, they receive live support while keeping their hands free and their attention focused on the job.
The Expert
The expert joins remotely using a desktop application and can view the worker’s environment in real time. They can communicate through voice and video, provide visual guidance, and collaborate directly within the worker’s physical space.
Why it matters
Some problems can’t wait for an expert to fly out. A machine goes down, a complex repair stalls, a frontline worker hits a step they’ve never seen before — and every minute of uncertainty costs time, money, and sometimes safety.
The Umajin XR Assistant, now on Meta Quest, is built to close that gap by putting a remote expert right beside the worker, virtually. The payoff is practical:
- Less downtime and travel cost, because help arrives instantly instead of waiting for a site visit
- Faster issue resolution, with experts diagnosing and directing in the moment
- Better safety and performance, since workers get precise, in-context guidance rather than guesswork
- Interactive training and knowledge transfer
For organizations with distributed teams, specialized equipment, or a shrinking bench of senior experts, the model is compelling: one expert can support many workers across many locations without leaving their desk.
What’s coming next
The roadmap pushes the assistant well beyond live calls, turning each session into something you can capture, search, and reuse:
- Capture and Documentation: Record, review, and report with ease
Workers can capture images and videos for later analysis, workflow validation, and sign-off, while voice-driven data entry streamlines information capture in the field. AI-powered transcription of voice conversations, complete with timestamps, creates an auditable record that supports compliance, reporting, and workflow management.
Users can also upload images, attach links to external files, and create step-by-step visual sequences to document processes, inspections, or completed work.
- AI and Vision: see more, know more
Vision enhancements are on the way, including zoom, on-the-fly text language translation, and part identification. Workers will be able to ask questions about components and get answers pulled from manuals or enterprise documents. They can also access files, illustrations, manuals, and OpenUSD/CAD assets anchored by location or 2D markers.
- Sessions and Replay: revisit and reuse
Saved sessions will be replayable inside the headset with spatially accurate asset tracking. XR sessions can be exported into 3D modelling software. Desktop users will also be able to send a webcam video feed to the worker.
- Tools and Content: built-in capabilities
A growing toolkit of content and drawing tools includes 2D and 3D iconography from an integrated library or “digital canvas.” Also coming is the ability to do accurate spatial measurements via a virtual measurement tool.
Taken together, these additions move the product from real-time help toward a full lifecycle: guide the work, document it, and feed what’s learned back into training and audits.
Built for the Future of Frontline Work
As organizations continue to embrace digital transformation, the need for efficient remote support and workforce enablement has never been greater. XR technologies are creating new opportunities to connect expertise with action, allowing teams to solve problems faster and train more effectively regardless of location.
Umajin XR Assistant was created to bridge the gap between remote expertise and on-site execution, delivering immersive collaboration that feels natural, immediate, and effective.
Available Now
Umajin XR Assistant is available today for Meta Quest devices.
Whether you’re supporting technicians in the field, training new employees, or providing specialist assistance across multiple locations, Umajin XR Assistant enables a new level of collaboration and operational efficiency.