IBM has demonstrated a system that can guide field technicians through equipment inspections with voice instructions and smart glasses. The approach is intended to reduce the need to switch attention between physical equipment, work orders, standard operating procedures, and manual reports.
In the demonstration, technicians receive step-by-step guidance while inspecting items such as pipe pressure, oil levels, and visible equipment conditions including corrosion. Inspection findings can also be entered into the system as part of a digital workflow.
Remote Support Can Be Placed on Physical Objects
When additional assistance is needed, the system can connect a technician with an expert working from another location. The remote expert can scan the physical area being handled to understand the context of the issue.
Repair instructions can then appear as digital labels attached to real objects in the work area. This allows visual guidance to be positioned on the specific area relevant to the technician.
The hands-free model is particularly relevant for work conducted in potentially hazardous environments. Technicians do not need to keep handling paper documents while following inspection procedures.
Training Moves Beyond the Physical Server Room
The same combination of Mixed Reality and Agentic AI is also being used for technical training. IBM showed the solution during a tour of its Industry 4.0 Studio at Changi Business Park in Singapore.
Participants can view a three-dimensional virtual representation of the IBM z17 mainframe through immersive MR glasses. The virtual model is positioned in front of the user for assembly and maintenance training in a simulated setting.
This setup addresses a practical limitation of training with large hardware, which can be difficult to move into a classroom. It also offers an alternative when mentors have limited time for repeated in-person instruction.
Two AI Agents Support Voice Interaction
Within the virtual training environment, IBM presents two AI agents as robot avatars that participants can speak with during the session. Users can ask about device features, assembly mechanisms, and quality inspection procedures.
| AI Agent | Use Environment | Displayed Function |
|---|---|---|
| Product Engineering Agent | IBM z17 training simulation | Robot avatar for participant voice interaction |
| Quality Agent | IBM z17 training simulation | Robot avatar for participant voice interaction |
The system can also provide access to information on statistics for components rejected during inspection. That information can support participants as they learn how quality checks are carried out.
One Workflow for Learning and Field Operations
Medcom.id reported that the immersive training format can be accessed remotely by participants in different locations. This enables them to join the same training session without gathering beside a physical server.
IBM’s demonstration combines virtual visualization, voice guidance, remote expert assistance, inspection, and reporting in a single operational flow. The company’s use of the technology points to potential applications in maintenance work, worker safety, and technical knowledge transfer.
The system does not merely display virtual objects for training purposes. It connects training and field support in a way that may help technicians perform procedures while keeping their focus on the equipment in front of them.
