Assembling a complex component often require expert assistance. Intuitive visual guidance using Augmented Reality (AR) has the potential to significantly enhance user performance. However, there is a noticeable gap in the development of comprehensive pipelines for creating AI and AR based assembly guidance systems. Furthermore, existing studies on AR-based assembly guidance primarily focus on simple assembly components, limiting their applicability to more complex scenarios. This report is proposing an Augmented Reality (AR) and Artificial Intelligence (AI) assistance for helping assembly process of complex machine component related to advanced manufacturing. In particular, the project compared Hardware Configuration, Software Architecture and Machine Vision Algorithms to combine AR and AI based systems for assembly process. The paper has investigated and compared different hardware configurations and software architecture and compare them with respect to latency, accuracy, and human factors. Based on an analysis of various hardware and software models, we selected the most effective configuration to develop the guidance system. We developed an AI based hologram registering technique for providing assembly assistance in dynamic environment. To enhance the interaction and information sharing, we developed multimodal user interface allows the user effectively communicate with Mixed Reality (MR) environment and ease access of instruction. We also found that users could undertake the assembly task faster with MR based system compared to traditional video based demonstration. In addition, our findings indicate that the proposed system significantly reduces cognitive load and improves usability compared to baseline methods.
Музыка
Фильмы
ТВ Шоу
Категории видео
