Article based on the report: Technology Evaluation of Augmented and Mixed Reality Systems in Shipbuilding Processes Preliminary Report.
Mari4_YARD is a European R&D project that connects real operational challenges at shipyards with modern digital solutions. TT PSC, with its skills and smart tools, had an opportunity to be directly involved in shipbuilding processes at Brodosplit in Croatia. At the same time, for Brodosplit, as for the end-users who are typically focused on their daily tasks, the project gave the chance to evaluate how new technologies could improve their work. Initiatives like Mari4_YARD bring these two sides together, ensuring that technological advancements address real industry needs.
The project’s main goal was to develop human-centric solutions that can preserve industry-specific knowledge, enhance the possibilities of present technologies, and improve work tasks’ performance.
Brodsplit, as an input provider of Mari4_YARD, tested Augmented Reality (AR) and Mixed Reality solutions in their shipbuilding processes. In this article, we present the highlights and results of testing of a head-mounted AR solution from TT PSC called SkillWorx Assisted Worker.
The system consists of a hands-free, voice-controlled head-mounted device (RealWear Navigator®) securely attached to a safety helmet. Equipped with wireless connectivity, a monocular camera, microphones, and advanced noise cancellation algorithms, the device enables engineers to operate entirely through voice commands, eliminating manual interaction. The device seamlessly integrates with TT PSC SkillWorx™, leveraging computer vision and remote SLAM to overlay critical information onto the ship structure and shipyard equipment. This article presents a usage of the system in a medium-sized shipyard use case, showcasing how it enhances field engineers’ efficiency while always keeping their hands free.
The project tested the functionalities and capabilities of tools such as are compact wearable industrial headsets equipped with a mini display under one eye that provide work-related information such as instructions, orders, checklists, and standard operating procedures depending on the installed software. The device, combined with TT PSC SkillWorx™ allows users to tag objects viewed through the headset, enabling the attachment of text notes, alerts, or images for annotations and guidance.
TT PSC provided SkillWorx Platform, including SkillWorx Assisted Worker and SkillWorx Guided Worker apps, plus spatial tracking technology, which made real-time tracking and tagging of objects possible during individual work and communication/cooperation with remote users
Object tracking, communication with outside users or mentors, real-time transcription/translation, and other functionalities of TT PSC SkillWorx™ were tested for three different use-cases:
The methodology primarily involved comparing time, materials, and personnel requirements between conventional shipyard processes and those utilizing the device. Initially, each technology came with claims from its developers, which were later translated into measurable Key Performance Indicators (KPIs) by a third-party company, typically specializing in monitoring services. The KPIs for each technology had been established during earlier project meetings.
The user received step-by-step instructions. Thanks to AR, specific objects were targeted for each of the steps, for example: “switch the polarity,” “engage clutch”, check voltage.” Furthermore, the voice-controlled actions were so intuitive that they eliminated the need for an additional workshops.
Goal: to digitalize all necessary learning material, in this case, the operator manual for the submerged welding tractor.
Devices and applications:
How did it go?
TT PSC team received shortened and transformed into step-by-step phases of working with LT7 tractor to connect onto chosen devices and platforms. After an hour of necessary preparations, the solution was ready to perform.
One of the TT PSC’s specialists was asked to complete the procedure of preparing and starting the tractor. Even though he had no previous experience with Submerged Arc Mechanized Welding, he performed the procedure correctly the first time, and it took him 7 minutes.
The same result was reached when another employee, who also had no experience with SAW, tried to run the tractor. The only difference was the need for an introduction to the tool itself (RealWear) and the TT PSC SkillWorx™ platform, which took 15 minutes.
Such a solution is also great for remote communication between a mentor and an engineer when support is needed from a more experienced employee to perform some activity.
Results
Checked and confirmed claims:
Interested in how it looks? Watch demo:
During multi-pass welding, maintaining WPS-compliant temperatures is essential. Traditional methods provide limited accuracy, while RealWear’s infrared camera offers precise, full-field temperature mapping after calibration. It also enables remote monitoring, mentoring, and documentation.
Goal: to make temperature control during multi-pass welding more precise and easier to proceed.
Devices and apps:
RealWear with an infrared camera attached, coupled with TT PSC SkillWorx™Assisted Worker customized to include thermal camera streaming for welding quality control and registering safety issues.
How did it go?
Shipyard “hot works” procedure (may vary by shipyard but generally includes):
For shipyard “hot works,” the TT PSC SkillWorx™for RealWear streamlines safety checks. A Fire Department officer can verify post-welding safety with infrared imaging, reducing paperwork and improving efficiency.
Results
Checked and confirmed:
Ship components and systems must meet specific standards, verified by commissioning personnel through various tests, many of which are visual. SkillWorx and RealWear technologies could enable remote or recorded inspections, ensuring authenticity through real-time communication and providing video proof of compliance.
Goal: to verify if some of the commissioning tasks can be done remotely or just by recordings
Devices and apps
RealWear with TT PSC SkillWorx™Assisted Worker app dedicated to remote commissioning of ship systems.
How did it go?
Testing with Brodosplit Outfitting personnel confirmed its practicality. The main challenge was not technical feasibility but acceptance by external commissioners, influenced by test types, distance, and prior experience. A key limitation is weak connectivity in ship structures, which could be resolved with Wi-Fi routers or improved transmitter placement, benefiting broader Industry 4.0 projects.
Results
Checked and confirmed claims:
Learn more about innovative manufacturing solutions:
Read also: Mari4_YARD project results: hand laser welding guide with HoloLens 2
Article based on the report: Technology Evaluation of Augmented and Mixed Reality Systems in Shipbuilding Processes Preliminary Report The technology was designed for laser welding, a high-energy process requiring precise path, speed, and angle control. While automation is common, recent advances in handheld laser welding demand tools to help “manual” welders maintain accuracy. To address […]
A pharmaceutical company aimed to enhance its innovation by actively testing modern technologies. A key challenge was skillfully and effectively integrating technological innovations into the production area so that data could be collected and analyzed in real-time. The company wanted to show that it is in the "close peloton" of digitalization of production, thereby increasing its market competitiveness.
Augmented Reality has helped the manufacturing industry in numerous ways. One of the significant benefits is that it allows workers to visualize and interact with digital models of products and processes in real time. This helps in identifying errors and potential issues in the production process, which can be corrected before they lead to wastage of resources.
The new opportunities associated with Industry 4.0 require companies to adapt to the new environment. In this article, we take a closer look at the current situation in the automotive industry, discuss the challenges it faces and the opportunities offered by digital transformation.
Modern technologies are starting to affect literally every industry. Even though most activities related to Augmented Reality (AR) are in their infancy when it comes to industry, we know from our own experience that the first implementations are the most important ones. These very implementations make a lot more people aware of the benefits of using AR. This applies to the logistics industry as well, even though it might seem to be much less industrial. In practice, just like other industries, it focuses on quality and efficiency.
Modern technology is constantly changing, with newer and newer products, which develop services and the effectiveness of specialists' work coming out constantly. Since recently we have had the opportunity to work with the new AR headset – Magic Leap. These advanced glasses, presented in 2018, allow users to utilise AR technology in a completely new way, thus becoming a strong competitor to other AR glasses.
Are you wondering how to enhance most of the processes in your company? How to eliminate production downtime, reduce the distance between your company and the professional you urgently need? How to lower the current costs? Together with RealWear HMT-1 we are coming to the rescue!
More and more entrepreneurs from different industrial sectors realize benefits which Augmented Reality technology can offer them. Augmented Reality supports efficiency of processes, for instance by eliminating production downtime. It enables quick identification of problems and resuming work continuity, and as a result, reduces current expenses.
Attracting user attention in a world that constantly provides new stimuli is becoming more difficult, but not impossible. Modern technologies which marketers are trying to efficiently use and with their help to achieve previously defined goals are coming to the rescue. One of the solutions that constantly shock both users and the people themselves who […]
Development of technology depends to a large extent on needs and problems of people who use it on a daily basis. Specialists and their clients very often come across...
Let’s get in touch
Contact us