Augmented Reality Medical Training Platform

Augmented Reality Medical Training

Introduction

Zubr Futures recently developed a series of innovative training simulations for leading healthcare simulation manufacturer, Limbs & Things.

Inspired by Limbs & Things’ central aim to enhance clinical training standards and improve patient outcomes through realistic learning experiences, Zubr Futures designed a new immersive layer for Limbs & Things’ medical task trainer models, building upon our expertise in image tracker-based AR.

We built several augmented reality medical training simulations to accompany Limbs & Things’ existing physical ‘task trainer’ models, hosted within a custom app for iOS and Android. So far, Zubr Futures has collaborated with Limbs & Things to produce accompanying materials for the Chest Drain & Needle Decompression Trainer, Male and Female Catheterisation Trainer, Lumbar Puncture and Epidural Trainer.

Augmented Reality Medical Training

Objectives

In 2022, Limbs & Things approached us with an idea to expand their task trainer models – a free, widely-accessible app featuring interactive 3D models based on their trainers. In response to their vision, Zubr Futures worked closely with Limbs & Things and their team of skilled medical artists, utilising real-world MRI and CT scan data to create an accurate and immersive learning experience.

Collaborating with Limbs & Things, a company that values meticulous attention to detail, our priority was to develop anatomically accurate content. Our team’s focus on accuracy and precision resulted in an educational AR experience which can be delivered in a repeatable and cost-effective manner.

Results and Impact

By tapping into the potential of augmented reality technologies, Limbs & Things is now able to roll out a brand new line of products which enhance the learning opportunities offered by their physical models. With a simple and elegant app-based user interface, rock-solid AR calibration, animation playback and detailed labelling, Limbs & Things’ customers can get excellent learning value from an internal, real-time view of anatomy which goes above and beyond the limits of the physical training model.

Many studies acknowledge the opportunities afforded by augmented reality training to the healthcare sector, given the ability to simulate difficult scenarios and rare medical situations safely and effectively. Studies show that immersive training not only improves the retention of key information, but also ensures competency in practical skills through a kinaesthetic approach.

Augmented Reality Medical Training App
Copyright © Limbs & Things LTD
Augmented reality Medical training App
Copyright © Limbs & Things LTD

Approach

Brought to life by our extensive expertise in creating image tracker-based AR experiences, Zubr Futures were the ideal partners to develop the digital layers for Limbs & Things’ task trainers. Our adeptness in tracker-based AR is evident throughout our work. Our climate projects are a prime example, including our collaboration with Infosys, in which an urban model triggers the AR experience showcasing net zero initiatives. A range of Zubr Curio’s past projects also demonstrate our expertise in tracker-based AR. For example, the Acropolis app, which includes an image tracker-based AR experience tailored for classroom use. We deliver intricate details and engaging, interactive experiences through a simple QR code scan, providing an ease of engagement with the digital realm.

Realising Limbs & Things’ initial concept, we developed an augmented reality medical training platform, which can be applied to Limbs & Things’ physical training models via the ART (Augmented Reality Training) mats. This AR experience adds a further dimension to the training model, allowing students to peel back the layers and explore the model’s anatomy in greater depth. Various overlays can be examined, moving seamlessly between the musculature, organs and vessels, and skeletal structure of the models, as well as the ability to view their cross sections.

Alternatively, students can access this additional layer of training without the training mats via a custom free app which we built to accompany Limbs & Things’ models. Students can explore the related anatomy within the app’s 3D interactive space, which provides the same, anatomically-accurate rendering that can be manipulated on screen to reveal the different layers of the task trainer model. The app also demonstrates relevant procedures with step by step labelling, for a comprehensive learning experience.

Technical Implementation

Designed with students in mind, the app is available to download on iOS and Android, easily accessible via personal phones or tablets. By creating a custom app, as opposed to hosting AR training content through WebAR or a third party platform, Zubr Futures was able to provide a sophisticated training experience with greater detail and opportunities for interaction.

Augmented Reality Medical Training App
Copyright © Limbs & Things LTD