Technology Supported Training

Professional training aims at showing high performance during a given task. We support training by using technology to measure human behavior in training and to development valuable performance metrics.

Performance Assessment in Surgery Training

Surgery is traditionally educated in physical training setups causing high personnel and material costs. More recently, virtual trainings have allowed to overcome these disadvantages, but still show shortcomings in realistic mechanical responses and tactile feedback. Now, the key idea is to combine the benefits of physical and virtual training. In collaboration with SYNBONE, we develop a hands-on training system for orthopedic trauma surgery applying latest technologies to evaluate the trainees' behavior and automatically assess their performance. The project is funded by Innosuisse.

external page Watch video

pdz_TST_trauma_training — Demonstration of a hands-on training system using technology to accurately identify deterministic interactions between surgical instruments and bones, allowing precise detection of procedural activities. (ETHZ_pdz)

Augmented Reality in Surgery Training

Augmented reality has a huge potential to support and guide surgeons in procedure training. For pedicle screw placement in spinal fusion surgery, we developed five AR visualizations displaying the deviation to the ideal drill trajectory via Microsoft HoloLens 2. Our results show that real-time feedback provided by navigation can level task performance between experts and novices, and that the design of a visualization has a significant impact on task performance, visual attention and user experience.

external page Read more

pdz_TST_augmented_reality — Training of a surgeon guided by an augmented reality application for Microsoft HoloLens 2 displaying real-time information about the deviation to the ideal trajectory for placing a pedicle screw. (ETHZ_pdz)

Pose Estimation in Resuscitation Training

Cardiopulmonary resuscitation (CPR) training improves the trainees' skills based on expert feedback. The quality of feedback can vary between experts, indicating a need for technology support in performance assessment. In a CPR training at the Simulation Center of University Hospital Zurich (USZ), we applied human pose estimation, a video-based technology tracking the human body and its joint positions, to evaluate arm and chest movements for an automated and objective assessment of the trainees' performance.

external page Read more

pdz_TST_pose_estimation — Pose estimation detects and tracks the position of body joints in video data. For performance assessment in CPR training we evaluated arm and chest movements of the trainees. (ETHZ_pdz)

Contact

Dr. Quentin Lohmeyer

Lecturer at the Department of Mechanical and Process Engineering

Chair of Product Dev.& Eng. Design
Leonhardstrasse 21
8092 Zürich
Switzerland