Queen's University

Towards webcam-based tracking for interventional navigation

Optical tracking is a commonly used tool in computer assisted surgery and surgical training; however, many current generation commercially available tracking systems are prohibitively large and expensive for certain applications. We developed an open source optical tracking system using the Intel RealSense SR300 webcam with integrated depth sensor. In this paper, we assess the accuracy of this tracking system.

The PLUS toolkit was extended to incorporate the ArUco marker detection and tracking library. The depth data obtained from the infrared sensor of the Intel RealSense SR300 was used to improve accuracy. We assessed the accuracy of the system by comparing this tracker to a high accuracy commercial optical tracker.

The ArUco based optical tracking algorithm had median errors of 20.0mm and 4.1 degrees in a 200x200x200mm tracking volume. Our algorithm processing the depth data had a positional error of 17.3mm, and an orientation error of 7.1 degrees in the same tracking volume. In the direction perpendicular to the sensor, the optical only tracking had positional errors between 11% and 15%, compared to errors in depth of 1% or less. In tracking one marker relative to another, a fused transform from optical and depth data produced the best result of 1.39% error.

The webcam based system does not yet have satisfactory accuracy for use in computer assisted surgery or surgical training. (Read More)