Multiple Screen Detection for Eye-Tracking Based Monitor Interaction

Thesis by: open
Advisor: Prof. Nassir Navab
Supervision by: Ralf Stauder, Mathias Magg (MITI)
Due date: tba

Abstract

A modern operating room usually offers multiple different monitors to present various information to the surgical staff. With the trend to go from highly invasive open surgery to minimally invasive techniques such as laparoscopic surgery, Single-Port surgery or even NOTES, the amount of additional monitors is likely to increase. Knowing which monitor the surgeon is looking at, and on which part of the monitor they are focused allows for a wide variety of supporting systems, such as automatic adjustments of the endoscopic camera position through a robotic system.

The goal of this work is to develop a method to recognize monitors with changing content through the cameras of head-mounted eye-tracking systems and translate the detected gaze point to the coordinate frame of the detection monitor. The work will be based on an existing framework (developed in C#) that is able to detect a single monitor, which should be extended to an arbitrary number of monitors and distinguish between them.