Research Interest

• Navigation and Computer Aided Surgery
• Evaluation of Navigation Systems in Medicine
• Augmented Reality in Medicine
• Hybrid User Interfaces for Surgery and Interventions

Publications

2020
	A. K. Kogler, A. M. Polemi, S. Nair, S. Majewski, L. T. Dengel, C. L. Slingluff, B. Kross, S. J. Lee, J. E. McKisson?, J. McKisson?, A. G. Weisenberger, B. L. Welch, T. Wendler, P. Matthies, J. Traub, M. Witt, M. B. Williams Evaluation of camera-based freehand SPECT in preoperative sentinel lymph node mapping for melanoma patients EJNMMI Research 10. https://doi.org/10.1186/s13550-020-00729-8. (bib)
2013
	M. Friebe, J. Traub Translational research with students - first experience from a new lecture format in image guided surgeries - innovation creation?! 25th International Conference of the International Society for Medical Innovation and Technology, iSMIT 2013 in Baden-Baden, Germany, September 05-07, 2013 (bib)
	N. Aubry, E. Auffray, F. B. Mimoun, N. Brillouet, R. Bugalho, , O. Charles, D. Cortinovis, P. Courday, A. Cserkaszky, C. Damon, K. Doroud, J.-M. Fischer, G. Fornaro, J.-M. Fourmigue, B. Frisch, B. Fuerst, J. Gardiazabal, K. Gadow, E. Garutti, C. Gaston, A. Gil-Ortiz, E. Guedj, T. Harion, P. Jarron, J. Kabadanian, T. Lasser, R. Laugier, P. Lecoq, D. Lombardo, S. Mandai, E. Mas, T. Meyer, O. Mundler, N. Navab, C. Ortigão, M. Paganoni, D. Perrodin, M. Pizzichemi, J. O. Prior, T. Reichl, M. Reinecke, M. Rolo, H.-C. Schultz-Coulon, M. Schwaiger, W. Shen, A. Silenzi, J. C. Silva, , I. Somlai-Schweiger, R. Stamen, J. Traub, J. Varela, V. Veckalns, V. Vidal, J. Vishwas, T. Wendler, C. Xu, S. I. Ziegler, M. Zvolsky EndoTOFPET-US: a novel multimodal tool for endoscopy and positron emission tomography JINST 8 C04002. https://doi.org/10.1088/1748-0221/8/04/C04002 (bib)
2012
	M. Friebe, T. Wendler, J. Traub, B. Tombach, N. Navab 3D handheld SPECT combined with serially acquired MRI reference images - feasibility study for intraoperative applications Proceedings of the 9th Interventional MRI Symposium Boston, September 2012 (bib)
2011
	A. Rieger, J. Saeckl, B. Belloni, R. Hein, A. Okur, K. Scheidhauer, T. Wendler, J. Traub, H. Friess, M. E. Martignoni First Experiences with Navigated Radio-Guided Surgery Using Freehand SPECT Case Reports in Oncology, August 2011 (bib)
2010
	T. Wendler, K. Herrmann, A. Schnelzer, M. E. Martignoni, T. Lasser, J. Traub, A. Ehlerding, J. Saeckl, N. Navab, M. Kiechle, H. Friess, M. Schwaiger, S. I. Ziegler, A. K. Buck Visione 3-D SPECT intraoperatoria: una nuova metodica per chirurgia radioguiata Proceedings of SICO 2010, Milan, Italy, June 2010 (bib)
	L. Wang, J. Traub, S. Weidert, S.M. Heining, E. Euler, N. Navab Parallax-Free Intra-Operative X-ray Image Stitching the MICCAI 2009 special issue of the Journal Medical Image Analysis (bib)
	T. Wendler, K. Herrmann, A. Schnelzer, T. Lasser, J. Traub, O. Kutter, A. Ehlerding, K. Scheidhauer, T. Schuster, M. Kiechle, M. Schwaiger, N. Navab, S. I. Ziegler, A. K. Buck First Demonstration of 3D Lymphatic Mapping using freehand SPECT Proceedings of the International Conference on Sentinel Node Biopsy and Radioguided Head & Neck Surgery (SNB), Copenhagen, Denmark, May 2010 (bib)
	A. K. Buck, A. Schnelzer, T. Wendler, K. Herrmann, T. Lasser, J. Traub, O. Kutter, T. Schuster, A. Ehlerding, K. Scheidhauer, M. Kiechle, N. Navab, S. I. Ziegler, M. Schwaiger First demonstration of 3D lymphatic mapping in breast cancer using freehand SPECT Proceedings of DGN Nuklearmedizin 2010, Leipzig, Germany, April 2010 (bib)
	T. Wendler, K. Herrmann, A. Schnelzer, T. Lasser, J. Traub, O. Kutter, A. Ehlerding, K. Scheidhauer, T. Schuster, M. Kiechle, M. Schwaiger, N. Navab, S. I. Ziegler, A. K. Buck First demonstration of 3-D lymphatic mapping in breast cancer using freehand SPECT European Journal of Nuclear Medicine and Molecular Imaging, Springer Berlin/Heidelberg, 2010 Aug;37(8):1452-61. Epub 2010 Mar 31. (bib)
	P. Dressel, L. Wang, O. Kutter, J. Traub, S.M. Heining, N. Navab Intraoperative positioning of mobile C-arms using artificial fluoroscopy SPIE Medical Imaging, San Diego, California, USA, February 2010 (bib)
2009
	J. Traub, K. Herrmann, T. Lasser, N. Navab, S. I. Ziegler, A. K. Buck, T. Wendler Freehand SPECT/Ultrasound Fusion for Hybrid Image-guided Resection Proceedings of RSNA 2009, Chicago, USA, December 2009 (bib)
	T. Wendler, K. Herrmann, A. Schnelzer, T. Lasser, J. Traub, O. Kutter, T. Schuster, M. Kiechle, M. Schwaiger, N. Navab, S. I. Ziegler, A. K. Buck Clinical introduction of freehand SPECT for image-guided sentinel lymph node biopsy Proceedings of Annual Congress of the European Association of of Nuclear Medicine (EANM 2009), Barcelona, Spain, October 2009 (bib)
	T. Wendler, X. Feng, K. Herrmann, T. Lasser, J. Traub, S. I. Ziegler, N. Navab, A. K. Buck 2D/3D registration of freehand SPECT and planar scintigraphy for clinical evaluation of 3D thyroid scintigraphy Proceedings of Annual Congress of the European Association of of Nuclear Medicine (EANM 2009), Barcelona, Spain, October 2009 (bib)
	T. Wendler, K. Herrmann, T. Lasser, J. Traub, M. Schwaiger, N. Navab, S. I. Ziegler, A. K. Buck First experience with freehand SPECT for lymphatic mapping in melanoma in upper body Proceedings of Annual Congress of the European Association of of Nuclear Medicine (EANM 2009), Barcelona, Spain, October 2009 (bib)
	T. Wendler, T. Lasser, J. Traub, S. I. Ziegler, N. Navab Freehand SPECT / ultrasound fusion for hybrid image-guided resection Proceedings of Annual Congress of the European Association of of Nuclear Medicine (EANM 2009), Barcelona, Spain, October 2009 (bib)
	L. Wang, J. Traub, S. Weidert, S.M. Heining, E. Euler, N. Navab Parallax-free Long Bone X-ray Image Stitching Medical Image Computing and Computer-Assisted Intervention (MICCAI), London, UK, September 20-24 2009 (bib)
	J. Traub, K. Herrmann, T. Wendler, T. Lasser, M. Schwaiger, N. Navab, S. I. Ziegler, A. K. Buck First clinical results of freehand SPECT for lymphatic mapping in breast cancer Proceedings of the Molekulare Bildgebung (MOBI), Berlin, Germany, Jun. 2009 (bib)
	T. Wendler, K. Herrmann, T. Lasser, J. Traub, M. Schwaiger, S. I. Ziegler, N. Navab, A. K. Buck Freehand SPECT: first in-vivo evaluation and comparison to conventional lymphatic mapping Proceedings of Annual Meeting of Society of Nuclear Medicine (SNM 2009), Toronto, Canada, June 2009 (bib)
	M. Feuerstein, T. Reichl, J. Vogel, J. Traub, N. Navab Magneto-Optical Tracking of Flexible Laparoscopic Ultrasound: Model-Based Online Detection and Correction of Magnetic Tracking Errors IEEE Trans. Med. Imag., vol. 28, no. 6, pp. 951-967, June 2009 (bib)
	N. Navab, S.M. Heining, J. Traub Camera Augmented Mobile C-arm (CAMC): Calibration, Accuracy Study and Clinical Applications IEEE Transactions Medical Imaging, 29 (7), 1412-1423 (bib)
	T. Wendler, X. Feng, T. Lasser, K. Herrmann, J. Traub, K. Scheidhauer, S. I. Ziegler, D. Lenhart, J. Grahneis, M. Schwaiger, N. Navab, A. K. Buck Freehand SPECT for 3D thyroid scintigraphy: first patient report Proceedings of DGN Nuklearmedizin 2009, Leipzig, Germany, April 2009 (bib)
	K. Herrmann, T. Wendler, T. Chen, A. Bartel, T. Lasser, K. Scheidhauer, J. Traub, T. Schuster, S. I. Ziegler, M. Schwaiger, A. K. Buck, N. Navab Freehand SPECT: first in-vivo use for lymphatic mapping and comparison to conventional imaging Proceedings of DGN Nuklearmedizin 2009, Leipzig, Germany, April 2009 (bib)
	L. Wang, J. Traub, S.M. Heining, S. Benhimane, R. Graumann, E. Euler, N. Navab Long Bone X-ray Image Stitching using C-arm Motion Estimation Proceedings of Bildverarbeitung fuer die Medizin (BVM 2009), Heidelberg, Germany, March 22-24 2009 (bib)
	L. Wang, S. Weidert, J. Traub, S.M. Heining, C. Riquarts, E. Euler, N. Navab Camera Augmented Mobile C-arm: Towards Real Patient Study Proceedings of Bildverarbeitung fuer die Medizin (BVM 2009), Heidelberg, Germany, March 22-24 2009 (bib)
2008
	J. Traub, T. Sielhorst, S.M. Heining, N. Navab Advanced Display and Visualization Concepts for Image Guided Surgery IEEE/OSA Journal of Display Technology; Special Issue on Medical Displays, Volume 4, Issue 4, Dec. 2008 (bib)
	J. Traub New Concepts for Design and Workflow Driven Evaluation of Computer Assisted Surgery Solutions Dissertation an der Fakultät für Informatik, Technische Universität München, 2008 ( online version available here) (bib)
	T. Lasser, T. Wendler, J. Traub, S. I. Ziegler, N. Navab Definition of optimal collimator geometries for 3D tomographic thyroid scintigraphy using navigated gamma probes Proceedings of Annual Congress of the European Association of Nuclear Medicine (EANM 2008), Munich, Germany, October 2008 (bib)
	T. Wendler, T. Lasser, A. K. Buck, J. Traub, M. Schwaiger, S. I. Ziegler, N. Navab First case report of 3D tomographic thyroid scintigraphy with tracked gamma probes Proceedings of Annual Congress of the European Association of Nuclear Medicine (EANM 2008), Munich, Germany, October 2008, Eur J Nuc Med Mol Imaging, vol. 35 (Suppl. 2), S129 (bib)
	O. Kutter, A. Aichert, C. Bichlmeier, J. Traub, S.M. Heining, B. Ockert, E. Euler, N. Navab Real-time Volume Rendering for High Quality Visualization in Augmented Reality International Workshop on Augmented environments for Medical Imaging including Augmented Reality in Computer-aided Surgery (AMI-ARCS 2008), USA, New York, September 2008 (bib)
	M. Feuerstein, T. Reichl, J. Vogel, J. Traub, N. Navab New Approaches to Online Estimation of Electromagnetic Tracking Errors for Laparoscopic Ultrasonography Computer Aided Surgery, vol. 13, no. 5, pp. 311-323, September 2008 (bib)
	J. Traub, A. Ahmadi, N. Padoy, L. Wang, S.M. Heining, E. Euler, P. Jannin, N. Navab Workflow Based Assessment of the Camera Augmented Mobile C-arm System International Workshop on Augmented Reality environments for Medical Imaging and Computer-aided Surgery (AMI-ARCS 2008), New York, NY, USA, September 2008 (bib)
	T. Wendler, A. Hartl, T. Lasser, J. Traub, S. I. Ziegler, N. Navab Tracking-based statistical correction for radio-guided cancer surgery Proceedings of World Molecular Imaging Congress (WMIC 2008), Nice, France, September 2008 (bib)
	L. Wang, J. Traub, S.M. Heining, S. Benhimane, R. Graumann, E. Euler, N. Navab Long Bone X-ray Image Stitching Using Camera Augmented Mobile C-arm Medical Image Computing and Computer-Assisted Intervention, MICCAI, 2008, New York, USA, September 6-10 2008 (bib)
	T. Wendler, J. Traub, T. Lasser, M. Feuerstein, J. Vogel, S. I. Ziegler, N. Navab Combined ultrasound and gamma probe imaging for examination of thyroid nodules Proceedings of Annual Meeting of Society of Nuclear Medicine (SNM 2008), New Orleans, USA, June 2008 (bib)
	T. Wendler, A. Hartl, T. Lasser, J. Traub, S. I. Ziegler, N. Navab 3D Intra-operative nuclear imaging for SLNB in neck Proceedings of Annual Meeting of Society of Nuclear Medicine (SNM 2008), New Orleans, USA, June 2008 (bib)
	A. Hartl, T. Wendler, J. Traub, T. Lasser, S. I. Ziegler, N. Navab Confident radioactivity surface reconstruction for control of resection borders Proceedings of Annual Meeting of Society of Nuclear Medicine (SNM 2008), New Orleans, USA, June 2008 (bib)
	J. Traub, S.M. Heining, E. Euler, N. Navab Two camera augmented mobile C-arm – System setup and first experiments Proceedings of The 8th Computer Assisted Orthopaedic Surgery (CAOS 2008), Hong Kong, China, June, 2008 (bib)
	N. Navab, J. Traub, A. K. Buck, S. I. Ziegler, T. Wendler Navigated nuclear probes for intra-operative functional imaging Proceedings of 5th IEEE International Symposium on Biomedical Imaging (ISBI 2008), Paris, France, May 14 - 17 2008, pp. 1395-1398 (bib)
2007
	T. Wendler, M. Feuerstein, J. Traub, T. Lasser, J. Vogel, F. Daghighian, S. I. Ziegler, N. Navab Real-time fusion of ultrasound and gamma probe for navigated localization of liver metastases Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October 29 - November 2007, LNCS 4792 (2), pp. 909-917 (bib)
	T. Wendler, A. Hartl, T. Lasser, J. Traub, F. Daghighian, S. I. Ziegler, N. Navab Towards intra-operative 3D nuclear imaging: reconstruction of 3D radioactive distributions using tracked gamma probes Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October 29 - November 2 2007, LCNS 4792 (2), pp. 252-260 (bib)
	J. Traub, H. Heibel, P. Dressel, S.M. Heining, R. Graumann, N. Navab A Multi-View Opto-Xray Imaging System: Development and First Application in Trauma Surgery Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October/November 2007. (bib)
	T. Klein, J. Traub, H. Hautmann, A. Ahmadian, N. Navab Fiducial-Free Registration Procedure for Navigated Bronchoscopy Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October/November 2007.
	A. Hartl, T. Wendler, T. Lasser, J. Traub, S. I. Ziegler, N. Navab Towards intra-operative 3D nuclear imaging: development and evaluation of ad hoc models Proceedings of Jahrestagung der deutschen Gesselschaft für Computer- und Roboterassistierte Chirurgie e.V. (CURAC 2007), Karlsruhe, Germany, October 2007 (bib)
	N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 10-14, Sept/Oct, 2007 (bib)
	T. Wendler, J. Traub, A. Hartl, T. Lasser, M. Burian, A. K. Buck, F. Daghighian, M. Schwaiger, S. I. Ziegler, N. Navab Adding navigation to radio-guided surgery: new possibilities, new problems, new solutions Proceedings of Russian Bavarian Conference on Biomedical Engineering (RBC Biomed 2007), Erlangen, Germany, July 2-3, 2007, pp. 96-100 (bib)
	T. Wendler, A. Hartl, J. Traub, S. I. Ziegler, N. Navab Intraoperative nuclear imaging using navigated gamma-probes for tumor localization Proceedings of Annual Meeting of Society of Nuclear Medicine (SNM 2007), Washington D.C., USA, June 2007 (bib)
	T. Wendler, J. Traub, S. I. Ziegler, N. Navab Validation of navigated beta-probe imaging with PET/CT-generated activity surfaces. New approach in radio-guided resection for FDG-positive tumors Proceedings of Annual Meeting of Society of Nuclear Medicine (SNM 2007), Washington D.C., USA, June 2007; Meeting Abstracts 48: 46P-b. (bib)
	P. Kneschaurek, J. Traub Dose Escalation with Photons - Emerging Technologies: a Physicist´s Point of View Eighth International Meeting on Progress in Radio-Oncology, May 16-19, 2007, Salzburg, Austria (bib)
	R. Bauernschmitt, M. Feuerstein, J. Traub, E.U. Schirmbeck, G. Klinker, R. Lange Optimal port placement and enhanced guidance in robotically assisted cardiac surgery Surgical Endoscopy, Volume 21, Number 4, April 2007 (bib)
	P. Stefan, J. Traub, S.M. Heining, C. Riquarts, T. Sielhorst, E. Euler, N. Navab Hybrid navigation interface: a comparative study Proceedings of Bildverarbeitung fuer die Medizin (BVM 2007), Munich, Germany, March 2007, pp. 81-86 (bib)
	J. Traub, S. Kaur, P. Kneschaurek, N. Navab Evaluation of Electromagnetic Error Correction Methods Proceedings of Bildverarbeitung fuer die Medizin (BVM 2007), Munich, Germany, March 2007, pp. 363-367 (bib)
	T. Klein, S. Benhimane, J. Traub, S.M. Heining, E. Euler, N. Navab Interactive Guidance System for C-arm Repositioning without Radiation Proceedings of Bildverarbeitung fuer die Medizin (BVM 2007), Munich, Germany, March 2007, pp. 21-25 (bib)
	O. Kishenkov, T. Wendler, J. Traub, S. I. Ziegler, N. Navab Method for projecting functional 3D information onto anatomic surfaces: Accuracy improvement for navigated 3D beta-probes Proceedings of Bildverarbeitung fuer die Medizin (BVM 2007), Munich, Germany, March 2007, pp.66-70 (bib)
2006
	J. Traub, J. Much, A. Schneider, F. Peltz, H. Hautmann, N. Navab User interface for electromagnetic navigated bronchoscopy 5. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2006), Hannover, Germany, September 2006 (bib)
	T. Wendler, J. Traub, S. I. Ziegler, N. Navab Navigated three dimensional beta probe for optimal cancer resection Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Denmark, October 1-6 2006, LNCS 4190 (1), pp. 565-569 (bib)
	J. Traub, P. Stefan, S.M. Heining, T. Sielhorst, C. Riquarts, E. Euler, N. Navab Hybrid navigation interface for orthopedic and trauma surgery Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Denmark, October 2006, pp. 373-380 (bib)
	J. Traub, P. Stefan, S.M. Heining, T. Sielhorst, C. Riquarts, E. Euler, N. Navab Towards a Hybrid Navigation Interface: Comparison of a Slice Based Navigation System with In-situ Visualization Proceedings of International Workshop on Medical Imaging and Augmented Reality (MIAR 2006), Shanghai, China, August, 2006, pp.179-186 (bib)
	S.M. Heining, P. Stefan, L. Omary, S. Wiesner, T. Sielhorst, N. Navab, F. Sauer, E. Euler, W. Mutschler, J. Traub Evaluation of an in-situ visualization system for navigated trauma surgery Journal of Biomechanics 2006; Vol. 39 Suppl. 1, page 209 (bib)
	J. Traub, P. Stefan, S.M. Heining, T. Sielhorst, C. Riquarts, E. Euler, N. Navab Stereoscopic augmented reality navigation for trauma surgery: cadaver experiment and usability study International Journal of Computer Assisted Radiology and Surgery, 2006; Vol. 1 Suppl. 1, page 30 - 31. The original publication is available online at www.springerlink.com (bib)
	T. Sielhorst, M. Feuerstein, J. Traub, O. Kutter, N. Navab CAMPAR: A software framework guaranteeing quality for medical augmented reality International Journal of Computer Assisted Radiology and Surgery, 2006; Vol. 1 Suppl. 1, page 29 - 30. The original publication is available online at www.springerlink.com (bib)
	S.M. Heining, P. Stefan, F. Sauer, E. Euler, N. Navab, J. Traub Evaluation of an in-situ visualization system for navigated trauma surgery Proceedings of The 6th Computer Assisted Orthopaedic Surgery (CAOS 2006), Montreal, Canada, June, 2006 (bib)
2005
	J. Traub, S. Wiesner, M. Feuerstein, H. Feußner, N. Navab Evaluation of Calibration Methods for Laparoscope Augmentation 4. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2005), Berlin, Germany, September 2005 (bib)
	B. Olbrich, J. Traub, S. Wiesner, A. Wiechert, H. Feußner, N. Navab Respiratory Motion Analysis: Towards Gated Augmentation of the Liver Proceedings of Computer Assisted Radiology and Surgery (CARS 2005), pp. 248-253, Berlin, Germany, June 2005 (bib)
2004
	R. Bauernschmitt, M. Feuerstein, E.U. Schirmbeck, J. Traub, G. Klinker, S.M. Wildhirt, R. Lange Improved Preoperative Planning in Robotic Heart Surgery IEEE Proceedings of Computers in Cardiology (CinC 2004), pp. 773 - 776, Chicago, USA, September 2004 (bib)
	J. Traub, M. Feuerstein, M. Bauer, E.U. Schirmbeck, H. Najafi, R. Bauernschmitt, G. Klinker Augmented Reality for Port Placement and Navigation in Robotically Assisted Minimally Invasive Cardiovascular Surgery Proceedings of Computer Assisted Radiology and Surgery (CARS 2004), pp. 735 - 740, Chicago, USA, June 2004 (bib)
	T. Sielhorst, J. Traub, N. Navab The AR Apprenticeship: Replication and Omnidirectional Viewing of Subtle Movements Proc. of IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), 2004, pp. (bib)

Teaching

Winter Term 2014/2015

• Lecture: Innovation Generation and Entrepreneurship in the Healthcare Domain

Summer Term 2014

• Lecture: Image Guided Surgeries - From Bench to Bedside and Back

Winter Term 2013/2014

• Lecture: Image Guided Surgeries - From Bench to Bedside and Back

Summer Term 2013

• Lecture: Image Guided Surgeries - From Bench to Bedside and Back

Winter Term 2007/2008

• Lecture Computer Aided Medical Procedures II
• Hauptseminar Recent Advances in Computer Assisted Surgery
• Proseminar History of Computational Science, Vision, and Medical Science

Winter Term 2006/2007

• Lecture Computer Aided Medical Procedures
• Hauptseminar Recent Advances in Computer Assisted Surgery

Summer Term 2006

• Lecture Computer Aided Medical Procedures II
• Programmierpraktikum Graphikprogrammierung in C++
• Doktorandenseminar Current Research and Challenges in Surgical Navigation
• Hauptseminar Selected Problems in Technical Medicine Techniques and Developments in the measurements of activity and motion in patients with Multiple Sclerosis

Winter Term 2005/2006

• Hauptseminar Recent Advances in Computer Assisted Surgery
• Programmierpraktikum Graphikprogrammierung in C++

Summer Term 2005

• Praktikum 3D Computer Vision
• Lecture Intra-operative Imaging & Visualization

Winter Term 2004/2005

• Programmierpraktikum Graphikprogrammierung in C++
• Lecture Intra-operative Imaging & Visualization
• Seminar für Überfachliche Grundlagen Medizinische Informatik
• Hauptseminar Algorithms for Augmented and Virtual Reality

Summer Term 2004

• Hauptseminar Augmented Reality in Medicine
• Hauptseminar Methods and Tools in Medical Imaging

Theses, SEPs, and IDPs under my (Co-)Supervision

Available:

Current:

Finished:

• Optimized Workflow for Integration of Pre-operative Images into a Intra-operative Imaging Application by Dominik Zaeuner (Diploma Thesis)
• C-arm Motion Estimation without Radiation by Maximilian Springer (DA/MA/BA)
• Visual Servoing for Camera Augmented Mobile C-arm by Thomas Weich (IDP)
• Error Classification and Propagation for Electromagnetic Tracking by Julian Much (DA/MA/BA)
• CamC Artificial Fluoroscopy by Philipp Dressel (IDP)
• Online Error Correction for the Tracking of Laparoscopic Ultrasound by Tobias Reichl (Diploma Thesis)
• Fiducial-Free Registration Procedure for Navigated Bronchoscopy by Tassilo Klein (DA/MA/BA)
• Depth Control and UI for Camera Augmented Mobile C-arm by Philipp Dressel (SEP)
• Fast and efficient error correction of electromagnetic tracking and its application in prostate cancer treatment by Claudia Thormann (Diploma Thesis)
• Experiments and Validation of a Three-Dimensional Accelerometer in a Belt Buckle, ActiBelt, for Continuous Multiple Sclerosis Patient Monitoring by Thomas Gossner (Diploma Thesis)
• Gamma Probe Modelling and Calibration for SPECT Reconstruction by Alexander Hartl (IDP)
• Visual Servoing for CamC by Tassilo Klein (SEP)
• CamC Visual Servoing Interface by Tassilo Klein (SEP)
• User interface to create precalibrated tool description files by Miriam Wiegand (SEP)
• Navigated Flexible Procedures (Bronchoscopy) by Julian Much (SEP)
• Error Correction for Electromagnetic Tracking by Sukhbansbir Kaur (DA/MA/BA)
• Development of an automatic multimodal in-situ visualisation tool by Latifa Omary, Philipp Stefan (IDP)
• Evaluation of inside-out and outside-in pose estimation by Timo Gebhardt (SEP)
• Optical and Magnetic Tracking by Sintje Göritz (Diploma Thesis)
• Augmentation of Segmented Liver Data onto the Endoscope View by Stefan Wiesner (IDP)
• Analysing the Accuracy of the Fluoroscopic Navigation and Image Registration in an established Medical Software Application by Matthias Assel (Diploma Thesis)
• 3D view of stereo laparoscope in the operating room by Benjamin Stetter (SEP)
• Real-time Computation of Depth Maps with an Application to Occlusion Handling in Augmented Reality by Hauke Heibel (DA/MA/BA)

Awards

• April 18, 2005: "Werner von Siemens Excellence Award" for outstanding diploma thesis.
  Design of an Intra-Operative Augmented Reality Navigation Tool for Robotically Assisted Minimally Invasive Cardiovascular Surgery . Supervised by Martin Bauer, Hesam Najafi, and Prof. Gudrun Klinker. In collaboration with Deutsche Herzzentrum München (Eva Schirmbeck and PD Dr. Robert Bauernschmitt). Follow this link to see images of the ceremony at Siemens Forum.

Other Activities

• Student Volunteer Chair at ISMAR 2005 in Vienna, Austria
• Financial Chair and Panel Organizer at AMI-ARCS 2006 Workshop during MICCAI conference in Copenhagen, Denmark
• Workshop Coordinator of the 1st Iranian-German Workshop on Medical Engineering 2006 in Munich, Germany
• Exchange Program Coordination of the DAAD German Iranian - Avicenna Roentgen Collaboration
• Interview at the Open Day 2006 in Garching for the BR. (see inteview)
• Organization of AR Tutorial at MICCAI 2007 in Brisbane, Australia

Research Projects

heARt - Heart surgery Enhanced by Augmented Reality Techniques Minimally invasive or totally endoscopic cardiac surgery is an operation technique in which physicians operate through small incision points at the operating region, either using endoscopic tools or master-slave robot systems. In either case, the field of view of the physician is quite limited to a small area around the operating region. To get more general overview, preoprative imaging and planning data can be used through Augmented Reality techniques. PORT - pre-operative planning and intra-operative guidance and navigation for robotically assisted minimally invasive cardiovascular surgery: - Design of a Planning Tool for Port Placement in Robotically Assisted Minimally Invasive Cardiovascular Surgery (MarcoFeuerstein) - Design of an Intra-Operative Augmented Reality Navigation Tool for Robotically Assisted Minimally Invasive Cardiovascular Surgery (JoergTraub) STENT - pre-operative planning and navigation for STENT implantations: - Development of a Planning and Navigation Tool for Endoscopic Treatment of abdominal Aortic Aneurysms - Computer Supported Implantation of a Stent Graft (MartinGroher) - Mathematical Methods of Image Processing for Automated Navigation in Endoscopic Treatment of Abdominal Aortic Aneurisms - Computer Aided Implantation of a Stent Graft (PeterKeitler) The project started in March 2003 and finished in November 2003 as a bundle of diploma theses supervised by Prof. Gudrun Klinker (Fachgebiet Augmented Reality) and Prof. R. Bauernschmitt (German Heart Center). Many of the participants are now working at the Chair for Computer Aided Medical Procedures by Prof. Nassir Navab.

Navigated Bronchoscopy A common task during broncoscopy procedures is to biopsy peripheral lung tumors. The video bronchoscope is not capable to reach the peripheral lung nodes, but only the biopsy needle. Thus there is no video feedback, but only feedback of the current location of the biopsy tool by fluoroscopy imaging during the intervention. This exposes patient and surgical staff to additional radiation. Another drawback is that tumors can not be visualized on the fluoroscope images and they are only a projection, thus do not report the three dimensional position of the biopsy tool. Electromagnetic tracking is capable of tracking the tip of flexible instrument. A field generator with three orthogonal coils introduces current and thus generates a magnetic field. A sensor composed also of three orthogonal coils is capable to estimate its position and orientation with respect to a coordinate system defined by the field generator. Currently we investigate the combination of all available information for navigation and solutions to represent it in one unified user interface. This includes the measurements of the electromagnetic tracking system, the c-arm, techniques of virtual bronchoscopy, and other data. Furthermore, clinical evaluation is conducted. We define the clinical endpoint and show through studies that the procedure will benefit from the usage of the navigation system.

Real-time fusion of ultrasound and gamma probe for navigated localization of malignancy Intra-operative localization of non-superficial cancerous lesions in non-hollow organs like liver, kidney, etc is currently facilitated by intra-operative ultrasound (IOUS) and palpation. This yields a high rate of false positives due to benign abnormal regions and thus unnecessary resections with increased complications and morbidity. In this project we integrate functional nuclear information from gamma probes with IOUS, to provide a synchronized, real-time visualization that facilitates the detection of active tumors and metastases intra-operatively. The bet of this project is that the inclusion of an advanced, augmented visualization provides more reliability and confidence on classifying lesions prior to the resection.

Freehand SPECT for Sentinel Lymph Node Localization Nuclear medicine imaging modalities assist commonly in surgical guidance given their functional nature. However, when used in the operating room they present limitations. Pre-operative tomographic 3D imaging can only serve as a vague guidance intra-operatively, due to movement, deformation and changes in anatomy since the time of imaging, while standard intra-operative nuclear measurements are limited to 1D or (in some cases) 2D images with no depth information. To resolve this problem we propose the synchronized acquisition of position, orientation and readings of gamma probes intra-operatively to reconstruct a 3D activity volume. In contrast to conventional emission tomography, here, in a first proof-of-concept, the reconstruction succeeds without requiring symmetry in the positions and angles of acquisition, which allows greater flexibility and thus opens doors towards 3D intra-operative nuclear imaging.

3D user interfaces for medical interventions This work group aims at practical user interfaces for 3D imaging data in surgery and medical interventions. The usual monitor based visualization and mouse based interaction with 3D data will not present acceptable solutions. Here we study the use of head mounted displays and advanced interaction techniques as alternative solutions. Different issues such as depth perception in augmented reality environment and optimal data representation for a smooth and efficient integration into the surgical workflow are the focus of our research activities. Furthermore appropriate ways of interaction within the surgical environment are investigated.

Magneto-Optic Tracking of a Flexible Laparoscopic Ultrasound Transducer In abdominal surgery, a laparoscopic ultrasound transducer is commonly used to detect lesions such as metastases. The determination and visualization of position and orientation of its flexible tip in relation to the patient or other surgical instruments can be of much help to (novice) surgeons utilizing the transducer intraoperatively. This difficult subject has recently been paid attention to by the scientific community. Electromagnetic tracking systems can be applied to track the flexible tip. However, the magnetic field can be distorted by ferromagnetic material. We present a new method based on optical tracking of the laparoscope and magneto-optic tracking of the transducer, which is able to automatically detect and correct field distortions. This is used for a smooth augmentation of the B-scan images of the transducer directly on the camera images in real time.

Port Placement in Minimally Invasive Endoscopic Surgery Optimal port placement is a delicate issue in minimally invasive endoscopic surgery. A good choice of the instruments' and endoscope's ports can avoid time-consuming consecutive new port placement. We present a novel method to intuitively and precisely plan the port placement. The patient is registered to its pre-operative CT by just moving the endoscope around fiducials, which are attached to the patient's thorax and are visible in its CT. Their 3D positions are automatically reconstructed. Without prior time-consuming segmentation, the pre-operative CT volume is directly rendered with respect to the endoscope or instruments. This enables the simulation of a camera flight through the patient's interior along the instruments' axes to easily validate possible ports.

Laparoscope Augmentation for Minimally Invasive Liver Resection In recent years, an increasing number of liver tumor indications were treated by minimally invasive laparoscopic resection. Besides the restricted view, a major issue in laparoscopic liver resection is the precise localization of the vessels to be divided. To navigate the surgeon to these vessels, pre-operative imaging data can hardly be used due to intra-operative organ deformations caused by appliance of carbon dioxide pneumoperitoneum and respiratory motion. Therefore, we propose to use an optically tracked mobile C-arm providing cone-beam computed tomography imaging capability intra-operatively. After patient positioning, port placement, and carbon dioxide insufflation, the liver vessels are contrasted and a 3D volume is reconstructed during patient exhalation. Without any further need for patient registration, the volume can be directly augmented on the live laparoscope video. This augmentation provides the surgeon with essential aid in the localization of veins, arteries, and bile ducts to be divided or sealed. Current research focuses on the intra-operative use and tracking of mobile C-arms as well as laparoscopic ultrasound, augmented visualization on the laparoscope's view, and methods to synchronize respiratory motion.

Intra-operative Beta Probe Surface Imaging and Navigation for Optimal Tumor Resection In minimally invasive tumor resection, the goal is to perform a minimal but complete removal of cancerous cells. In the last decades interventional beta probes supported the detection of remaining tumor cells. However, scanning the patient with an intraoperative probe and applying the treatment are not done simultaneously. The main contribution of this work is to extend the one dimensional signal of a nuclear probe to a four dimensional signal including the spatial information of the distal end of the probe. This signal can be then used to guide the surgeon in the resection of residual tissue and thus increase its spatial accuracy while allowing minimal impact on the patient.

Discovery and Detection of Surgical Activity in Percutaneous Vertebroplasties In this project, we aim at discovering automatically the workflow of percutaneous vertebroplasty. The medical framework is quite different from a parallel project , where we analyze laparoscopic surgeries. Contrary to cholecystectomies where much information is provided by the surgical tools and by the endoscopic video, in vertebroplasties and kyphoplasties, we believe that the body and hand movement of the surgeon give a key insight into the surgical activity. Surgical movements like hammering of the trocar into the vertebra or the stirring of cement compounds are indicative of the current workflow phase. The objectives of this project are to acquire the workflow related signals using accelerometers, processing the raw signals and detecting recurrent patterns in order to objectively identify the low-level and high-level workflow of the procedure.

Coffee Consumption Histogram

3 47 79 47 37 39 36 36 38 24 6 1 1 1 7 8 9 10 11 12 13 14 15 16 17 18 20 22 Joerg Traub Coffee Consumption Table

The quantity of coffee I drink between 8am and 5pm (17).