TeachingWs20MedAR

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Augmented Reality - Medical Augmented Reality - Winter Term 2020/2021

Administrative Info

Lecture by Prof. Nassir Navab, Dr. Daniel Roth
Exercises by Alejandro Martin, Alexander Winkler, Matthias Grimm, Evin Pinar Örnek

Type: Lecture IN2293
Programs: Informatics (Bachelor, Master)
Biomedical Computing (Master)
Computational Science and Engineering (Master)
Wirtschaftsinformatik (Bachelor, Master)
SWS: 2+2
ECTS: 5 Credits
Course Language: English
Contact: Alexander Winkler
(on appointment, send an email beforehand)

Time, Location & Requirements

Lecture & Exercise: Tuesday (12:00-13:30) & Thursday (16:00-17:30)

Course information and certificate requirements:

  • The classes as well as the exercises will be held in English.
  • Exercises will consist of practical and theoretical tasks. Practical exercises will be done in Unity.
  • The lecture consists of one final exam, which will be hand written and a closed-book exam (no notes allowed)
  • NOTE: There will be NO repeat exam!
  • All the material for the course will be made available on TUM-Moodle (www.moodle.tum.de)

Site Content

Announcements

Projects

Hands-on projects will play a major in this course, which will make up a portion of the final grade. Three different options are available:

  • i) Hololens project with Unity
  • ii) AR desktop application with Unity and Vuforia
  • iii) Mobile AR application with Unity and Vuforia

During the exercises we will teach the basics of creating an AR application in Unity (version 2019.4). Due to hardware constraints, it will not be possible for all students to work with the Microsoft Hololens. To still provide a fair chance to everybody, there will a project pitch session before christmas during which you will present (in groups of 3-4 students) your project idea. The best projects will be selected and implemented using the Hololens. All other projects will be implemented as AR desktop applications or mobile AR applications with a camera and marker tracking.

As we do not know about Corona restrictions yet, we will come up with a fair process to allow for these projects with distributed teams and hygienic hardware access.

Topics

In this lecture we will cover many topics, including, but not limited to:

  • Transformations & Coordinate Systems
  • Computer Vision
  • Parameter Estimation
  • Spatial Relationship Graphs
  • Visual System & Perception
  • Anatomy Visualization
  • Head Mounted Displays
  • Sensing Technologies & Reconstruction
  • Tracking
  • Validation
  • Sonification
  • User Interaction & Input Devices
  • History of Medical AR
  • Rendering

PRELIMINARY Lecture & Exercise Schedule

Day Time Place Type Topic
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Introduction to AR
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture The Historical View into the Human Body
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Lecture Visual System & Perception
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Transformations & Coordinate Systems
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Exercise Preparation & Tool Installation
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Parameter Estimation
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Exercise Computer Vision
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Camera Models
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Exercise Pinhole Camera Model, Camera Calibration
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Head Mounted Displays
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Lecture Sensing Technologies & Reconstruction
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Camera Calibration Part 2
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Exercise Tracking
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Sonification
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Projects Project Proposals
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Spatial Relationship Graphs
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Lecture User Interaction & Input Devices
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Projects Kickoff Projects
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Lecture Keypoint-based Methods
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Rendering
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Lecture Rendering II
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Exercise Rendering
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Lecture State of the Art in Medical AR
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Projects Meet the Mentors + How to Present your Poster
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Lecture CAM-C
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Lecture Challenges in HMD-based AR
Thu 16:00 - 17:30 00.04.011, MI Hörsaal 2 (5604.EG.011) Projects Meet the Mentors
Tue 12:00 - 13:30 03.13.010, Seminarraum (5613.03.010) Exercise Exam Preparation
Thu 16:00 - 17:30 03.13.010, Seminarraum (5613.03.010) Projects Final Presentations (Posters & Demos)

General Literature on Lecture Content

  • R.Hartley and A.Zisserman: Multiple View Geometry in Computer Vision; Cambridge University Press, 2004. Online version
  • D.Ballard and C.Brown: Computer Vision. Online version
  • R.Tsai: A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision. Download from CALTECH.
  • J.Rolland, L.Davis, Y. Baillot: A Survey of Tracking Technology for Virtual Environments; in Fundamentals of Wearable Computers and Augmented, 2001. Download from UPenn.
  • D.Allen, G.Bishop, G.Welch: Tracking - Beyond 15 Minutes of Thought; Course 11 at Siggraph 2001. Download from UNC.
  • J.Rolland, H. Fuchs: Optical versus See-Through Head-Mounted Displays; in Fundamentals of Wearable Computers and Augmented, 2001. Download from citeseer.
  • M.Tuceryan, Y.Genc, N.Navab: Single Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration; in Presence: Teleoperators and Virtual Environments, 11(3), 2002. Download from M. Tuceryan's home page.
  • P.Milgram, Colquhoun: A Taxonomy of Real and Virtual World Display Integration; in Proc. International Symposium of Mixed Reality (ISMR 1999). Download from ebookbrowse.
  • M.Weiser: The Computer for the Twenty-First Century; Scientific American, 1991. Download from ubiq.com.
  • R. Szeliski: Computer Vision - Algorithms and Applications, Springer Verlag, 2011. Online Version

Unity


TeachingForm
Title: Medical Augmented Reality
Professor: Prof. Nassir Navab, Dr. Daniel Roth
Tutors: Alejandro Martin, Alexander Winkler, Matthias Grimm, Evin Pinar Örnek
Type: Lecture
Information: 2 + 2 SWS, 5 ECTS Credits (IN2293)
Term: 2020WiSe
Abstract:  


Edit | Attach | Refresh | Diffs | More | Revision r1.2 - 18 Sep 2020 - 11:39 - AlexanderWinkler

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif