TeachingWs20MedAR

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Augmented Reality - Medical Augmented Reality - Winter Term 2020/2021

Administrative Info

Lecture by Prof. Nassir Navab, Dr. Daniel Roth
Exercises by Alejandro Martin, Alexander Winkler, Matthias Grimm, Evin Pinar Örnek

Type: Lecture IN2293
Programs: Informatics (Bachelor, Master)
Biomedical Computing (Master)
Computational Science and Engineering (Master)
Wirtschaftsinformatik (Bachelor, Master)
SWS: 2+2
ECTS: 5 Credits
Course Language: English
Contact: Alexander Winkler
(on appointment, send an email beforehand)

Time, Location & Requirements

Lecture & Exercise: Tuesday (12:00-13:30) & Thursday (16:00-17:30)

Course information and certificate requirements:

  • Lectures and exercises will be held in English.
  • Exercises will consist of practical (Unity3D) and theoretical tasks.
  • We originally planned to have one final handwritten exam. But due to the COVID19 TUM regulations we cannot perform an on site exam. Therefore it was changed into an online graded exercise. Details are available on Moodle.
  • NOTE: There will be NO repeat exam!
  • All the material will be made available on TUM-Moodle (www.moodle.tum.de)

Site Content

Announcements

  • Lecture & Exercise schedule updated
  • (Zoom Passwords will be made available in Moodle)

Projects

Hands-on projects will play a major in this course, which will make up a portion of the final grade. Three different options are available:

  • i) Hololens project with Unity
  • ii) AR desktop application with Unity and Vuforia
  • iii) Mobile AR application with Unity and Vuforia

During the exercises we will teach the basics of creating an AR application in Unity (version 2019.4). Due to hardware constraints, it will not be possible for all students to work with the Microsoft Hololens. To still provide a fair chance to everybody, there will a project pitch session before christmas during which you will present (in groups of 3-4 students) your project idea. The best projects will be selected and implemented using the Hololens. All other projects will be implemented as AR desktop applications or mobile AR applications with a camera and marker tracking.

As we do not know about Corona restrictions yet, we will come up with a fair process to allow for these projects with distributed teams and hygienic hardware access.

Topics

In this lecture we will cover many topics, including, but not limited to:

  • Transformations & Coordinate Systems
  • Computer Vision
  • Parameter Estimation
  • Spatial Relationship Graphs
  • Visual System & Perception
  • Anatomy Visualization
  • Head Mounted Displays
  • Sensing Technologies & Reconstruction
  • Tracking
  • Validation
  • Sonification
  • User Interaction & Input Devices
  • History of Medical AR
  • Rendering

PRELIMINARY Lecture & Exercise Schedule

*(Zoom Passwords will be made available in Moodle)

Day Date Time Type Topic Place Zoom ID (Password --> see TUMonline)
Tue 03.11.2020 12.00-13.30 Lecture Introduction to AR Zoom 970 6944 5542
Thu 05.11.2020 16.00-17.30 Lecture The Historical View into the Human Body Zoom 937 3726 3881
Tue 10.11.2020 12.00-13.30 Lecture Transformations & Coordinate Systems Zoom 970 6944 5542
Thu 12.11.2020 16.00-17.30 Exercise Tool Installation and Transformations Zoom 937 3726 3881
Tue 17.11.2020 12.00-13.30 Lecture Parameter Estimation Zoom 970 6944 5542
Thu 19.11.2020 16.00-17.30 Lecture Camera Models Zoom 937 3726 3881
Tue 24.11.2020 12.00-13.30 Lecture Camera Models Part 2 (Calibration) Zoom 970 6944 5542
Thu 26.11.2020 16.00-17.30 Exercise Homography, Camera Models, Camera Calibration Zoom 937 3726 3881
Tue 01.12.2020 12.00-13.30 Lecture Tracking Technologies and Spatial Relationship Graphs Zoom 970 6944 5542
Thu 03.12.2020 16.00-17.30 -- No Lecture, dies academicus    
Tue 08.12.2020 12.00-13.30 Lecture Head Mounted Displays Zoom 970 6944 5542
Thu 10.12.2020 16.00-17.30 Lecture Visual System & Perception Zoom 937 3726 3881
Tue 15.12.2020 12.00-13.30 Exercise Vuforia, Tracking and HMDs Zoom 970 6944 5542
Thu 17.12.2020 16.00-17.30 Lecture Sonic Interaction Design for Medical Zoom 937 3726 3881
Tue 22.12.2020 12.00-13.30 Projects Project Kickoff Zoom 970 6944 5542
Thu 07.01.2021 16.00-17.30 Exercise Sonic Interaction Design for Medical Zoom 937 3726 3881
Tue 12.01.2021 12.00-13.30 Project Project Presentation Zoom 970 6944 5542
Thu 14.01.2021 16.00-17.30 Lecture User Interaction & Input Devices Zoom 937 3726 3881
Tue 19.01.2021 12.00-13.30 Lecture Perspective-n-Point Zoom 970 6944 5542
Thu 21.01.2021 16.00-17.30 Lecture Sensing Technologies & Reconstruction Zoom 937 3726 3881
Tue 26.01.2021 12.00-13.30 Lecture Rendering Zoom 970 6944 5542
Thu 28.01.2021 16.00-17.30 Exercise Rendering Zoom 937 3726 3881
Tue 02.02.2021 12.00-13.30 Lecture State of the Art in Medical AR Zoom 970 6944 5542
Thu 04.02.2021 16.00-17.30 Lecture CAM-C Zoom 937 3726 3881
Tue 09.02.2021 12.00-13.30 Exercise Exam Preparation Q&A Zoom 970 6944 5542
Thu 15.02.2021 14.00-16.00 Projects Final Presentations (Presentation & Demos) Zoom  

*(Zoom Passwords will be made available in Moodle)

General Literature on Lecture Content

  • R.Hartley and A.Zisserman: Multiple View Geometry in Computer Vision; Cambridge University Press, 2004. Online version
  • D.Ballard and C.Brown: Computer Vision. Online version
  • R.Tsai: A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision. Download from CALTECH.
  • J.Rolland, L.Davis, Y. Baillot: A Survey of Tracking Technology for Virtual Environments; in Fundamentals of Wearable Computers and Augmented, 2001. Download from UPenn.
  • D.Allen, G.Bishop, G.Welch: Tracking - Beyond 15 Minutes of Thought; Course 11 at Siggraph 2001. Download from UNC.
  • J.Rolland, H. Fuchs: Optical versus See-Through Head-Mounted Displays; in Fundamentals of Wearable Computers and Augmented, 2001. Download from citeseer.
  • M.Tuceryan, Y.Genc, N.Navab: Single Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration; in Presence: Teleoperators and Virtual Environments, 11(3), 2002. Download from M. Tuceryan's home page.
  • P.Milgram, Colquhoun: A Taxonomy of Real and Virtual World Display Integration; in Proc. International Symposium of Mixed Reality (ISMR 1999). Download from ebookbrowse.
  • M.Weiser: The Computer for the Twenty-First Century; Scientific American, 1991. Download from ubiq.com.
  • R. Szeliski: Computer Vision - Algorithms and Applications, Springer Verlag, 2011. Online Version

Unity


TeachingForm
Title: Medical Augmented Reality
Professor: Prof. Nassir Navab, Dr. Daniel Roth
Tutors: Alejandro Martin, Alexander Winkler, Matthias Grimm, Evin Pinar Örnek
Type: Lecture
Information: 2 + 2 SWS, 5 ECTS Credits (IN2293)
Term: 2020WiSe
Abstract:  


Edit | Attach | Refresh | Diffs | More | Revision r1.7 - 03 Feb 2021 - 17:41 - AlexanderWinkler

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif