Augmented Reality - Medical Augmented Reality - Winter Term 2020/2021
Administrative Info
Lecture by Prof. Nassir Navab, Dr. Daniel Roth
Exercises by Alejandro Martin, Alexander Winkler, Matthias Grimm, Evin Pinar Örnek
Type: Lecture IN2293
Programs: Informatics (Bachelor, Master)
Biomedical Computing (Master)
Computational Science and Engineering (Master)
Wirtschaftsinformatik (Bachelor, Master)
SWS: 2+2
ECTS: 5 Credits
Course Language: English
Contact: Alexander Winkler
(on appointment, send an email beforehand)
|
Time, Location & Requirements
Lecture & Exercise: Tuesday (12:00-13:30) & Thursday (16:00-17:30)
Course information and certificate requirements:
- Lectures and exercises will be held in English.
- Exercises will consist of practical (Unity3D) and theoretical tasks.
- We originally planned to have one final handwritten exam. But due to the COVID19 TUM regulations we cannot perform an on site exam. Therefore it was changed into an online graded exercise. Details are available on Moodle.
- NOTE: There will be NO repeat exam!
- All the material will be made available on TUM-Moodle (www.moodle.tum.de)
|
Site Content
|
Announcements
- Lecture & Exercise schedule updated
- (Zoom Passwords will be made available in Moodle)
|
Projects
Hands-on projects will play a major in this course, which will make up a portion of the final grade. Three different options are available:
- i) Hololens project with Unity
- ii) AR desktop application with Unity and Vuforia
- iii) Mobile AR application with Unity and Vuforia
During the exercises we will teach the basics of creating an AR application in Unity (version 2019.4). Due to hardware constraints, it will not be possible for all students to work with the Microsoft Hololens. To still provide a fair chance to everybody, there will a project pitch session before christmas during which you will present (in groups of 3-4 students) your project idea. The best projects will be selected and implemented using the Hololens. All other projects will be implemented as AR desktop applications or mobile AR applications with a camera and marker tracking.
As we do not know about Corona restrictions yet, we will come up with a fair process to allow for these projects with distributed teams and hygienic hardware access.
Topics
In this lecture we will cover many topics, including, but not limited to:
- Transformations & Coordinate Systems
- Computer Vision
- Parameter Estimation
- Spatial Relationship Graphs
- Visual System & Perception
- Anatomy Visualization
- Head Mounted Displays
- Sensing Technologies & Reconstruction
- Tracking
- Validation
- Sonification
- User Interaction & Input Devices
- History of Medical AR
- Rendering
PRELIMINARY Lecture & Exercise Schedule
*(Zoom Passwords will be made available in Moodle)
*(Zoom Passwords will be made available in Moodle)
General Literature on Lecture Content
- R.Hartley and A.Zisserman: Multiple View Geometry in Computer Vision; Cambridge University Press, 2004. Online version
- D.Ballard and C.Brown: Computer Vision. Online version
- R.Tsai: A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision. Download from CALTECH.
- J.Rolland, L.Davis, Y. Baillot: A Survey of Tracking Technology for Virtual Environments; in Fundamentals of Wearable Computers and Augmented, 2001. Download from UPenn.
- D.Allen, G.Bishop, G.Welch: Tracking - Beyond 15 Minutes of Thought; Course 11 at Siggraph 2001. Download from UNC.
- J.Rolland, H. Fuchs: Optical versus See-Through Head-Mounted Displays; in Fundamentals of Wearable Computers and Augmented, 2001. Download from citeseer.
- M.Tuceryan, Y.Genc, N.Navab: Single Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration; in Presence: Teleoperators and Virtual Environments, 11(3), 2002. Download from M. Tuceryan's home page.
- P.Milgram, Colquhoun: A Taxonomy of Real and Virtual World Display Integration; in Proc. International Symposium of Mixed Reality (ISMR 1999). Download from ebookbrowse.
- M.Weiser: The Computer for the Twenty-First Century; Scientific American, 1991. Download from ubiq.com.
- R. Szeliski: Computer Vision - Algorithms and Applications, Springer Verlag, 2011. Online Version
Unity
