Augmented Reality - Medical Augmented Reality - Winter Term 2017/2018
Administrative Info
Lecture by Prof. Nassir Navab
Exercises by Ulrich Eck, Felix Bork, Jakob Weiss, Alexander Winkler
Type: Lecture IN2293
Programs: Informatics (Bachelor, Master)
Biomedical Computing (Master)
Computational Science and Engineering (Master)
Wirtschaftsinformatik (Bachelor, Master)
SWS: 2+2
ECTS: 5 Credits
Course Language: English
Contact: Felix Bork (on appointment, send an email beforehand)
NOTE: Only exercise solutions of the theoretic parts will be posted on the web-site.
|
Time, Location & Requirements
Course information and certificate requirements:
- The classes as well as the exercises will be held in English.
- Exercises will consist of practical and theoretical tasks. Practical exercises will be done in Unity.
- The lecture consists of one final exam, which will be hand written and a closed-book exam (no notes allowed)
- NOTE: There will be NO repeat exam!
|
Site Content
|
Announcements
- 08/09: Registration on TUMOnline is possible
- 09/09: Lecture & Exercise schedule updated
- 17/10: Information about projects posted
|
Projects
It will be possible to gain a grade bonus of 0.3 by working on a project during the course. Three different options are available:
- i) Hololens project with Unity
- ii) AR desktop application with Unity and Vuforia
- iii) Literature review
Due to hardware constraints, it will not be possible for all students to work with the Hololens. In order to still provide a fair chance to everybody, there will a project pitch session before christmas during which you will present (in groups of 3-4 students) your project idea using a single slide. The best projects will be selected and implemented using the Hololens. All other projects will be implemented as AR desktop application with a webcam and marker tracking. Requests for literature reviews (including topic preferences) have to be sent to one of the tutors before the project pitch session.
Access to the Hololenses
in Garching will be provided as follows:
- There are two devices available. Access is first-come first-serve.
- The devices will be handed out for two-hour slots, which you can prolong unless another group requests access.
- You will need to provide a signature+deposit (some kind of ID) to borrow the device
- Access is provided on Tuesdays, Thursdays and Fridays between 10:00 AM and ~5:00 PM, where you can just come to office 03.13.53.
- Outside of those hours, contact Jakob Weiss to see if it might still be possible.
Access to the Hololenses in the
NARVIS lab (close to Sendlinger Tor) will be provided as follows:
- There are two devices available. Access is first-come first-serve.
- The devices will be handed out for two-hour slots, which you can prolong unless another group requests access.
- You will need to provide a signature+deposit (some kind of ID) to borrow the device
- Access is provided on Mondays, Tuesdays, Wednesdays and Thursdays between 10:00 AM and ~5:00 PM
- Please contact Alexander Winkler the day before to make sure that a Hololens is available
- Outside of those hours, contact Alexander Winkler to see if it might still be possible.
Preliminary Lecture & Exercise Schedule
Literature Review Topics
General Literature on Lecture Content
- R.Hartley and A.Zisserman: Multiple View Geometry in Computer Vision; Cambridge University Press, 2004. Online version
- D.Ballard and C.Brown: Computer Vision. Online version
- R.Tsai: A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision. Download from CALTECH.
- J.Rolland, L.Davis, Y. Baillot: A Survey of Tracking Technology for Virtual Environments; in Fundamentals of Wearable Computers and Augmented, 2001. Download from UPenn.
- D.Allen, G.Bishop, G.Welch: Tracking - Beyond 15 Minutes of Thought; Course 11 at Siggraph 2001. Download from UNC.
- J.Rolland, H. Fuchs: Optical versus See-Through Head-Mounted Displays; in Fundamentals of Wearable Computers and Augmented, 2001. Download from citeseer.
- M.Tuceryan, Y.Genc, N.Navab: Single Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration; in Presence: Teleoperators and Virtual Environments, 11(3), 2002. Download from M. Tuceryan's home page.
- P.Milgram, Colquhoun: A Taxonomy of Real and Virtual World Display Integration; in Proc. International Symposium of Mixed Reality (ISMR 1999). Download from ebookbrowse.
- M.Weiser: The Computer for the Twenty-First Century; Scientific American, 1991. Download from ubiq.com.
- R. Szeliski: Computer Vision - Algorithms and Applications, Springer Verlag, 2011. Online Version
Unity