TeachingWs17MedAR

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Augmented Reality - Medical Augmented Reality - Winter Term 2017/2018

Administrative Info

Lecture by Prof. Nassir Navab
Exercises by Ulrich Eck, Felix Bork, Jakob Weiss, Alexander Winkler

Type: Lecture IN2293
Programs: Informatics (Bachelor, Master)
Biomedical Computing (Master)
Computational Science and Engineering (Master)
Wirtschaftsinformatik (Bachelor, Master)
SWS: 2+2
ECTS: 5 Credits
Course Language: English
Contact: Felix Bork
(on appointment, send an email beforehand)

NOTE: Only exercise solutions of the theoretic parts will be posted on the web-site.

Time, Location & Requirements

Course information and certificate requirements:

  • The classes as well as the exercises will be held in English.
  • Exercises will consist of practical and theoretical tasks. Practical exercises will be done in Unity.
  • The lecture consists of one final exam, which will be hand written and a closed-book exam (no notes allowed)
  • NOTE: There will be NO repeat exam!

Site Content

Announcements

  • 08/09: Registration on TUMOnline is possible
  • 09/09: Lecture & Exercise schedule updated
  • 17/10: Information about projects posted

Projects

It will be possible to gain a grade bonus of 0.3 by working on a project during the course. Three different options are available:

  • i) Hololens project with Unity
  • ii) AR desktop application with Unity and Vuforia
  • iii) Literature review

Due to hardware constraints, it will not be possible for all students to work with the Hololens. In order to still provide a fair chance to everybody, there will a project pitch session before christmas during which you will present (in groups of 3-4 students) your project idea using a single slide. The best projects will be selected and implemented using the Hololens. All other projects will be implemented as AR desktop application with a webcam and marker tracking. Requests for literature reviews (including topic preferences) have to be sent to one of the tutors before the project pitch session.

Access to the Hololenses in Garching will be provided as follows:

  • There are two devices available. Access is first-come first-serve.
  • The devices will be handed out for two-hour slots, which you can prolong unless another group requests access.
  • You will need to provide a signature+deposit (some kind of ID) to borrow the device
  • Access is provided on Tuesdays, Thursdays and Fridays between 10:00 AM and ~5:00 PM, where you can just come to office 03.13.53.
  • Outside of those hours, contact Jakob Weiss to see if it might still be possible.

Access to the Hololenses in the NARVIS lab (close to Sendlinger Tor) will be provided as follows:

  • There are two devices available. Access is first-come first-serve.
  • The devices will be handed out for two-hour slots, which you can prolong unless another group requests access.
  • You will need to provide a signature+deposit (some kind of ID) to borrow the device
  • Access is provided on Mondays, Tuesdays, Wednesdays and Thursdays between 10:00 AM and ~5:00 PM
  • Please contact Alexander Winkler the day before to make sure that a Hololens is available
  • Outside of those hours, contact Alexander Winkler to see if it might still be possible.

Preliminary Lecture & Exercise Schedule

Date Time Place Material/Literature Topic Conducted by Material
19.10.2017 16:00 - 17:30 00.04.011 (MI HS 2) Lecture Introduction + Administrative Dr. Ulrich Eck  Administrative,  Introduction to AR
24.10.17 12:00 - 13:30 03.13.010 Exercise Introduction + Hololens Intro Prof. Nassir Navab, Alexander Winkler  Introduction to Medical AR,  Exercise 01
26.10.17 16:00 - 17:30 00.04.011 (MI HS 2) Lecture Transformations & Coordinate Systems Felix Bork Slides
02.11.17 16:00 - 17:30 00.04.011 (MI HS 2) Lecture Parameter Estimation Felix Bork Slides
07.11.17 12:00 - 13:30 03.13.010 Exercise Unity Setup, Transformations and Homography Alexander Winkler  Exercise2, Solutions2
09.11.17 16:00 - 17:30 00.04.011 (MI HS 2) Lecture Camera Models & Camera Calibration Felix Bork Slides
14.11.17 12:00 - 13:30 03.13.010 Exercise Camera Undistortion and Marker Tracking Alexander Winkler  Exercise2, Solutions3
16.11.17 16:30 - 18:00 CH 26411 (Emil-Erlenmeyer-HS) Lecture HMDs (Technology & Human Factors) Dr. Ulrich Eck  slides
21.11.17 12:00 - 13:30 03.13.010 Exercise Marker Tracking and Unity Scripting basics Alexander Winkler  Exercise4, Solutions4
23.11.17 16:00 - 17:30 00.04.011 (MI HS 2) Lecture HMDs (Calibration) Dr. Ulrich Eck  slides
28.11.17 12:00 - 13:30 03.13.010 Exercise OST-Calibration, Quaternions and shaders Alexander Winkler  Exercise5, Solutions5
30.11.17 16:30 - 18:00 CH 26411 (Emil-Erlenmeyer-HS) Lecture Tracking & Navigation Dr. Ulrich Eck  slides
05.12.17 12:00 - 13:30 03.13.010 Exercise Projection Matrices and transformations Alexander Winkler  Exercise6, Solutions6
07.12.17 16:00 - 17:30 00.04.011 (MI HS 2) Lecture Two View Geometry I Jakob Weiss Slides
12.12.17 12:00 - 13:30 03.13.010 Exercise Fundamental Matrix Alexander Winkler  Exercise7, Solutions7
14.12.17 16:30 - 18:00 CH 26411 (Emil-Erlenmeyer-HS) Lecture Two View Geometry II Jakob Weiss Slides (new!)
19.12.17 12:00 - 13:30 03.13.010 Project Pitch Session Presentations of Project Ideas    
11.01.18 16:00 - 17:30 00.04.011 (MI HS 2) Lecture Depth Perception + Visualization Jakob Weiss Slides
18.01.18 16:30 - 18:00 CH 26411 (Emil-Erlenmeyer-HS) Lecture Camera-Augmented C-Arm Dr. Ulrich Eck Slides
25.01.18 16:00 - 17:30 00.04.011 (MI HS 2) Lecture TBD    
01.02.18 16:00 - 17:30 00.04.011 (MI HS 2) Lecture TBD    
08.02.18 16:00 - 17:30 00.04.011 (MI HS 2) Lecture Project Presentations    
19.02.18 13:30 - 15:00 2501, Rudolf-Mößbauer-Hörsaal (5101.EG.501) Final Exam     MockExamQuestions MockExamQuestionsSolution

Literature Review Topics

Topic Papers
3D Slam Paper 1 Paper 2
Calibration & Distortion Paper 1 Paper 2
HMD Measurements Paper 1 Paper 2
HMD Display Technologies Paper 1 Paper 2
Perceptual Visualization Paper 1 Paper 2
Photorealistic Rendering Paper 1 Paper 2

General Literature on Lecture Content

  • R.Hartley and A.Zisserman: Multiple View Geometry in Computer Vision; Cambridge University Press, 2004. Online version
  • D.Ballard and C.Brown: Computer Vision. Online version
  • R.Tsai: A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision. Download from CALTECH.
  • J.Rolland, L.Davis, Y. Baillot: A Survey of Tracking Technology for Virtual Environments; in Fundamentals of Wearable Computers and Augmented, 2001. Download from UPenn.
  • D.Allen, G.Bishop, G.Welch: Tracking - Beyond 15 Minutes of Thought; Course 11 at Siggraph 2001. Download from UNC.
  • J.Rolland, H. Fuchs: Optical versus See-Through Head-Mounted Displays; in Fundamentals of Wearable Computers and Augmented, 2001. Download from citeseer.
  • M.Tuceryan, Y.Genc, N.Navab: Single Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration; in Presence: Teleoperators and Virtual Environments, 11(3), 2002. Download from M. Tuceryan's home page.
  • P.Milgram, Colquhoun: A Taxonomy of Real and Virtual World Display Integration; in Proc. International Symposium of Mixed Reality (ISMR 1999). Download from ebookbrowse.
  • M.Weiser: The Computer for the Twenty-First Century; Scientific American, 1991. Download from ubiq.com.
  • R. Szeliski: Computer Vision - Algorithms and Applications, Springer Verlag, 2011. Online Version

Unity


TeachingForm
Title: Medical Augmented Reality
Professor: Prof. Nassir Navab
Tutors: Ulrich Eck, Felix Bork, Jakob Weiss, Alexander Winkler
Type: Lecture
Information: 2 + 2 SWS, 5 ECTS Credits IN2293
Term: 2017WiSe
Abstract:  


Edit | Attach | Refresh | Diffs | More | Revision r1.48 - 16 Feb 2018 - 14:33 - FelixBork

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif