Augmented Reality - Medical Augmented Reality - Winter Term 2018/2019

Administrative Info Lecture by Prof. Nassir Navab Exercises by Felix Bork, Huseyin Coscun, Alejandro Martin, Alexander Winkler Type: Lecture IN2293 Programs: Informatics (Bachelor, Master) Biomedical Computing (Master) Computational Science and Engineering (Master) Wirtschaftsinformatik (Bachelor, Master) SWS: 2+2 ECTS: 5 Credits Course Language: English Contact: Felix Bork (on appointment, send an email beforehand)

Time, Location & Requirements Lecture & Exercise: Tuesday (12:00-13:30) & Thursday (16:00-17:30) Course information and certificate requirements: The classes as well as the exercises will be held in English. Exercises will consist of practical and theoretical tasks. Practical exercises will be done in Unity. The lecture consists of one final exam, which will be hand written and a closed-book exam (no notes allowed) NOTE: There will be NO repeat exam!

Site Content Projects Preliminary Lecture & Exercise Schedule Literature Review Topics General Literature on Lecture Content Unity

Announcements 03/09: Registration on TUMOnline is possible 05/09: Lecture & Exercise schedule updated

Projects

IMPORTANT: The Final Project Presentation session was moved to Friday, 8th of February 2019, 15:00 - 18:00. Please make sure to attend. Also the deadline for the poster submission was moved to Monday, 4th of February 2019 9:00 to get your posters printed in time.

Preliminary Lecture & Exercise Schedule

Day	Date	Time	Place	Type	Topic	Conducted by	Material
Tue	16.10.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Lecture	Introduction to AR	Prof. Dr. Nassir Navab	Introduction
Thu	18.10.18	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Lecture	Transformations & Coordinate Systems	Prof. Dr. Nassir Navab	Transformations
Tue	23.10.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Lecture	Parameter Estimation	Prof. Dr. Nassir Navab	Parameter Estimation
Thu	25.10.18	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Exercise	Practical: Preparation & Tool Installation	Alexander Winkler	Slides,  Exercise1,  Solution1
Tue	30.10.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Exercise	Theoretical: Computer Vision	Alexander Winkler	Slides,  Exercise2,  Solution2
Tue	06.11.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Lecture	Parameter Estimation 2	Prof. Dr. Nassir Navab
Thu	08.11.18	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Lecture	Camera Models	Prof. Dr. Nassir Navab	Camera Models
Tue	13.11.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Lecture	Camera Models 2	Prof. Dr. Nassir Navab
Thu	15.11.18	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Exercise	Theoretical: Pinhole camera model and distortion	Alexander Winkler	Slides, Exercise3, Solution3
Tue	20.11.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Lecture	Sensing Technologies & Reconstruction	Tolga Birdal	Sensing Technologies & Reconstruction
Thu	22.11.18	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Lecture	State of the Art in Medical AR	Prof. Dr. Nassir Navab	State of the Art in Medical AR
Tue	27.11.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Projects	Project Presentations	All Tutors	Project Presentation
Thu	29.11.18	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Lecture	AR/VR HMDs	Alexander Winkler	AR VR HMDs
Tue	04.12.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Exercise	Practical & Theoretical: Computer Vision & Tracking Techniques	Alexander Winkler	Slides, Exercise4, Solution4
Thu	06.12.18	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Lecture	Visual System & Perception	Alejandro Martin	Visual System and Perception
Tue	11.12.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Lecture	Rendering	Jakob Weiss	Rendering I
Thu	13.12.18	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Lecture	SLAM Tracking Techniques	Patrick Ruhkamp	SLAM Tracking Techniques
Tue	18.12.18	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Projects	Kickoff-Presentations	All Tutors
Thu	20.12.18	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Exercise	Rendering	Jakob Weiss	Slides, Exercise5, Solution5
Tue	08.01.19	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Lecture	User Interaction & Input Devices	Matthias Grimm	User Interaction & Input Devices
Thu	10.01.19	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Projects	Project Progress / Presentation Preparation	All Tutors	How to Present a Poster
Tue	15.01.19	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Lecture	Synchronization & Lag	Dr. Ulrich Eck	Synchronization & Lag
Thu	17.01.19	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Lecture	Light Fields Reloaded	Invited Talk: Oliver Bimber	Video Lecture GDC18,   TUM Lecture Slideshow
Tue	22.01.19	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Projects	Project Progress / Auditory AR	Sasan Matinfar + All Tutors	Sonification
Thu	24.01.19	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Lecture	Field of View & Focal Planes	Felix Bork	FOV + Focal Planes
Tue	29.01.19	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Lecture	Visualization	Jakob Weiss	Visualization
Thu	31.01.19	16:00 - 17:30	00.04.011, MI Hörsaal 2 (5604.EG.011)	Projects	Project Progress	All Tutors
Tue	05.02.19	12:00 - 13:30	03.13.010, Seminarraum (5613.03.010)	Exercise	Exam Preparation	All Tutors	Last Year's Exam,  Last Year's Exam Solution
Fri	08.02.19	15:00 - 18:00	03.13.010, Seminarraum (5613.03.010)	Projects	Final Presentations (Posters & Demos)	All Tutors
Mon	18.02.19	10:30 - 11:45	102, Interims Hörsaal 2 (5620.01.102)	Final Exam

General Literature on Lecture Content

• R.Hartley and A.Zisserman: Multiple View Geometry in Computer Vision; Cambridge University Press, 2004. Online version
• D.Ballard and C.Brown: Computer Vision. Online version
• R.Tsai: A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision. Download from CALTECH.
• J.Rolland, L.Davis, Y. Baillot: A Survey of Tracking Technology for Virtual Environments; in Fundamentals of Wearable Computers and Augmented, 2001. Download from UPenn.
• D.Allen, G.Bishop, G.Welch: Tracking - Beyond 15 Minutes of Thought; Course 11 at Siggraph 2001. Download from UNC.
• J.Rolland, H. Fuchs: Optical versus See-Through Head-Mounted Displays; in Fundamentals of Wearable Computers and Augmented, 2001. Download from citeseer.
• M.Tuceryan, Y.Genc, N.Navab: Single Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration; in Presence: Teleoperators and Virtual Environments, 11(3), 2002. Download from M. Tuceryan's home page.
• P.Milgram, Colquhoun: A Taxonomy of Real and Virtual World Display Integration; in Proc. International Symposium of Mixed Reality (ISMR 1999). Download from ebookbrowse.
• M.Weiser: The Computer for the Twenty-First Century; Scientific American, 1991. Download from ubiq.com.
• R. Szeliski: Computer Vision - Algorithms and Applications, Springer Verlag, 2011. Online Version

Unity

• Unity documentation: https://docs.unity3d.com/2017.3/Documentation/Manual/