TeachingSs08CVSpecialEffectsLabCourse

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Praktikum: 3D Computer Vision for Special Effects

by Prof. Navab
Tutors: Dr. Selim Benhimane and Stefan Hinterstoisser, Alexander Ladikos, Martin Horn
Typ: Praktikum (Theoretische Informatik + Master)
SWS: 6+0
Generelle Studienplaneinordnung: BS-INF WA ab 5, INF. theor. WP ab 5
ECTS: 10 Credits
Weekly Meeting: Tuesday 14:30-16:00 in MI 03.13.008
There is no preliminary discussion (Vorbesprechung) but ALERT! a questionnaire!

The course will be conducted in English.

This lab course has been inspired by a similar one designed and developed by Prof. Irfan Essa at Georgia Tech.

Announcements

About the Course:

The lab course is designed to teach basic 3D computer vision algorithms with hands on practical examples from robot vision, augmented reality, and special effects for movies. The first weeks will be exercises which provide the basic skills in 3D Computer vision, like main algorithms in mono and stereo vision. The second part will be about computer graphics, particularly geometric modeling, animation and advanced special effects (e.g. adding fire or explosions ). The third part is about general editing of video streams required for producing professional looking movies. The final assignment is a self-contained project, like a video augmentation of short clips, rendering virtual persons into a scene or the famous "Matrix" effect from the cinema.

This class is inspired by a similar one offered by Prof. Irfan Essa at Georgia Tech. College of Computing, who provided us with information and support for establishing this new and exciting tradition at TUM.

It is complementary to the lecture 3D computer vision I in the winter terms which are of great benefit, but not compulsory. Visiting the lecture 3D computer vision II in the summer term is also recommended.

You can obtain an impression of the results from last years praktikum

There is a questionnaire (due to February 23, 2008) for the team building process. After this questionnaire we will propose some students who confirm a founded knowledge in the theory of 3D Computer Vision to form groups to deal with more complex and more fun projects on video augmentation and diminished reality.

Schein requirements

  • Weekly participation in the weekly meetings
  • Submission of all assignments in time
  • Present your final assignment work

The assignment submission

Send the assignment to by email.
The email subject should be “SPECIAL_EFFECT_1_Familyname” if it is the first assignment done by Mr. Familyname.
The email subject should be “SPECIAL_EFFECT_2_Familyname” if it is the second assignment done by Mr. Familyname. ...
Each assignment is sent as a ZIP of a directory containing the Matlab functions and one Matlab script using these functions. The script file should be called “run_script”.
The ZIP file should be called like the email subject (and the same thing for the directory).
Each assignment is tested by the tutor as follows:
a - Unzip the ZIP file.
b - Go the obtained directory automatically created by the ZIP file when unzipped.
c - Run the script by typing “run_script”.
The script should call the functions and exits without any error. If this is the case, the script and the functions are eligible for correction. It is very important that all supplementary material should be in the zip file. Otherwise, the “run_script” function will exit with an error and the assignment will not be corrected.

Schedule

Date Type Topic Conducted by Material/Literature Solutions
Tue, Apr 15, 2008 C Welcome - Overview - Introduction to Matlab Dr. Selim Benhimane and Prof. Navab MatlabTutorial  
Tue, Apr 22, 2008 C Basic 2D Transformations, Duality Points Lines, Image Warping Dr. Selim Benhimane and Prof. Navab Blatt01.pdf  
Tue, Apr 29, 2008 C No Class due to CAMP Chair internal meeting      
Tue, May 6, 2008 C Feature extraction and tracking Dr. Selim Benhimane and Prof. Navab Blatt02.pdf  
Tue, May 13, 2008 C No Class      
Tue, May 20, 2008 C Your first Special Effect Dr. Selim Benhimane and Prof. Navab Blatt03.pdf  
Tue, May 27, 2008 C 3D modeling, animation, effects and rendering I Alexander Ladikos and Prof. Navab Maya.zip  
Tue, Jun 3, 2008 C 3D modeling, animation, effects and rendering II Alexander Ladikos and Prof. Navab Maya.pdf  
Tue, Jun 10, 2008 C Video Production I Martin Horn and Prof. Navab    
Tue, Jun 17, 2008 C Video Production II Martin Horn and Prof. Navab    
Tue, Jun 24, 2008 C Project Presentation - Discussions Invited Talk    
Tue, Jul 22, 2008 ALERT! C Project Final Presentation Dr. Selim Benhimane and Prof. Navab    

Literature

  • Multiple View Geometry in Computer Vision; by Richard Hartley, Andrew Zisserman
  • Three-Dimensional Computer Vision; by Olivier Faugeras
  • Computer Vision: A Modern Approach; by David A. Forsyth & Jean Ponce
  • Introductory Techniques for 3-D Computer Vision; by Emanuele Trucco & Alessandro Verri
  • The Geometry of Multiple Images: The Laws That Govern the Formation of Multiple Images of a Scene and Some of Their Applications; by Olivier Faugeras, Quang-Tuan Luong, Theodore H. Papadopoullos; MIT Press; 2001

TeachingForm
Title: 3D Computer Vision for Special Effects
Professor: Prof. Navab
Tutors: Dr. Selim Benhimane and Stefan Hinterstoisser, Alexander Ladikos, Martin Horn
Type: Praktikum
Information: 6 SWS, 10ECTS
Term: 2008SoSe
Abstract: The lab course is designed to teach the mathematical background of 3D computer vision with hands on practical examples form robot vision, augmented reality, and special effects for movies. The first weeks will be exercises which provide the basic skills in 3D Computer vision, like main algorithms in mono and stereo vision. The second part will be about computer graphics, particularly geometric modelling, animation and advanced special effects (e.g. adding fire or explosions ). The third part is about general editing of video streams required for producing professional looking movies. The final assignment is a self-contained project, like a video augmentation of short clips, rendering virtual persons into a scene or the famous "Matrix" effect from the cinema. It is complementary to the lecture 3D computer vision I in the winter terms which are of great benefit, but not compulsory. Visiting the lecture 3D computer vision II in the summer term is also recommended.


Edit | Attach | Refresh | Diffs | More | Revision r1.25 - 10 Jul 2008 - 12:47 - SelimBenhimane

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif