ProjectMosaicing

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Mosaicing

Mosaicing

Contact Person(s): Christian Wachinger

Keywords: Registration / Visualization, Medical Imaging

Abstract

The creation of mosaics is an interesting application, which leads to many challenging theoretical and practical problems. In this project, we are mainly focusing on viewing the mosaicing as a multiple image alignment task. Therefore, pairwise registration methods with a consecutive normalization and simultaneous registration techniques are in focus. Espcically the simultaneous alignment of images for mosaicing seems very promising. We earlier developed a new type of multivariate extension for similarity measures, which led to a whole new class metrics. They are specifically adapted for their usage in mosaicing, but can also be used for general multiple image alignment tasks, e.g. population studies. Our main interest lied so far on the combination of several ultrasound images. To this end, we are benifiting from a quite recent development in ultrasonographic research; the development of advanced 2D array ultrasound transducers. Their new fabrication process allows for higher resolution images with a higher quality resulting from the increased frequency spectrum that they can be operated with. The instantaneously acquired ultrasound volumes serve as input for our mosaicing framework, where they will be compounded to one lager volume.

Videos

Demonstration of simultaneous registration with a newly developed similarity measure on baby phantom

Publications

2012
C. Wachinger, N. Navab
A Contextual Maximum Likelihood Framework for Modeling Image Registration
IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Providence, Rhode Island (USA), June 2012. (bib)
2010
C. Wachinger, N. Navab
Manifold Learning for Multi-Modal Image Registration
21st British Machine Vision Conference (BMVC), Aberystwyth, United Kingdom, August 31 - September 3 2010. (bib)
C. Wachinger, N. Navab
Structural Image Representation for Image Registration
IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, California, June 2010. Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA). (bib)
2009
C. Wachinger, N. Navab
Alignment of Viewing-Angle Dependent Ultrasound Images.
Medical Image Computing and Computer-Assisted Intervention (MICCAI), London, UK, September 20-24 2009 (bib)
O. Kutter, W. Wein, N. Navab
Multi-modal registration based Ultrasound Mosaicing
Medical Image Computing and Computer-Assisted Intervention (MICCAI), London, UK, September 20-24 2009 (bib)
C. Wachinger, N. Navab
Similarity Metrics and Efficient Optimization for Simultaneous Registration
IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Miami, Florida (USA), June 2009. (bib)
2008
C. Wachinger, B. Glocker, J. Zeltner, N. Paragios, N. Komodakis, M. S. Hansen, N. Navab
Deformable Mosaicing for Whole-body MRI
Medical Image Computing and Computer-Assisted Intervention (MICCAI), New York, USA, September 6-10 2008 (bib)
C. Wachinger
Insights Into Three-Dimensional Ultrasound Mosaicing: Strategies for the alignment of multiple ultrasound volumes
VDM Verlag Dr. Müller, Stuttgart, ISBN: 3836488264, December 23 2008, Amazon (bib)
C. Wachinger, W. Wein, N. Navab
Registration Strategies and Similarity Measures for Three-dimensional Ultrasound Mosaicing
Journal of the University Radiologists, Academic Radiology 15 (11), pp.1404-1415. Special issue of MICCAI 2007 (bib)
S. Atasoy, D. Noonan, S. Benhimane, N. Navab, G. Z. Yang
A Global Approach for Automatic Fibroscopic Video Mosaicing in Minimally Invasive Diagnosis
Medical Image Computing and Computer-Assisted Intervention, MICCAI, 2008, New York, USA, September 6-10 2008 (bib)
C. Wachinger, R. Shams, N. Navab
Estimation of Acoustic Impedance from Multiple Ultrasound Images with Application to Spatial Compounding
IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska (USA), June 2008. Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA). (bib)
C. Wachinger, N. Navab
Ultrasound Specific Similarity Measures for Three-Dimensional Mosaicing.
SPIE Medical Imaging, San Diego, California, USA, 16-21 February 2008 (bib)
2007
C. Wachinger, W. Wein, N. Navab
Three-Dimensional Ultrasound Mosaicing
Medical Image Computing and Computer-Assisted Intervention, MICCAI, 2007, Brisbane, Australia, October 29 - November 2 2007 (bib)
C. Wachinger, W. Wein, N. Navab
Ultrasound Volume Stitching
6. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2007), Karlsruhe, Germany, October 2007 (bib)

Team

Contact Person(s)

Christian Wachinger
Dr. Christian Wachinger

Working Group

Nassir Navab
Prof. Dr. Nassir Navab
Ramtin Shams
Ramtin Shams

Location



Technische Universität München
Institut für Informatik / I16
Boltzmannstr. 3
85748 Garching bei München

Tel.: +49 89 289-17058
Fax: +49 89 289-17059
Visit our lab at Garching.



internal project page

Please contact Christian Wachinger for available student projects within this research project.

Mosaicing

The creation of mosaics is an interesting application, which leads to many challenging theoretical and practical problems. In this project, we are mainly focusing on viewing the mosaicing as a multiple image alignment task. Therefore, pairwise registration methods with a consecutive normalization and simultaneous registration techniques are in focus. Espcically the simultaneous alignment of images for mosaicing seems very promising. We earlier developed a new type of multivariate extension for similarity measures, which led to a whole new class metrics. They are specifically adapted for their usage in mosaicing, but can also be used for general multiple image alignment tasks, e.g. population studies.

Our main interest lied so far on the combination of several ultrasound images. To this end, we are benifiting from a quite recent development in ultrasonographic research; the development of advanced 2D array ultrasound transducers. Their new fabrication process allows for higher resolution images with a higher quality resulting from the increased frequency spectrum that they can be operated with. The instantaneously acquired ultrasound volumes serve as input for our mosaicing framework, where they will be compounded to one lager volume.

Three-dimensional Ultrasound Mosaicing

The creation of 2D ultrasound mosaics is becoming a common clinical practice with a high clinical value. The next step coming along with the increasing availability of 2D array transducers is the creation of 3D mosaics. In the literature of ultrasound registration, the alignment of multiple images has not yet been addressed. Therefore, we propose registration strategies, which are able to cope with problems arising by multiple image alignment. We use pair-wise registration with a consecutive Lie normalization and simultaneous registration, which urges the usage of multivariate similarity measures. In this thesis, we propose alternative multivariate extensions based on a maximum likelihood framework. Due to the higher computational cost of simultaneous registration, we describe possibilities for speeding them up, among others, the usage of a stochastic pyramid.

We also present methods to reduce speckle noise and to detect shadow in ultrasonographic volumes, to improve the overall registration performance. For the compounding of the final volume, a variety of approaches are listed, ranging from general to advanced ones. Experimental results, on multiple ultrasound data sets, show the good performance of the proposed registration strategies and similarity measures.

keywords: ultrasound registration, three-dimensional (3D) mosaicing, ultrasound stitching, ultrasound compounding, extended field-of-view ultrasound, simultaneous registration, lie normalization, pairwise registration, multivariate similarity measures, global registration

For furthr information on ultrasound mosaicing you can take a look at the page of the Diploma Thesis of Christian Wachinger.

Project Members

Related Publications

C. Wachinger, N. Navab
A Contextual Maximum Likelihood Framework for Modeling Image Registration
IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Providence, Rhode Island (USA), June 2012. (bib)
C. Wachinger, N. Navab
Manifold Learning for Multi-Modal Image Registration
21st British Machine Vision Conference (BMVC), Aberystwyth, United Kingdom, August 31 - September 3 2010. (bib)
C. Wachinger, N. Navab
Structural Image Representation for Image Registration
IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, California, June 2010. Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA). (bib)
C. Wachinger, N. Navab
Alignment of Viewing-Angle Dependent Ultrasound Images.
Medical Image Computing and Computer-Assisted Intervention (MICCAI), London, UK, September 20-24 2009 (bib)
O. Kutter, W. Wein, N. Navab
Multi-modal registration based Ultrasound Mosaicing
Medical Image Computing and Computer-Assisted Intervention (MICCAI), London, UK, September 20-24 2009 (bib)
C. Wachinger, N. Navab
Similarity Metrics and Efficient Optimization for Simultaneous Registration
IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Miami, Florida (USA), June 2009. (bib)
C. Wachinger, B. Glocker, J. Zeltner, N. Paragios, N. Komodakis, M. S. Hansen, N. Navab
Deformable Mosaicing for Whole-body MRI
Medical Image Computing and Computer-Assisted Intervention (MICCAI), New York, USA, September 6-10 2008 (bib)
C. Wachinger
Insights Into Three-Dimensional Ultrasound Mosaicing: Strategies for the alignment of multiple ultrasound volumes
VDM Verlag Dr. Müller, Stuttgart, ISBN: 3836488264, December 23 2008, Amazon (bib)
C. Wachinger, W. Wein, N. Navab
Registration Strategies and Similarity Measures for Three-dimensional Ultrasound Mosaicing
Journal of the University Radiologists, Academic Radiology 15 (11), pp.1404-1415. Special issue of MICCAI 2007 (bib)
S. Atasoy, D. Noonan, S. Benhimane, N. Navab, G. Z. Yang
A Global Approach for Automatic Fibroscopic Video Mosaicing in Minimally Invasive Diagnosis
Medical Image Computing and Computer-Assisted Intervention, MICCAI, 2008, New York, USA, September 6-10 2008 (bib)
C. Wachinger, R. Shams, N. Navab
Estimation of Acoustic Impedance from Multiple Ultrasound Images with Application to Spatial Compounding
IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska (USA), June 2008. Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA). (bib)
C. Wachinger, N. Navab
Ultrasound Specific Similarity Measures for Three-Dimensional Mosaicing.
SPIE Medical Imaging, San Diego, California, USA, 16-21 February 2008 (bib)
C. Wachinger, W. Wein, N. Navab
Three-Dimensional Ultrasound Mosaicing
Medical Image Computing and Computer-Assisted Intervention, MICCAI, 2007, Brisbane, Australia, October 29 - November 2 2007 (bib)
C. Wachinger, W. Wein, N. Navab
Ultrasound Volume Stitching
6. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2007), Karlsruhe, Germany, October 2007 (bib)

Images

  • Vessel:

  • Baby:



Edit | Attach | Refresh | Diffs | More | Revision r1.6 - 25 Feb 2009 - 09:13 - ChristianWachinger

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif