Mosaicing Contact Person(s): Christian Wachinger

Keywords: Registration / Visualization, Medical Imaging

Abstract

The creation of mosaics is an interesting application, which leads to many challenging theoretical and practical problems. In this project, we are mainly focusing on viewing the mosaicing as a multiple image alignment task. Therefore, pairwise registration methods with a consecutive normalization and simultaneous registration techniques are in focus. Espcically the simultaneous alignment of images for mosaicing seems very promising. We earlier developed a new type of multivariate extension for similarity measures, which led to a whole new class metrics. They are specifically adapted for their usage in mosaicing, but can also be used for general multiple image alignment tasks, e.g. population studies. Our main interest lied so far on the combination of several ultrasound images. To this end, we are benifiting from a quite recent development in ultrasonographic research; the development of advanced 2D array ultrasound transducers. Their new fabrication process allows for higher resolution images with a higher quality resulting from the increased frequency spectrum that they can be operated with. The instantaneously acquired ultrasound volumes serve as input for our mosaicing framework, where they will be compounded to one lager volume.

Videos

Demonstration of simultaneous registration with a newly developed similarity measure on baby phantom

Publications

2012
	C. Wachinger, N. Navab A Contextual Maximum Likelihood Framework for Modeling Image Registration IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Providence, Rhode Island (USA), June 2012. (bib)
2010
	C. Wachinger, N. Navab Manifold Learning for Multi-Modal Image Registration 21st British Machine Vision Conference (BMVC), Aberystwyth, United Kingdom, August 31 - September 3 2010. (bib)
	C. Wachinger, N. Navab Structural Image Representation for Image Registration IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, California, June 2010. Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA). (bib)
2009
	C. Wachinger, N. Navab Alignment of Viewing-Angle Dependent Ultrasound Images. Medical Image Computing and Computer-Assisted Intervention (MICCAI), London, UK, September 20-24 2009 (bib)
	O. Kutter, W. Wein, N. Navab Multi-modal registration based Ultrasound Mosaicing Medical Image Computing and Computer-Assisted Intervention (MICCAI), London, UK, September 20-24 2009 (bib)
	C. Wachinger, N. Navab Similarity Metrics and Efficient Optimization for Simultaneous Registration IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Miami, Florida (USA), June 2009. (bib)
2008
	C. Wachinger, B. Glocker, J. Zeltner, N. Paragios, N. Komodakis, M. S. Hansen, N. Navab Deformable Mosaicing for Whole-body MRI Medical Image Computing and Computer-Assisted Intervention (MICCAI), New York, USA, September 6-10 2008 (bib)
	C. Wachinger Insights Into Three-Dimensional Ultrasound Mosaicing: Strategies for the alignment of multiple ultrasound volumes VDM Verlag Dr. Müller, Stuttgart, ISBN: 3836488264, December 23 2008, Amazon (bib)
	C. Wachinger, W. Wein, N. Navab Registration Strategies and Similarity Measures for Three-dimensional Ultrasound Mosaicing Journal of the University Radiologists, Academic Radiology 15 (11), pp.1404-1415. Special issue of MICCAI 2007 (bib)
	S. Atasoy, D. Noonan, S. Benhimane, N. Navab, G. Z. Yang A Global Approach for Automatic Fibroscopic Video Mosaicing in Minimally Invasive Diagnosis Medical Image Computing and Computer-Assisted Intervention, MICCAI, 2008, New York, USA, September 6-10 2008 (bib)
	C. Wachinger, R. Shams, N. Navab Estimation of Acoustic Impedance from Multiple Ultrasound Images with Application to Spatial Compounding IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska (USA), June 2008. Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA). (bib)
	C. Wachinger, N. Navab Ultrasound Specific Similarity Measures for Three-Dimensional Mosaicing. SPIE Medical Imaging, San Diego, California, USA, 16-21 February 2008 (bib)
2007
	C. Wachinger, W. Wein, N. Navab Three-Dimensional Ultrasound Mosaicing Medical Image Computing and Computer-Assisted Intervention, MICCAI, 2007, Brisbane, Australia, October 29 - November 2 2007 (bib)
	C. Wachinger, W. Wein, N. Navab Ultrasound Volume Stitching 6. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2007), Karlsruhe, Germany, October 2007 (bib)

Team

Contact Person(s)

Dr. Christian Wachinger

Working Group

Prof. Dr. Nassir Navab

Ramtin Shams

Location

Technische Universität München Institut für Informatik / I16 Boltzmannstr. 3 85748 Garching bei München Tel.: +49 89 289-17058 Fax: +49 89 289-17059

Visit our lab at Garching.



internal project page

Please contact Christian Wachinger for available student projects within this research project.

Mosaicing The creation of mosaics is an interesting application, which leads to many challenging theoretical and practical problems. In this project, we are mainly focusing on viewing the mosaicing as a multiple image alignment task. Therefore, pairwise registration methods with a consecutive normalization and simultaneous registration techniques are in focus. Espcically the simultaneous alignment of images for mosaicing seems very promising. We earlier developed a new type of multivariate extension for similarity measures, which led to a whole new class metrics. They are specifically adapted for their usage in mosaicing, but can also be used for general multiple image alignment tasks, e.g. population studies. Our main interest lied so far on the combination of several ultrasound images. To this end, we are benifiting from a quite recent development in ultrasonographic research; the development of advanced 2D array ultrasound transducers. Their new fabrication process allows for higher resolution images with a higher quality resulting from the increased frequency spectrum that they can be operated with. The instantaneously acquired ultrasound volumes serve as input for our mosaicing framework, where they will be compounded to one lager volume.

Three-dimensional Ultrasound Mosaicing The creation of 2D ultrasound mosaics is becoming a common clinical practice with a high clinical value. The next step coming along with the increasing availability of 2D array transducers is the creation of 3D mosaics. In the literature of ultrasound registration, the alignment of multiple images has not yet been addressed. Therefore, we propose registration strategies, which are able to cope with problems arising by multiple image alignment. We use pair-wise registration with a consecutive Lie normalization and simultaneous registration, which urges the usage of multivariate similarity measures. In this thesis, we propose alternative multivariate extensions based on a maximum likelihood framework. Due to the higher computational cost of simultaneous registration, we describe possibilities for speeding them up, among others, the usage of a stochastic pyramid. We also present methods to reduce speckle noise and to detect shadow in ultrasonographic volumes, to improve the overall registration performance. For the compounding of the final volume, a variety of approaches are listed, ranging from general to advanced ones. Experimental results, on multiple ultrasound data sets, show the good performance of the proposed registration strategies and similarity measures. keywords: ultrasound registration, three-dimensional (3D) mosaicing, ultrasound stitching, ultrasound compounding, extended field-of-view ultrasound, simultaneous registration, lie normalization, pairwise registration, multivariate similarity measures, global registration For furthr information on ultrasound mosaicing you can take a look at the page of the Diploma Thesis of Christian Wachinger. Project Members Christian Wachinger Nassir Navab Related Publications C. Wachinger, N. Navab A Contextual Maximum Likelihood Framework for Modeling Image Registration IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Providence, Rhode Island (USA), June 2012. (bib) C. Wachinger, N. Navab Manifold Learning for Multi-Modal Image Registration 21st British Machine Vision Conference (BMVC), Aberystwyth, United Kingdom, August 31 - September 3 2010. (bib) C. Wachinger, N. Navab Structural Image Representation for Image Registration IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, California, June 2010. Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA). (bib) C. Wachinger, N. Navab Alignment of Viewing-Angle Dependent Ultrasound Images. Medical Image Computing and Computer-Assisted Intervention (MICCAI), London, UK, September 20-24 2009 (bib) O. Kutter, W. Wein, N. Navab Multi-modal registration based Ultrasound Mosaicing Medical Image Computing and Computer-Assisted Intervention (MICCAI), London, UK, September 20-24 2009 (bib) C. Wachinger, N. Navab Similarity Metrics and Efficient Optimization for Simultaneous Registration IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Miami, Florida (USA), June 2009. (bib) C. Wachinger, B. Glocker, J. Zeltner, N. Paragios, N. Komodakis, M. S. Hansen, N. Navab Deformable Mosaicing for Whole-body MRI Medical Image Computing and Computer-Assisted Intervention (MICCAI), New York, USA, September 6-10 2008 (bib) C. Wachinger Insights Into Three-Dimensional Ultrasound Mosaicing: Strategies for the alignment of multiple ultrasound volumes VDM Verlag Dr. Müller, Stuttgart, ISBN: 3836488264, December 23 2008, Amazon (bib) C. Wachinger, W. Wein, N. Navab Registration Strategies and Similarity Measures for Three-dimensional Ultrasound Mosaicing Journal of the University Radiologists, Academic Radiology 15 (11), pp.1404-1415. Special issue of MICCAI 2007 (bib) S. Atasoy, D. Noonan, S. Benhimane, N. Navab, G. Z. Yang A Global Approach for Automatic Fibroscopic Video Mosaicing in Minimally Invasive Diagnosis Medical Image Computing and Computer-Assisted Intervention, MICCAI, 2008, New York, USA, September 6-10 2008 (bib) C. Wachinger, R. Shams, N. Navab Estimation of Acoustic Impedance from Multiple Ultrasound Images with Application to Spatial Compounding IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska (USA), June 2008. Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA). (bib) C. Wachinger, N. Navab Ultrasound Specific Similarity Measures for Three-Dimensional Mosaicing. SPIE Medical Imaging, San Diego, California, USA, 16-21 February 2008 (bib) C. Wachinger, W. Wein, N. Navab Three-Dimensional Ultrasound Mosaicing Medical Image Computing and Computer-Assisted Intervention, MICCAI, 2007, Brisbane, Australia, October 29 - November 2 2007 (bib) C. Wachinger, W. Wein, N. Navab Ultrasound Volume Stitching 6. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2007), Karlsruhe, Germany, October 2007 (bib)

Images Vessel: Baby: