Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

S. Conjeti, M. Paschali, A. Guha Roy, N. Navab
Deep Hashing for Large-Scale Medical Image Retrieval
Bildverarbeitung für die Medizin 2018 - Algorithmen - Systeme - Anwendungen. Proceedings des Workshops vom 11. bis 13. März 2018 in Erlangen
The original publication is available online at

Adoption of content-based image retrieval systems (CBIR) requires efficient indexing of the data contents in order to respond to visual queries without explicitly relying on textual keywords. Searching for similar data is closely related to the fundamental problem of nearest neighbor search. Exhaustive comparison of a query across the database is infeasible in large-scale retrieval as it is computationally expensive. Towards this, we propose scalable image retrieval techniques that employing hashing to learn semantics-preserving binary codes for indexing and retrieval. We leverage deep learning for end-to-end learning of hash-codes that are tailored for retrieval in large-scale medical image databases. Developing medical image CBIR systems is particularly challenging due to variability in image acquisition (contrast agents, protocol variations), anatomical variability, high-dimensionality of the data etc. We recently introduced Deep Residual Hashing (DRH) and Deep Multiple Instance Hashing (DMIH) which are deep hashing methods for medical image retrieval. DRH uses residual networks that terminate in dedicated binarization layers that generate hash-codes. It was trained with a multi-class variant of neighborhood component analysis (NCA) with dedicated losses such as quantization and bit-balance to improve hash code quality. DMIH extends DRH to a scenario of multiple instance learning by introduction of the multiple-instance pooling layer that aggregates representations from across member instances within a bag of samples. The aforementioned deep hashing methods were exhaustively validated and their fidelity was demonstrated on scenarios of retrieval on highly heterogeneous databases with significant population variability such as cardiopulmonary chest X-rays, breast mammography and breast histology, with highly competitive retrieval time (< 100 ms).
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each authors copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Edit | Attach | Refresh | Diffs | More | Revision r1.13 - 30 Jan 2019 - 15:16 - LeslieCasas

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif