Deep learning for clinical and pre-clinical research Image credits: NVIDIA;
Office
Center for Translational Cancer Research (TranslaTUM)
Klinikum rechts der Isar, Trogerstr 1, 81675 Munich
My TUM email address is not active anymore. In case of questions, please contact my colleagues at the chair or reach out to me via LinkedIn
Research Focus
My research interest is motivated by the tremendous potential impact of making Deep Learning-based computer vision applicable in everyday settings in clinical and pre-clinical research. This entails developing deep convolutional networks for detection, localization, and segmentation tasks in medical images of various modalities. Ensuring applicability in everyday settings typically requires elaborate strategies to deal with limited availability of annotated data, for instance making use of Transfer Learning or Data Augmentation.
I cooperate with Ali Ertürk's Lab at the Helmholtz Center Munich where I am leading the Artificial Intelligence Group. This work comprises research questions like automatic image segmentation and classification problems for general 3D anatomy, but also specific questions in the fields of stroke, dementia, and cancer.
DeepMACT - Deep learning based Metastasis Analysis in Cleared Tissue
The DeepMACT pipeline is an end-to-end procedure that enables highly automated detection and characterization of tumor micro-metastasis in large volumetric scans of whole cleared mice. This pipeline comprises two core technologies: DISCO tissue clearing and deep learning. For details, please refer to web resources and the article published in Cell (2019)
The AIMOS pipeline is an end-to-end procedure that enables fully automated segmentation of major organs (brain, lungs, heart, liver, kidneys, spleen, bladder, stomach, intestine) and the skeleton in large volumetric scans of whole mice. This method is independent of the imaging modality (we implemented it for light-sheet microscopy, native micro-CT, and contrast-enhanced micro-CT). In addition to the 3D segmentations for each organ, AIMOS can also provide a heatmap highlighting ambiguous image regions, allowing to localize and quantify inherent uncertainty. Besides the code and the pre-trained models, we also provide manually labeled datasets. For details, please refer to web resources and the article published in Nature Communications (2020)
We are inviting applications for several exciting research opportunities for Master students with our group. Please also feel free to reach out if you are interested in a Bachelor thesis, research project, etc. The projects are intended for students in Informatics, Electrical Engineering, or related fields. Please refer to the project descriptions below for more detailed information. Unfortunately, I cannot offer any new projects. If you are interested in student projects, please reach out to my IBBM colleagues directly.
We expect all students to have:
Prior theoretical knowledge on deep learning
Some practical experience with deep learning (PyTorch or TensorFlow)
Good Python coding skills
Ideally experience in computer vision / medical image analysis
Deep learning-based tumor detection in 3D scans
Deep transfer learning for 3D brain vessel segmentation
Deep learning-based tracing of single neurons and neural pathways
Distributed deep learning for large-scale medical image analysis
Deep learning-based 3D segmentation of prostate lesions
Analysis of CT scans from automotive OEM with deep learning
Deep learning-based multi-organ segmentation for MRI & CT
Deep learning-based multi-organ segmentation for 3D microscopy
Deep learning for multi-channel microscopy
Clinical application of deep learning for spine analysis
Machine learning analysis of sensor data for autonomous driving
S Zhao, M Todorov, R Cai, R al-Maskari, H Steinke, E Kemter, H Mai, Z Rong, M Warmer, K Stanic, O Schoppe, J Paetzold, B Gesierich, M Wong, T Huber, M Duering, O Bruns, B Menze, J Lipfert, V Puelles, E Wolf, I Bechmann, A Ertürk. Cellular and Molecular Probing of Intact Human Organs. Cell 2020
C Pan*, O Schoppe*, A Parra-Damas*, R Cai, M Todorov, G Gondi, B v. Neubeck, N Böğürcü-Seidel, S Seidel, K Sleiman, C Veltkamp, B Förstera, H Mai, Z Rong, O Trompak, A Ghasemigharagoz, M Reimer, A Cuesta, J Coronel, I Jeremias, D Saur, A Acker-Palmer, T Acker, B Garvalov, B Menze, R Zeidler, A Ertürk. Deep learning reveals cancer metastasis and therapeutic antibody targeting in entire body. Cell 2019 (free bioRxiv preprint (old version))