Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

THIS WEBPAGE IS DEPRECATED - please visit our new website

MA/IDP: Federated Learning


Rami Eisawy


Federated learning is quickly becoming a key area of interest for its ability to potentially tackle the issue of training a global machine learning model without having the need for clients to share data externally. A common challenge in this distributed learning setting is 1) how do you effectively combine the client models into a global one (aggregation scheme) and 2) the heterogeneity of the data distribution (non-iid) among the clients negatively affects the performance of the server-side model.

A single algorithm/model has the potential to be deployed to multiple sites either via site-specific calibration and/or domain adaptation. This provides a favorable environment for clients in terms of performance, privacy and data ownership. However, there is the possibility to leverage information across all installations in the form of distributed training. In this setting, we can consider these various site installations as edge devices. The challenge remains in producing a global (server) model that is robust and efficient in terms of its aggregation scheme, tackles the heterogeneous nature of the nodes and whether or not the difficulty in data distribution across clients can be addressed at the server level to lead to a more accurate model.


The focus of the project will be the aggregation scheme. Recent projects have tackled this by simply using an average function (FedAvg?), personalisation layers (FedPer?) and matched averaging (FedMA?) to name a few. An internal CT brain model will be provided and ideally, the (Clara Train SDK) is utilised. Previous experience in another framework that supports custom components/models would also be acceptable and speed up development time.

The goal of this project is to develop methods to reuse the knowledge from previous scans. The possible direction can be:

  • Literature review of various papers in the field of federated learning
  • Simulate a distributed training setting using nvidia’s Clara SDK to create a global model
  • Evaluate performance of internal model in this setting under various aggregation schemes (AS) i.e FedMA?, FedAvg?
  • Improve performance of the current SOTA


  • Good programming skills: Python, Unix, Dockerisation
  • Knowledge of image processing and data analysis
  • Sound knowledge about deep learning, linear algebra and probability theory
  • Prior experience in Clara SDK beneficial


Federated learner setup.

Fig.1 Overview of a federated learner setup.

Title: Federated Learning @deepc
Director: Bjoern Menze
Supervisor: Rami Eisawy
Type: Master Thesis
Area: Machine Learning, Medical Imaging
Status: open
Thesis (optional):  

Edit | Attach | Refresh | Diffs | More | Revision r1.4 - 21 Apr 2021 - 10:38 - RamiEisawy