Model Heterogeneity in Federated Learning - Revision history

Slawek at 16:52, 17 September 2022

2022-09-17T16:52:35Z

Slawek at 15:48, 20 September 2021

2021-09-20T15:48:19Z

Amira at 10:16, 8 October 2020

2020-10-08T10:16:12Z

Amira at 10:14, 8 October 2020

2020-10-08T10:14:10Z

Amira at 09:46, 8 October 2020

2020-10-08T09:46:25Z

Amira: Created page with "{{StudentProjectTemplate |Summary=Group users within a federated learning environment into different learning overlays according to their behavioural similarities |Keywords=Fe..."

2020-10-08T09:45:34Z

Created page with "{{StudentProjectTemplate |Summary=Group users within a federated learning environment into different learning overlays according to their behavioural similarities |Keywords=Fe..."

New page

{{StudentProjectTemplate
|Summary=Group users within a federated learning environment into different learning overlays according to their behavioural similarities
|Keywords=Federated Learning, Clustering
|Supervisor=Amira Soliman, Sławomir Nowaczyk,
}}
Federated Learning (FL) has been introduced as an alternative distributed and privacy-friendly learning approach. FL allows users to train models locally on their devices using their sensitive data, and communicate intermediate model updates to a central server without the need to centrally store the data. The principal advantage of FL is the decoupling of global model training from the need for direct access to the raw data. Accordingly, FL offers a solution to learn from private personal data such as biometrics, text input, and location coordinates where models can be trained for many services in a privacy-preserving manner.

Generating a single global model that accumulates all user behaviors might not produce the best model for particular categories of users. Specifically, the global averaging model enforces a bias towards the behavioral patterns provided by the majority, while suppressing the patterns of less significant users. Thus, it is interesting to provide overlay-based FL techniques that can group users in different learning overlays according to their behavioral similarities. The objective of this thesis is to introduce a mechanism for grouping users with similar behaviors and develop a hierarchical aggregation mechanism to provide more than one model, automatically identifying the best group for a given node.

@@ Line 2: / Line 2: @@
 |Summary=Group users within a federated learning environment into different learning overlays according to their behavioural similarities
 |Keywords=Federated Learning, Clustering
-|TimeFrame=Fall 2021
+|TimeFrame=Fall 2022
 |References=Advances and Open Problems in Federated Learning:
 https://hal.inria.fr/hal-02406503/document

@@ Line 2: / Line 2: @@
 |Summary=Group users within a federated learning environment into different learning overlays according to their behavioural similarities
 |Keywords=Federated Learning, Clustering
 |References=Advances and Open Problems in Federated Learning:
 https://hal.inria.fr/hal-02406503/document
 FedML: A Research Library and Benchmark for Federated Machine Learning: https://arxiv.org/pdf/2007.13518.pdf
 |Supervisor=Amira Soliman, Sławomir Nowaczyk,
 |Level=Master

@@ Line 3: / Line 3: @@
 |Keywords=Federated Learning, Clustering
 |Supervisor=Amira Soliman, Sławomir Nowaczyk,
 }}
 Federated Learning (FL) has been introduced as an alternative distributed and privacy-friendly learning approach. FL allows users to train models locally on their devices using their sensitive data, and communicate intermediate model updates to a central server without the need to centrally store the data. The principal advantage of FL is the decoupling of global model training from the need for direct access to the raw data. Accordingly, FL offers a solution to learn from private personal data such as biometrics, text input, and location coordinates where models can be trained for many services in a privacy-preserving manner.
 Generating a single global model that accumulates all user behaviors might not produce the best model for particular categories of users. Specifically, the global averaging model enforces a bias towards the behavioral patterns provided by the majority, while suppressing the patterns of less significant users. Thus, it is interesting to provide overlay-based FL techniques that can group users in different learning overlays according to their behavioral similarities. The objective of this thesis is to introduce a mechanism for grouping users with similar behaviors and develop a hierarchical aggregation mechanism to provide more than one model, automatically identifying the best group for a given node.