FedScore is a framework for developing scoring systems across multiple sites in a privacy-preserving way. This repo contains the Python code for the proposed method. The R implementation is available here.
See also our newly published article for the whole story.
Cross-institutional collaboration has gained popularity in recent years as a way to accelerate medical research and facilitate quality improvement. Federated learning (FL) can avoid data sharing by collectively training algorithms without exchanging patient-level data. However, most FL applications in medical image data use black box models from computer vision. Interpretable models, on the contrary, have fewer instances of FL applications despite their popularity in clinical research.
As a type of interpretable risk scoring model, scoring systems have been employed in practically every diagnostic area of medicine. However, scoring systems have usually been created using single-source data, limiting application at other sites if the development data has insufficient sample size or is not representative. Although it is possible to develop scoring systems on pooled data, the process of doing such pooling is time-consuming and difficult to achieve due to privacy restrictions.
To fill this gap, we propose FedScore, a first-of-its-kind framework for building federated scoring systems across multiple sites.
The figure below provides a high-level overview of the FedScore algorithm:
- Python 3.9
- To install required Python packages, run
pip install -r requirements.txt
- In
FedScoredirectory, open three terminals. First start the server in the first terminal.
python server.py
- Then start two clients, one for each terminal.
python client1.py
python client2.py
Note that the current implementation is a proof of concept with the assumption that server and clients are on the same machine. It has not been adapted or tested for real-world commercial use cases. In addition, the implementation only supports data with binary outcomes.