Dataloader for heterogeneity

[johanos1]

Feature

Desired Behavior / Functionality

A dataloader class to be used by the clients. The dataloader should allow for heterogeneity among clients via, e.g., latent Dirichlet allocation (LDA).

What Needs to Be Done

• Implement a class to be used by the clients.
• Implement LDA sampling to parametrize the heterogeneity
• Enable scalability to many clients and large datasets where the dataloaders cannot be stored in RAM during the simulation.

How Can It Be Tested

• Large number of clients supported
• Datasets between clients are different
• Heterogeneity is controllable via parameter