Skip to content

Hellodecentralization Nevermined: Leveraging Blockchain to Unlock Data for Federated Learning

Notifications You must be signed in to change notification settings

nevermined-io/hellodecentralization

Repository files navigation

banner

Hellodecentralization Nevermined Workshop

Nevermined: Leveraging Blockchain to Unlock Data for Federated Learning

In this workshop we will be presenting the Nevermined data ecosystem being developed by Keyko. This will be a follow along session and so we encourage all attendees to perform the setup describe in this repo prior to the workshop. We will start by giving and overview of what Nevermined is and what it can do and we will follow that with a follow along coding session focused on the Data In-Situ Computation (DISC) capabilities of Nevermined.

This workshop will be based on the Credit Card Fraud Detection Demo which we wrote about previously.


Agenda

  1. Introducing Keyko
  2. Overview of Nevermined
  3. Follow along workshop
    1. Data publish and consume flow with the marketplace
    2. Publishing data for compute
    3. Publishing algorithms
    4. Running a distributed compute job over multipe datasets with Federated Learning
  4. Q & A

Setup

Requirements

We need to setup both nevermined and the environment for this workshop

Setup and start nevermined

  1. Clone the nevermined-tools repo
$ git clone git@github.com:nevermined-io/tools.git
$ cd tools/
  1. Start Nevermined
$ ./start_nevermined.sh --events-handler --compute --latest
  1. Wait for all the services to be up and running. This may take a few minutes
$ ./scripts/wait_for_compute_api.sh

Setup the workshop repo

  1. If you don't have virtualenv you can install it with
$ pip install virtualenv --user
  1. Create a new virtual environment for the workshop
$ virtualenv venv
$ source venv/bin/activate
  1. The new dependency resolution in pip creates problems with the nevermined sdk so we are going to use a previous version
$ pip install pip==20.2.4
  1. Install all the dependencies we are going to need for this workshop
$ pip install .
  1. Copy the contract artifacts from created by nevermined-tools
$ ./scripts/wait_for_migration_and_extract_keeper_artifacts.sh
  1. Run the tests to make sure everything is working
$ pytest -vs

About

Hellodecentralization Nevermined: Leveraging Blockchain to Unlock Data for Federated Learning

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published