Skip to content

KyonQi/Simulating-Ring-AllReduce

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

English

Introduction

These codes are the experiments to simulate the attack on Ring AllReduce algorithm in Single GPU by Pytorch.

Therefore, what you need is a single GPU with Pytorch available.

BTW, the annotations in the codes will be rewritten in English later, if I have spare time LOL.

What's Ring AllReduce?

Ring AllReduce介绍

Introduction of Ring AllReduce

I really recommend the article posted latter(written in English one). After reading the article carefully, I believe that little problems would be occured for you to comprehend these codes.

What's the Attack?

Briefly, the aim of attack is to make the whole training process divergence (at least my attack is lol).

In Attack.py file, 2 kinds of treatments of data are provided.

Ending

Welcome any questions about the codes~~~.

About

Simulating Ring AllReduce in Single GPU By Pytorch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages