Skip to content

Adding an example that shows MirroredStrategy #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
May 8, 2020
Merged

Adding an example that shows MirroredStrategy #3

merged 2 commits into from
May 8, 2020

Conversation

@sayakpaul
Copy link
Contributor

@sayakpaul sayakpaul commented May 8, 2020

The example already does a great job discussing different flavors of distributed training for Keras models. In the Further reading section, I just added a link to my article that shows the use of MirroredStrategy in a bit more detailed way.

fchollet
fchollet reviewed May 8, 2020
View reviewed changes
guides/distributed_training.py Outdated
https://www.tensorflow.org/api_docs/python/tf/distribute/MirroredStrategy)
4. [MultiWorkerMirroredStrategy docs](
https://www.tensorflow.org/api_docs/python/tf/distribute/experimental/MultiWorkerMirroredStrategy)
5. [Distributed training in `tf.keras`](https://towardsdatascience.com/distributed-training-in-tf-keras-with-w-b-ccf021f9322e)
Copy link
Contributor

@fchollet fchollet May 8, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the PR. Please use the full title of the article here. The link text should differentiate this link from the others, and should answer: why should the reader click on it?

Copy link
Contributor Author

@sayakpaul sayakpaul May 8, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the suggestion, I updated it. The article shows the use of MirroredStrategy and also discusses about some important gotchas like learning rate tuning, data pipeline optimization. Should I change the title of the article to reflect on that?

@fchollet fchollet merged commit b192f2a into keras-team:master May 8, 2020
fchollet pushed a commit that referenced this pull request Jan 18, 2021
@ksalama
Merge pull request #3 from keras-team/master
8f7ea74 
Probable error in example "TemporalSoftmax" (#320)
Ankur3107 added a commit to Ankur3107/keras-io that referenced this pull request Jun 27, 2021
@Ankur3107
comment keras-team#3
cdae4c3
fchollet added a commit that referenced this pull request Apr 18, 2022
@ariG23498 @sayakpaul @fchollet
Add: Probing ViTs (#853)
583383c 
* chore: adding probing-vits (#1)

* chore: adding probing-vits

* chore: review feedback

Co-authored-by: ariG23498 <aritra.born2fly@gmail.com>

* chore: applied black formatting with updated black.

* chore: added a note on keras reimplementation.

* chore: added a note on keras reimplementation.

* Adding: QnA (#2)

* chore: adding QnA for 3 sections

As soon as the later sections of code are added we will be adding the 2 leftover QnA sections

* feat: added visualization of projection and positional encoding. (#3)

* chore: adding the final qna

* chore: review feedback

* chore: reivew feedback II

* chore: typo

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Copyedits

* chore: applied pr feedback.

* Copyedits

* chore: added generated files.

* fix: tables.

* chore: added generated files.

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: François Chollet <francois.chollet@gmail.com>
mattdangerw pushed a commit to mattdangerw/keras-io that referenced this pull request Mar 27, 2025
@alexabbott
Merge pull request keras-team#3 from manuel-azenha/feature/docs-css-u…
e1f5723 
…pdates

feat: docs - more css updates
mattdangerw added a commit to mattdangerw/keras-io that referenced this pull request Mar 27, 2025
@mattdangerw
BYND redesign
a7b07a6 
Co-authored-by: Alex Abbott <alex.abbott@bynd.com>
Co-authored-by: Maciej Manista <maciej.manista@bynd.com>

commit 0033ea8
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Tue Mar 11 11:51:02 2025 -0700

    Remove github button from kears 3 announcement

commit f0d4190
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 10 14:35:25 2025 -0700

    Fixes parallax issue

commit d05b9ea
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 10 14:20:42 2025 -0700

    Adds more UAT tweaks

commit d2d434e
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Fri Mar 7 15:12:33 2025 -0800

    Adds color tweaks

commit 86c773f
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Fri Mar 7 14:36:07 2025 -0800

    Adds additional fixes

commit a4346ef
Merge: 877e385 a3c8291
Author: Alex Abbott <alex.r.abbott@gmail.com>
Date:   Fri Mar 7 14:29:32 2025 -0800

    Merge pull request keras-team#5 from manuel-azenha/bugfix/landing-sticky-textbox

    fix: landing page - sticky textbox section fix

commit a3c8291
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Fri Mar 7 22:17:03 2025 +0100

    fix: landing page - sticky textbox section fix

commit 877e385
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Fri Mar 7 09:13:39 2025 -0800

    Fixes more UAT issues

commit a1424af
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Fri Mar 7 07:49:41 2025 -0800

    Fixes a few more UAT issues

commit 3bbe12f
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Thu Mar 6 16:19:04 2025 -0800

    Addresses UAT and PR feedback

commit aa341e1
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Thu Mar 6 16:17:28 2025 -0800

    Address UAT and PR feedback

commit f150362
Merge: e1f5723 0a1407e
Author: Alex Abbott <alex.r.abbott@gmail.com>
Date:   Thu Mar 6 09:20:44 2025 -0800

    Merge pull request keras-team#4 from manuel-azenha/feature/docs-css-updates

    fix: docs styling - addressing QA feedback

commit 0a1407e
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Thu Mar 6 18:16:13 2025 +0100

    fix: docs styling - addressing QA feedback

commit e1f5723
Merge: 106d340 fedd27b
Author: Alex Abbott <alex.r.abbott@gmail.com>
Date:   Wed Mar 5 15:15:07 2025 -0800

    Merge pull request keras-team#3 from manuel-azenha/feature/docs-css-updates

    feat: docs - more css updates

commit fedd27b
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Wed Mar 5 19:10:52 2025 +0100

    feat: docs - more css updates

commit 106d340
Merge: 973822e 92d9c88
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Tue Mar 4 10:26:27 2025 -0800

    Merge branch 'feature/docs-css-updates'

commit 973822e
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Tue Mar 4 10:26:07 2025 -0800

    Adds theme enhancements

commit 92d9c88
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Tue Mar 4 18:23:12 2025 +0100

    feat: docs pages css updates

commit f80c024
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 3 21:15:02 2025 -0800

    Adds nav to subpages

commit b39decf
Merge: 7421345 5ef0724
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 3 13:10:50 2025 -0800

    Adds nav changes

commit 7421345
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 3 09:18:57 2025 -0800

    Adds changes for landing page

commit 5ef0724
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Mon Mar 3 15:31:48 2025 +0100

    feat: docs - sidenav rework

commit f3ca2c5
Author: mmanista-bynd <84510160+mmanista-bynd@users.noreply.github.com>
Date:   Mon Mar 3 17:05:55 2025 +0100

    feat: docs - sidenav rework (keras-team#1)

commit 09111ec
Author: manuel-azenha <145027312+manuel-azenha@users.noreply.github.com>
Date:   Wed Feb 26 18:18:52 2025 +0000

    add Images via upload

commit 5e79b3e
Author: Manuel Azenha <manuel.azenha@bynd.com>
Date:   Wed Feb 26 18:14:35 2025 +0000

    feat: add icons

commit ddf631c
Author: Manuel Azenha <manuel.azenha@bynd.com>
Date:   Wed Feb 26 18:13:43 2025 +0000

    feat: landing page desktop

commit 92165c4
Author: Manuel Azenha <manuel.azenha@bynd.com>
Date:   Tue Feb 25 10:12:30 2025 +0000

    feat: create webpack config
fchollet pushed a commit that referenced this pull request Mar 27, 2025
@mattdangerw
New landing and theme (#2071)
663d826 
* BYND redesign

Co-authored-by: Alex Abbott <alex.abbott@bynd.com>
Co-authored-by: Maciej Manista <maciej.manista@bynd.com>

commit 0033ea8
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Tue Mar 11 11:51:02 2025 -0700

    Remove github button from kears 3 announcement

commit f0d4190
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 10 14:35:25 2025 -0700

    Fixes parallax issue

commit d05b9ea
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 10 14:20:42 2025 -0700

    Adds more UAT tweaks

commit d2d434e
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Fri Mar 7 15:12:33 2025 -0800

    Adds color tweaks

commit 86c773f
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Fri Mar 7 14:36:07 2025 -0800

    Adds additional fixes

commit a4346ef
Merge: 877e385 a3c8291
Author: Alex Abbott <alex.r.abbott@gmail.com>
Date:   Fri Mar 7 14:29:32 2025 -0800

    Merge pull request #5 from manuel-azenha/bugfix/landing-sticky-textbox

    fix: landing page - sticky textbox section fix

commit a3c8291
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Fri Mar 7 22:17:03 2025 +0100

    fix: landing page - sticky textbox section fix

commit 877e385
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Fri Mar 7 09:13:39 2025 -0800

    Fixes more UAT issues

commit a1424af
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Fri Mar 7 07:49:41 2025 -0800

    Fixes a few more UAT issues

commit 3bbe12f
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Thu Mar 6 16:19:04 2025 -0800

    Addresses UAT and PR feedback

commit aa341e1
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Thu Mar 6 16:17:28 2025 -0800

    Address UAT and PR feedback

commit f150362
Merge: e1f5723 0a1407e
Author: Alex Abbott <alex.r.abbott@gmail.com>
Date:   Thu Mar 6 09:20:44 2025 -0800

    Merge pull request #4 from manuel-azenha/feature/docs-css-updates

    fix: docs styling - addressing QA feedback

commit 0a1407e
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Thu Mar 6 18:16:13 2025 +0100

    fix: docs styling - addressing QA feedback

commit e1f5723
Merge: 106d340 fedd27b
Author: Alex Abbott <alex.r.abbott@gmail.com>
Date:   Wed Mar 5 15:15:07 2025 -0800

    Merge pull request #3 from manuel-azenha/feature/docs-css-updates

    feat: docs - more css updates

commit fedd27b
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Wed Mar 5 19:10:52 2025 +0100

    feat: docs - more css updates

commit 106d340
Merge: 973822e 92d9c88
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Tue Mar 4 10:26:27 2025 -0800

    Merge branch 'feature/docs-css-updates'

commit 973822e
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Tue Mar 4 10:26:07 2025 -0800

    Adds theme enhancements

commit 92d9c88
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Tue Mar 4 18:23:12 2025 +0100

    feat: docs pages css updates

commit f80c024
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 3 21:15:02 2025 -0800

    Adds nav to subpages

commit b39decf
Merge: 7421345 5ef0724
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 3 13:10:50 2025 -0800

    Adds nav changes

commit 7421345
Author: Alex Abbott <alex.abbott@bynd.com>
Date:   Mon Mar 3 09:18:57 2025 -0800

    Adds changes for landing page

commit 5ef0724
Author: Maciej Manista <maciej.manista@bynd.com>
Date:   Mon Mar 3 15:31:48 2025 +0100

    feat: docs - sidenav rework

commit f3ca2c5
Author: mmanista-bynd <84510160+mmanista-bynd@users.noreply.github.com>
Date:   Mon Mar 3 17:05:55 2025 +0100

    feat: docs - sidenav rework (#1)

commit 09111ec
Author: manuel-azenha <145027312+manuel-azenha@users.noreply.github.com>
Date:   Wed Feb 26 18:18:52 2025 +0000

    add Images via upload

commit 5e79b3e
Author: Manuel Azenha <manuel.azenha@bynd.com>
Date:   Wed Feb 26 18:14:35 2025 +0000

    feat: add icons

commit ddf631c
Author: Manuel Azenha <manuel.azenha@bynd.com>
Date:   Wed Feb 26 18:13:43 2025 +0000

    feat: landing page desktop

commit 92165c4
Author: Manuel Azenha <manuel.azenha@bynd.com>
Date:   Tue Feb 25 10:12:30 2025 +0000

    feat: create webpack config

* Matt's fixes

* Minor updates

* Remove box shadows for examples
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@fchollet fchollet fchollet approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@sayakpaul @fchollet