Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Add cloud profiler to training_utils #828

Merged
merged 69 commits into from
Nov 29, 2021
Merged

feat: Add cloud profiler to training_utils #828

merged 69 commits into from
Nov 29, 2021

Commits on Aug 23, 2021

  1. using dispatcher to relay requests for additional event senders

    @mkovalski
    mkovalski committed Aug 23, 2021
    Configuration menu
    Copy the full SHA
    99b3519 View commit details
    Browse the repository at this point in the history

  2. minor change for return value

    @mkovalski
    mkovalski committed Aug 23, 2021
    Configuration menu
    Copy the full SHA
    535a0b3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into profiler

    @mkovalski
    mkovalski committed Aug 23, 2021
    Configuration menu
    Copy the full SHA
    9c84c23 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2021

  1. reformatted

    @mkovalski
    mkovalski committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    1640a96 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/master' into profiler

    @mkovalski
    mkovalski committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    8c51461 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'profiler' of github.com:mkovalski/python-aiplatform int… 

    …o profiler
    @mkovalski
    mkovalski committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    b0594a4 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2021

  1. Merge branch 'master' into profiler

    @mkovalski
    mkovalski committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    fadcf9a View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2021

  1. type hints and changing mutable default

    @mkovalski
    mkovalski committed Aug 30, 2021
    Configuration menu
    Copy the full SHA
    83a803e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'profiler' of github.com:mkovalski/python-aiplatform int… 

    …o profiler
    @mkovalski
    mkovalski committed Aug 30, 2021
    Configuration menu
    Copy the full SHA
    f71c41f View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2021

  1. creating separate RunResourceManager for handling runs

    @mkovalski
    mkovalski committed Aug 31, 2021
    Configuration menu
    Copy the full SHA
    49b2727 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2021

  1. Merge branch 'main' of https://github.com/googleapis/python-aiplatform … 

    …into profiler
    @mkovalski
    mkovalski committed Sep 1, 2021
    Configuration menu
    Copy the full SHA
    17c3f8b View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2021

  1. moving additional functionality to uploader_utils to be shared by pro… 

    …file uploader
    @mkovalski
    mkovalski committed Sep 2, 2021
    Configuration menu
    Copy the full SHA
    833bbbb View commit details
    Browse the repository at this point in the history

  2. initial profile uploader commit, still needs testing

    @mkovalski
    mkovalski committed Sep 2, 2021
    Configuration menu
    Copy the full SHA
    75048d3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'profiler' of github.com:mkovalski/python-aiplatform int… 

    …o profiler_impl
    @mkovalski
    mkovalski committed Sep 2, 2021
    Configuration menu
    Copy the full SHA
    b7ba730 View commit details
    Browse the repository at this point in the history

  4. abstract methods for call, move items to uploader_utils

    @mkovalski
    mkovalski committed Sep 2, 2021
    Configuration menu
    Copy the full SHA
    400de49 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2021

  1. adding test objects for profiler

    @mkovalski
    mkovalski committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    4bc3912 View commit details
    Browse the repository at this point in the history

  2. merging from main

    @mkovalski
    mkovalski committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    097fa34 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2021

  1. have mock client create one platform names for testing

    @mkovalski
    mkovalski committed Sep 11, 2021
    Configuration menu
    Copy the full SHA
    17be71a View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2021

  1. additional tets for profile events

    @mkovalski
    mkovalski committed Sep 13, 2021
    Configuration menu
    Copy the full SHA
    9cd47b6 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2021

  1. more tests

    @mkovalski
    mkovalski committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    f3c7032 View commit details
    Browse the repository at this point in the history

  2. 100% coverage on profiler

    @mkovalski
    mkovalski committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    9907578 View commit details
    Browse the repository at this point in the history

  3. docstrings and typing

    @mkovalski
    mkovalski committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    89fcce0 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/main' into profiler_impl

    @mkovalski
    mkovalski committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    0107c54 View commit details
    Browse the repository at this point in the history

  5. moving training utils over from DEV branch

    @mkovalski
    mkovalski committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    5a4cd9a View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2021

  1. rename tensorboard to tensorboard_resource to avoid import conflicts,… 

    … support for local file uploads
    @mkovalski
    mkovalski committed Sep 21, 2021
    Configuration menu
    Copy the full SHA
    7dfd269 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/profiler_impl' into profiling_sdk

    @mkovalski
    mkovalski committed Sep 21, 2021
    Configuration menu
    Copy the full SHA
    6049df1 View commit details
    Browse the repository at this point in the history

  3. adding of tensorboard_resource file

    @mkovalski
    mkovalski committed Sep 21, 2021
    Configuration menu
    Copy the full SHA
    e469013 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2021

  1. moving profile plugin creation to TensorBoardUploader and added docst… 

    …rings
    @mkovalski
    mkovalski committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    05aaec1 View commit details
    Browse the repository at this point in the history

  2. merging from main

    @mkovalski
    mkovalski committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    35ecd1d View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2021

  1. Merge branch 'profiler_impl' into profiling_sdk

    @mkovalski
    mkovalski committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    78f6c5b View commit details
    Browse the repository at this point in the history

  2. adding additional environment variables for profiling SDK

    @mkovalski
    mkovalski committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    e68cc5c View commit details
    Browse the repository at this point in the history

  3. adding profile plugin and base plugin

    @mkovalski
    mkovalski committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    4d2ca8b View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2021

  1. adding profiler plugin and initializers

    @mkovalski
    mkovalski committed Sep 27, 2021
    Configuration menu
    Copy the full SHA
    134713d View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2021

  1. adding tests

    @mkovalski
    mkovalski committed Sep 28, 2021
    Configuration menu
    Copy the full SHA
    919c957 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2021

  1. README.rst

    @mkovalski
    mkovalski committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    415d528 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2021

  1. Merge branch 'main' into profiler_impl

    @sasha-gitg
    sasha-gitg committed Oct 4, 2021
    Configuration menu
    Copy the full SHA
    5c62724 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2021

  1. proper docstrings and type hints on files

    @mkovalski
    mkovalski committed Oct 6, 2021
    Configuration menu
    Copy the full SHA
    6534781 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'profiler_impl' of github.com:mkovalski/python-aiplatfor… 

    …m into profiler_impl
    @mkovalski
    mkovalski committed Oct 6, 2021
    Configuration menu
    Copy the full SHA
    df86310 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2021

  1. Merge branch 'profiler_impl' into profiling_sdk

    @mkovalski
    mkovalski committed Oct 7, 2021
    Configuration menu
    Copy the full SHA
    5459c4d View commit details
    Browse the repository at this point in the history

  2. updates to typing + docstrings

    @mkovalski
    mkovalski committed Oct 7, 2021
    Configuration menu
    Copy the full SHA
    8490990 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2021

  1. merges from main, add plugin to setup.py

    @mkovalski
    mkovalski committed Oct 12, 2021
    Configuration menu
    Copy the full SHA
    df6c7ba View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2021

  1. merging from main

    @mkovalski
    mkovalski committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    5930cb4 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2021

  1. moving around directory structure

    @mkovalski
    mkovalski committed Nov 1, 2021
    Configuration menu
    Copy the full SHA
    0d5b89d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into profiling_sdk

    @mkovalski
    mkovalski committed Nov 1, 2021
    Configuration menu
    Copy the full SHA
    ad926c6 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2021

  1. adding HTTP handler port as environment variable

    @mkovalski
    mkovalski committed Nov 2, 2021
    Configuration menu
    Copy the full SHA
    76a4acb View commit details
    Browse the repository at this point in the history

  2. add tests to support environment variables module

    @mkovalski
    mkovalski committed Nov 2, 2021
    Configuration menu
    Copy the full SHA
    1e92260 View commit details
    Browse the repository at this point in the history

  3. update tests for environment variables

    @mkovalski
    mkovalski committed Nov 2, 2021
    Configuration menu
    Copy the full SHA
    6ea3718 View commit details
    Browse the repository at this point in the history

  4. flake8 + black

    @mkovalski
    mkovalski committed Nov 2, 2021
    Configuration menu
    Copy the full SHA
    281c9c4 View commit details
    Browse the repository at this point in the history

  5. flake8 + black for tests

    @mkovalski
    mkovalski committed Nov 2, 2021
    Configuration menu
    Copy the full SHA
    38453cd View commit details
    Browse the repository at this point in the history

  6. docstring update for initializer

    @mkovalski
    mkovalski committed Nov 2, 2021
    Configuration menu
    Copy the full SHA
    cba4bdd View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2021

  1. update requirements

    @mkovalski
    mkovalski committed Nov 8, 2021
    Configuration menu
    Copy the full SHA
    ed42226 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into profiling_sdk

    @mkovalski
    mkovalski committed Nov 8, 2021
    Configuration menu
    Copy the full SHA
    940e3e1 View commit details
    Browse the repository at this point in the history

  3. importlib returns the module, check if this is None instead

    @mkovalski
    mkovalski committed Nov 8, 2021
    Configuration menu
    Copy the full SHA
    0bc0251 View commit details
    Browse the repository at this point in the history

  4. directly check for None

    @mkovalski
    mkovalski committed Nov 8, 2021
    Configuration menu
    Copy the full SHA
    17a2698 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into profiling_sdk

    @nicain
    nicain committed Nov 8, 2021
    Configuration menu
    Copy the full SHA
    50b2593 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into profiling_sdk

    @nicain
    nicain committed Nov 8, 2021
    Configuration menu
    Copy the full SHA
    c957a1b View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2021

  1. must rely on tensorflow 2.4.0

    @mkovalski
    mkovalski committed Nov 9, 2021
    Configuration menu
    Copy the full SHA
    6ea028f View commit details
    Browse the repository at this point in the history

  2. Add correct typing to _build_plugin

    @mkovalski
    mkovalski committed Nov 9, 2021
    Configuration menu
    Copy the full SHA
    20f1268 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2021

  1. resolving a number of comments

    @mkovalski
    mkovalski committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    348c0de View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2021

  1. Proper typing for WSGI related variables

    @mkovalski
    mkovalski committed Nov 18, 2021
    Configuration menu
    Copy the full SHA
    b7469ce View commit details
    Browse the repository at this point in the history

  2. Add test for catching ImportError while loading tensoflow

    @mkovalski
    mkovalski committed Nov 18, 2021
    Configuration menu
    Copy the full SHA
    983dbd3 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2021

  1. throw error if importing cloud_profiler fails

    @mkovalski
    mkovalski committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    d2e04ac View commit details
    Browse the repository at this point in the history

  2. module level import for TBContext

    @mkovalski
    mkovalski committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    7ff3bad View commit details
    Browse the repository at this point in the history

  3. apply black formatting

    @mkovalski
    mkovalski committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    58dd84f View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into profiling_sdk

    @mkovalski
    mkovalski committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    e6d7ded View commit details
    Browse the repository at this point in the history

  5. removed profiler from full_extra_requires, add requirements for testing

    @mkovalski
    mkovalski committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    2fc8eeb View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2021

  1. Merge branch 'main' into profiling_sdk

    @sasha-gitg
    sasha-gitg committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    e3808a4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into profiling_sdk

    @mkovalski
    mkovalski committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    1c211a6 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2021

  1. Merge branch 'main' into profiling_sdk

    @sasha-gitg
    sasha-gitg committed Nov 29, 2021
    Configuration menu
    Copy the full SHA
    dba42ff View commit details
    Browse the repository at this point in the history