Revise the logging functionality and add log about tensorboard #2859

sxjscience · 2023-02-07T08:13:21Z

Issue #, if available:

#2049

Description of changes:

Improve logging to mention the usage of tensorboard:

When the training just started:

Start training!! The model file will be saved to /home/ubuntu/workspace/AutogluonModels/ag-20230207_080957. The validation metric is "pearsonr". To inspect the learning process, you can launch a tensorboard environment via the following command:

```shell
tensorboard --logdir /home/ubuntu/workspace/AutogluonModels/ag-20230207_080957
```

When the training completed:

Training finished!! Models and intermediate outputs are saved to /home/ubuntu/workspace/AutogluonModels/ag-20230207_080957. 

To load the trained predictor, use the following code 

```python
from autogluon.multimodal import MultiModalPredictor

predictor = MultiModalPredictor.load("/home/ubuntu/workspace/AutogluonModels/ag-20230207_080957")
```

To track the training process, you can launch a tensorboard

```shell
tensorboard --logdir /home/ubuntu/workspace/AutogluonModels/ag-20230207_080957
```

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

github-actions · 2023-02-07T09:47:55Z

Job PR-2859-23a6d96 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/23a6d96/index.html

bryanyzhu

LGTM, thanks for improving the logging functionality.

multimodal/src/autogluon/multimodal/utils/log.py

github-actions · 2023-02-07T20:34:29Z

Job PR-2859-9da3486 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/9da3486/index.html

github-actions · 2023-02-07T20:42:43Z

Job PR-2859-2d3404f is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/2d3404f/index.html

github-actions · 2023-02-08T00:02:34Z

Job PR-2859-c6a1815 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/c6a1815/index.html

github-actions · 2023-02-08T00:10:58Z

Job PR-2859-704fc28 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/704fc28/index.html

multimodal/src/autogluon/multimodal/utils/log.py

Innixma · 2023-02-08T00:17:53Z

multimodal/src/autogluon/multimodal/predictor.py

-        logger.info(f"Models and intermediate outputs are saved to {self._save_path} ")
+
+        # TODO(?) We should have a separate "_post_training_event()" for logging messages.
+        logger.info(get_fit_complete_message(self._save_path))


Is info shown by default or only if the user increases verbosity? In what situation will the user see the new logs added in this PR?

It's shown by default (verbosity=2,3).

@Innixma Our logger seems to have a bug. Setting verbosity=4 doesn't print the messages in logger.debug().

@zhiqiangdon Can you create a GitHub issue with a minimal reproducible example with the logger in isolation?

multimodal/src/autogluon/multimodal/utils/log.py

github-actions · 2023-02-08T00:20:22Z

Job PR-2859-1ea20ad is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/1ea20ad/index.html

multimodal/src/autogluon/multimodal/utils/log.py

github-actions · 2023-02-08T01:46:21Z

Job PR-2859-afbb31e is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/afbb31e/index.html

github-actions · 2023-02-08T02:00:26Z

Job PR-2859-a1a29e9 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/a1a29e9/index.html

github-actions · 2023-02-08T02:05:07Z

Job PR-2859-f983589 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/f983589/index.html

github-actions · 2023-02-08T02:12:49Z

Job PR-2859-c710935 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/c710935/index.html

github-actions · 2023-02-08T02:22:46Z

Job PR-2859-28ef00d is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/28ef00d/index.html

github-actions · 2023-02-08T02:28:15Z

Job PR-2859-4b680d6 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/4b680d6/index.html

github-actions · 2023-02-08T03:42:04Z

Job PR-2859-62f34e9 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/62f34e9/index.html

github-actions · 2023-02-08T03:49:19Z

Job PR-2859-5308445 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/5308445/index.html

…sorboard

Innixma

LGTM! We can probably do any remaining cleanup of logging during code freeze for minor changes

github-actions · 2023-02-09T21:48:23Z

Job PR-2859-f1821db is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/f1821db/index.html

…sorboard

github-actions · 2023-02-10T07:40:20Z

Job PR-2859-c93ad31 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-2859/c93ad31/index.html

sxjscience added 14 commits February 6, 2023 23:43

Update predictor.py

3d5b086

Update predictor.py

610343d

Update predictor.py

dd82e6b

Update predictor.py

3952551

Update predictor.py

0fc9199

Update predictor.py

0cec03a

Update predictor.py

ede49dd

Update predictor.py

1ef1c53

update

4c608ff

update

f306bac

Update predictor.py

1236337

Update log.py

5feae55

Update predictor.py

45e6b3c

Update log.py

23a6d96

bryanyzhu approved these changes Feb 7, 2023

View reviewed changes

multimodal/src/autogluon/multimodal/utils/log.py Outdated Show resolved Hide resolved

sxjscience added 3 commits February 7, 2023 10:45

improve logging message

11ad3e1

Update log.py

2d3404f

fix log message

9da3486

Update log.py

81ba76f

sxjscience added 8 commits February 7, 2023 13:34

Update log.py

06d7d1e

Update predictor.py

f3e9fb9

Update predictor.py

878196e

Update log.py

9c43c0c

Update log.py

4d34b17

Update log.py

c6a1815

Update predictor.py

704fc28

Update log.py

cd271cf

sxjscience requested a review from Innixma February 8, 2023 00:14

Innixma reviewed Feb 8, 2023

View reviewed changes

multimodal/src/autogluon/multimodal/utils/log.py Outdated Show resolved Hide resolved

Innixma reviewed Feb 8, 2023

View reviewed changes

multimodal/src/autogluon/multimodal/utils/log.py Outdated Show resolved Hide resolved

sxjscience added 5 commits February 7, 2023 16:27

Update log.py

a1a29e9

Update log.py

f983589

Update log.py

c710935

Update log.py

28ef00d

Update log.py

4b680d6

Update log.py

62f34e9

Update log.py

5308445

Merge remote-tracking branch 'upstream/master' into add_log_about_ten…

89b288e

…sorboard

Innixma approved these changes Feb 8, 2023

View reviewed changes

update

f1821db

Merge remote-tracking branch 'upstream/master' into add_log_about_ten…

c93ad31

…sorboard

sxjscience merged commit bfc40a7 into autogluon:master Feb 10, 2023

sxjscience mentioned this pull request Feb 10, 2023

[Multimodal] Add Documentation for using Tensorboard in AutoMM #2049

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Revise the logging functionality and add log about tensorboard #2859

Revise the logging functionality and add log about tensorboard #2859

sxjscience commented Feb 7, 2023

github-actions bot commented Feb 7, 2023

bryanyzhu left a comment

github-actions bot commented Feb 7, 2023

github-actions bot commented Feb 7, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

Innixma Feb 8, 2023

sxjscience Feb 8, 2023

zhiqiangdon Feb 8, 2023

Innixma Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

Innixma left a comment

github-actions bot commented Feb 9, 2023

github-actions bot commented Feb 10, 2023

Revise the logging functionality and add log about tensorboard #2859

Revise the logging functionality and add log about tensorboard #2859

Conversation

sxjscience commented Feb 7, 2023

github-actions bot commented Feb 7, 2023

bryanyzhu left a comment

Choose a reason for hiding this comment

github-actions bot commented Feb 7, 2023

github-actions bot commented Feb 7, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

Innixma Feb 8, 2023

Choose a reason for hiding this comment

sxjscience Feb 8, 2023

Choose a reason for hiding this comment

zhiqiangdon Feb 8, 2023

Choose a reason for hiding this comment

Innixma Feb 8, 2023

Choose a reason for hiding this comment

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

github-actions bot commented Feb 8, 2023

Innixma left a comment

Choose a reason for hiding this comment

github-actions bot commented Feb 9, 2023

github-actions bot commented Feb 10, 2023