Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.

Conversation

@bfineran
Copy link
Contributor

@bfineran bfineran commented Jun 24, 2022

adds a sparseml TensorBoardLogger to the transformers integration to enable tensorboard logging of sparsification modifier values.

implementation is currently setup so that TensorBoardLogger is only created if the default transformers tensorboard logging callback is setup and will share a logging directory with it so the sparsification and default transformers training values will both appear on the board.

default transformers tensorboard logged values include run arguments, epoch, loss, and learning rate.
the tensorboard logs are written to --logging_dir, so the tensorboard server can be launched with

tensorboard --logdir <LOGGING_DIR>

additionally investigating if there is any further information to be gained by setting sync_tensorboard=True in the wandb logger

@bfineran bfineran requested a review from a team June 24, 2022 21:29
@bfineran bfineran self-assigned this Jun 24, 2022
@bfineran bfineran requested review from InquestGeronimo, markurtz and natuan and removed request for a team June 24, 2022 21:29
@bfineran bfineran force-pushed the transformers-tensorboard-logging branch from 12537d2 to 70e1af4 Compare June 24, 2022 21:30
@bfineran bfineran merged commit be28f31 into main Jul 28, 2022
@bfineran bfineran deleted the transformers-tensorboard-logging branch July 28, 2022 15:02
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants