Skip to content
Permalink
Branch: master
Find file Copy path
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
57 lines (29 sloc) 4.09 KB

Overview

What is wandb?

Wandb is an experiment tracking tool for machine learning. We make it easy for anyone doing machine learning to keep track of experiments and share results with colleagues and their future self.

Here's a 1 minute overview video.

{% embed url="https://www.youtube.com/watch?v=icy3XkZ5jBk" %}

How does it work?

When you instrument your training code with wandb, our background process will collect useful data about what is happening as you train your models. For example, we can track model performance metrics, hyperparameters, gradients, system metrics, output files, and your most recent git commit.

{% page-ref page="../library/api/examples.md" %}

How hard is it to set up?

We know that most people track their training with tools like emacs and Google Sheets, so we've designed wandb to be as lightweight as possible. Integration should take 5-10 minutes, and wandb will not slow down or crash your training script.

Benefits of wandb

Our users tell us they get three kinds of benefits from wandb:

1. Visualizing training

Some of our users think of wandb as a "persistent TensorBoard". By default, we collect model performance metrics like accuracy and loss. We can also collect and display matplotlib objects, model files, system metrics like GPU usage, and your most recent git commit SHA + a patch file of any changes since your last commit.

You can also take notes about individual runs to be saved along with your training data. Here's a relevant example project from a class we taught to Bloomberg.

2. Organize and compare lots of training runs

Most people training machine learning models are trying lots and lots of versions of their model and our goal is to help people stay organized.

You can create projects to keep all of your runs in a single place. You can visualize performance metrics across lots of runs and filter, group, and tag them any way you like.

A good public example of a project is our friend Bingbin's crossing project. She ran and tagged a few hundred experiments. If you click on the icon next to the word "Runs" it will expand her table of runs. You can sort by accuracy, loss, or anything else.

3. Share your results

Once you have done lots of runs you usually want to organize them to show some kind of result. Our friends at Latent Space wrote a nice article called ML Best Practices: Test Driven Development that talks about how they use W&B reports to improve their team's productivity.

A user Boris Dayma wrote a public example report on Semantic Segmentation. He walks through various approaches he tried and how well they work.

We really hope that wandb encourages ML teams to collaborate more productively.

If you want to learn more about how teams use wandb, we've recorded interviews with our technical users at OpenAI and Toyota Research.

Teams

If you're working on a machine learning project with collaborators, we make it easy to share results.

  • Enterprise Teams: We support small startups and large enterprise teams like OpenAI and Toyota Research Institute. We have flexible pricing options to fit your team's needs, and we support hosted cloud, private cloud, and on-prem installations.
  • Academic Teams: We are dedicated to supporting the academic transparent and collaborative research. If you're an academic, we will grant you access to free teams to share your research in private projects.

If you'd like to share a project with people outside a team, click on the project privacy settings in the navigation bar and set the project to "Public." Anyone you share a link with will be able to see your public project results.

You can’t perform that action at this time.