Influence of the color jittering parameters

[PkuRainBow]

Great work! We find that you apply only the color jittering augmentation as the strong augmentation. So we are very interested in the influence of the choice of the color jittering parameters.

For example, the default setting in the release code is,

wss/core/preprocess_utils.py

Lines 715 to 718 in 8069dbe

	brightness = 0.5
	contrast = 0.5
	saturation = 0.5
	hue = 0.25

According to the previous SimCLR paper, we know they set them as follows:

  brightness = 0.8
  contrast = 0.8
  saturation = 0.8
  hue = 0.2

It would be great if you could share more results of the influence on the choices of these four hyperparameters!

[Yuliang-Zou]

Hi @PkuRainBow , thanks for your interest! We have an ablation study in Figure 5(e) of the paper.

We mainly adjust the strengths of brightness, contrast, and saturation. Using the same strength as in SimCLR leads to slightly worse performance. But a "strong enough" operation is necessary, otherwise, the model will overfit to the training set in the low-data regime. Overall, we find that 0.5 is a reasonable value.

[PkuRainBow]

@Yuliang-Zou Thanks for your explanation!