Watermark removal

[azsunlight]

I fine-tuned the model via single video fine tuning, but the watermark is still there. Would like to know fine-tune detail that can remove the watermark

Many thanks

[azsunlight]

And also what dataset do you use for the fine-tuning. thx

[ExponentialML]

Hey @azsunlight.

Usually training the temporal attention layers ('attn1', 'attn2') at a learning rate of roughly 1e-5 and weight_decay 0 should be enough to get rid of the watermark.

If it still shows, you can try training the resnet or temp_conv layers as well, but note that it takes quite a bit of VRAM.

[azsunlight]

Hi @ExponentialML, thanks for the information. What dataset do you use for fine-tuning other than single-video?

Thanks again

[green-s]

@ExponentialML Could this technique potentially be applied to remove the watermark?

[ExponentialML]

@green-s & @azsunlight There was a PR that got merged with this feature in the inference script. Does this resolve the issue for you two?

[azsunlight]

@green-s & @azsunlight There was a PR that got merged with this feature in the inference script. Does this resolve the issue for you two?

Yes. It works. Thank you