how to remove that watermark？

[suzhenghang]

use a lot of data or with more layers unfrozen could make it ?

[ExponentialML]

I've noticed that when finetuning, the watermark typically goes away over time.

For removing the watermark directly without finetuning, you could probably do it through post processing and inpainting similar to the following implementation:

https://github.com/braindotai/Watermark-Removal-Pytorch