Diagrams which have notes will appear as dirty after being opened. The reason for this is the dirty check includes an exception for the labels of notes to ensure they are serialized.
The appropriate fix is to modify Note to be immutable and to require updating the BO. Furthermore when updating the BO, the diagram should compare the data of embedded objects and store as a field change.